Manage Data Streams
Last updated
Last updated
A Data Stream is a visual representation of a flow of data, which is depicted by the use of Agents that are connected by arrows that allow data to flow from one Agent to the next. Data streams are built in an interactive canvas environment that allows you to drag Agents from the toolbox to a drawing area. These Agents allow you to complete certain actions on the data. This includes aggregating, filtering, displaying, or re-saving the data into another database.
It is recommended that you read the article listed below to improve your understanding of Data Streams.
To create a Data Stream, follow the steps below:
Open the New Data Streams page from the left-hand menu.
Give the Data Stream a name.
Enter a description.
Enter the type (streaming or recurring).
Enter the category under which the Data Stream is found in the Data Stream list.
Give the Data Stream an icon. Sample icons can be found in the Icon Library.
Enter the Collection the Data Stream will have.
Click Save.
Data Streams can be opened via the Data Streams Page on the left-hand menu, or via the main page that contains the list of Categories.
To open Data Streams from the left-hand menu:
Open the Data Streams page from the left-hand menu.
Select the Data Stream you want to open.
To open Data Streams from the list of categories:
Click the Logo to open the landing page.
Click the Category of the Data Stream.
3. Click the Data Stream you want to open.
To add Agents to the canvas, drag and drop Agents from the left-hand toolbox to make up the data flow for your Data Stream. An Agent that has been added to the canvas is called a Stream Object. See the Agents article for more information on Agents.
Enter part of the Agent name to filter the toolbox (or expand a category to view the list of Agents).
Click and drag an agent onto the Canvas.
Click the output endpoint and drag it to an input endpoint to connect two Stream Objects.
Stream Objects that are in the Data Stream can be copied and pasted using keyboard shortcuts. To copy a Stream object:
Select a Stream Object to highlight it.
To highlight multiple Stream Objects, hold the ctrl key while you are selecting them.
Once the Stream Object(s) are highlighted in yellow, press and hold ctrl + C.
To paste the Stream Object that was just copied, press and hold ctrl + P.
You can also copy a Stream Object from one Data Stream and paste it into a different Data Stream.
To delete a Stream Object on the canvas, follow the steps below:
Click a Stream Object to select it.
Click Delete.
You can also delete Stream Objects that are on the Data Stream canvas by using the 'delete' keyboard shortcut.
Select an Agent to highlight it.
To highlight multiple Agents, hold the ctrl key while you are selecting them.
Once the Stream Object/s are highlighted in yellow, click on the delete key on the keyboard.
To delete a Data Stream, follow the steps below:
Click Properties.
Click Delete.
Data Streams can be shared between users with differing permisson. See the Manage Access article to read more about managing access to users. To share a Data Stream, follow the steps below:
Click Manage Access.
Click Add.
Enter the user to which you want to grant access.
Choose between read, write, or co-owner permissions.
Click Ok.
To change permissions of existing users, follow the steps below:
Click on Manage Access.
Select the user.
3. Change their permissions. 4. Or, delete permissions for the user.
To remove the permissions for multiple users, follow the steps below:
Click Manage Access.
Click Select.
Select multiple users.
Click Delete.
To clone a Data Stream, follow the steps below:
From within the Data Stream canvas, click Properties.
Click Clone. This button may not initially be visible on the Properties page but can be found in the menu that appears if you hover with your mouse cursor over the “More” button.
Specify the name for the cloned Data Stream.
Choose a category to copy the Data Steam to. Please note that this should not be the same as the category of the original Data Stream.
Click Save.
