A Data Stream is a visual representation of the flow of data. It enables you to integrate and connect to multiple different systems or Data Sources in order to view your data. This can include real-time data from machines, websites, or other streaming data, or contextual data such as the make or model of a certain item.
The Data Stream Designer will allow you to see all of the connected data in one place and allow you to manipulate the data in different ways such as aggregating, filtering, displaying, or re-saving the data into another database. It will allow you to monitor the data to identify any critical events such as machine failures, without having to know how to code.
The Data Stream's flow of data is depicted by the use of Agents that are connected by arrows, allowing data to flow from one agent to the next and be processed upon reaching each agent, according to the function of that particular agent. This allows you to view data from multiple data sources in one place, and complete certain actions on the data.
The search bar can be used to find any specific Data Streams that you may be looking for. There is a dropdown option where you can specify to search through everything in Data Stream Designer, or only for Data Streams.
The Type selected in the Properties affects your choice of how often and when polling-based Agents run.
Streaming (Default): This allows you to specify a Polling Interval in seconds on polling-based Agents in the Stream Object configuration. Polling starts immediately and continues indefinitely.
Recurring: This allows you to specify granular options to schedule polling-based Agents in the Stream Object configuration. Options allow you to control the start time, repetition interval, and end time or number of repetitions. There is also the option to repeat indefinitely.
An advanced option that allows the Data Stream to compensate for large event sizes, a high number of events, or increased stream complexity by allocating more memory to the Data Stream. The default buffer size is 128kb.
Data streams are built in an interactive canvas environment that allows you to drag agents from the toolbox to a drawing area. Each agent’s user settings can then be configured in the same environment as where the stream was built. This page also allows for you to perform various tasks related to each data stream, including managing versions, defining business cases, etc. Stream Objects that are on the canvas can also be duplicated or deleted.
The toolbox is a component in the Data Stream Designer that allows you to choose an Agent from a library of Agents that have been uploaded to the system and drag the agent from the toolbox to the Canvas when building a stream. All agents in the toolbox will always be the latest version and will all be available for all users, regardless of their role, unless a user does not have permission to view any of the Agents.
Agents are grouped by category in the toolbox. To expand a category, click on the arrow next to the category name. Please note that if no agents in a particular category are uploaded, the entire category will be hidden. Thus, if you are missing some of the categories in the toolbox, it is likely that there aren’t any Agents uploaded belonging to that category.