Azure Event Hub is a fully managed, real-time data ingestion service that is simple, trusted and scalable. Stream millions of events per second from any source to build dynamic data pipelines and immediately respond to business challenges.
Ingest data from anywhere and develop real-time data pipelines across platforms. It’s simple, secure, scalable and open.
Sprinkle supports a wide range of data sources. On clicking the “+sign”, a list of data sources pops up. In this case, Azure Event Hub is selected. A new Azure Event Hub data source is named and created.
After naming the data source, the configure tab would require the user to fill in the Event hub connection string before testing the connection and updating it.
In Add Tables, the user must name the topic before selecting between automatic schema and manual schema. Sprinkle specializes in automatic schema features i.e. creating tables with automatic warehouse schema. On selecting “No” for automatic schema feature, it requires the user to fill in the warehouse schema.
In the Run and Schedule tab, the concurrency (number of tables that can run in parallel, a maximum of 7) can be set preferentially before running the job. The status of the job will be updated in the tab below once it’s complete. The jobs can also be set to run automatically by enabling autorun. By default, the frequency is set to every night. Frequency can be changed by clicking on More --> Autorun-->Change Frequency.