Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information.
Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application.
Sprinkle supports a wide range of data sources. On clicking the “+sign”, a list of data sources pops up. In this case, Amazon Kinesis is selected. A new Amazon Kinesis data source is named and created.
After naming the data source, the configure tab would require the user to fill in the credentials such as Access key ID, Secret Access Key, and Region before testing the connection and updating.
In Add Tables, the user must name the stream before selecting between automatic schema and manual schema. Sprinkle specializes in automatic schema features i.e. creating tables with automatic warehouse schema. On selecting “No” for automatic schema feature, it requires the user to fill in the warehouse schema.
In the Run and Schedule tab, the concurrency (number of tables that can run in parallel, a maximum of 7) can be set preferentially before running the job. The status of the job will be updated in the tab below once it’s complete. The jobs can also be set to run automatically by enabling autorun. By default, the frequency is set to every night. Frequency can be changed by clicking on More --> Autorun-->Change Frequency.