With the addition of Webhook as a data source, Sprinkle now enables push based data ingestion as well, wherein the data source can push the data into Sprinkle systems.
SendGrid data source is built on top of Webhook, so data can be pushed from SendGrid to Sprinkle.
In order to create a Webhook data source, the user can click on the ‘+’ icon in the data sources page and select the webhook data source.
Upon selection and naming the webhook data source, a connection URL is generated.
An example of the URL could be:
The user needs to copy this URL and save it for editing later. Post copying, the user can click on create.
Post clicking on create, the user will be redirected to the data set page, wherein the user needs to name the Webhook table and click on ‘Create’.
This will create a table in the warehouse. But, this table will not have any data. Users can push data into this table using the Webhook URL created earlier.
In the URL, the user needs to fill the API details. In order to generate API keys, the user can go to Admin -> Permissions -> Api Keys.
Note: Please note, users with Analyst or Developer roles may not have access to the Admin tab. Please check with Admin for API key and secret.
Once on the Permissions page,the user can click on ‘ API keys’ and then ‘New’ to generate new API keys and secret keys.
Once the API key and secret key is generated, users can edit the Webhook URL and add the API key and secret key to the URL.
Post editing the URL, users can then schedule the jobs and select the ingestion frequency. It is recommended to set the Autorun frequency of ingestion to real time or every 1 hour. Bigger values of frequency are not recommended for webhook data.
This will enable the user to push data from data sources to Sprinkle.
More datasets can be added, if required and data can be sent to those tables by adding the table name in the webhook url.
For adding a new data set in the same data source, the user can go back to Datasets, click on “Add”.
Then the user needs to name the table and create a new table. After table creation user can send data webhook by passing tablename parameter. The Webhook URL with table will be as below.