JSON Universal Connector

JSON, or JavaScript Object Notation, is a lightweight data interchange format that is easy for humans to read and write and easy for machines to parse and generate. It is often used to transmit data between a server and a web application, as well as to store configuration information and structured data.

How to Create a JSON Data Source

Fill in Basic File Information

1. On the Sources page, click on the Create Source button and select the connector from the list.
2. Select the HTTP method which defines a set of request methods to indicate the desired action to be performed for a given resource.
3. Insert the URL of your JSON file. You can specify the date range in the URL. For more information, refer to the section on setting a date range.
4. [Optional] Select your account.
5. Select your snapshot keeping policy.

Specify Your HTTP Request

1. Define a short script, a brief transformation pipeline, to process the data from these APIs.
2. Define your HTTP headers, the name or value pairs that are displayed in the request and response messages of message headers for the HTTP protocol. In most cases, you will need to set this parameter for authorization or setting the content type.
3. [Optional] In the HTTP Body tab, you can see the data transmitted in an HTTP transaction message. Here, you can specify the date range. For more information, refer to the section on specifying a date range.
4. On the Schedule tab, choose your sync frequency or the exact synchronization time.

Preview Data and Save Your Data Source

1. Preview your data by by adding the array (square brackets [ ] ) symbols to the Transformation Pipeline tab.
2. Click on the Get Data button to test your transformation and see a preview table.
3. Click on Save Source and congratulations, your new data source is ready!

Troubleshooting

Specific Date Range

If you want to extract data from a specific time period, you can do so in the URL or HTTP body section.

Use static or dynamic date range to specify your date range. For more information, see our article on types of date ranges.