JSON Universal Connector

JSON, or JavaScript Object Notation, is a lightweight data interchange format that is easy for humans to read and write and easy for machines to parse and generate. It is often used to transmit data between a server and a web application, as well as to store configuration information and structured data.

How to Create a JSON Data Source

Fill in Basic File Information

1. On the Sources page, click on the Create Source button and select the connector from the list.
2. Select the HTTP method to define a set of request methods.
3. Insert the URL of your JSON file. You can specify the date range in the URL. For more information, refer to the section on setting a date range.
4. If authorization is needed, select your account.
5. Select your snapshot keeping policy.

Specify Your HTTP Request

1. In the Transformation Pipeline window, define a short script to process the data from these APIs. You can also click on the Get transformation button. In most cases, it will auto-generate a transformation script for you.
   
2. Define your HTTP headers, name-value pairs that will be included in the request and response messages of the HTTP protocol. In most cases, you will need to set this parameter for authorization or setting the content type.
3. 4. [Optional] On the HTTP Body tab, you can see the data transmitted in an HTTP transaction message.
      In the HTTP Body tab, you can see the data transmitted in an HTTP transaction message. Here, you can specify the date range. For more information, refer to the section on specifying a date range.
4. On the Schedule tab, choose your sync frequency or the exact synchronization time.

Preview Data and Save Your Data Source

1. Make sure your transformation script has array symbols (square brackets [ ] ).
2. Click on the Get Data button to test your transformation and see a preview table.
3. Click on Save Source and congratulations, your new data source is ready!

Troubleshooting

Specific Date Range

If you want to extract data from a specific time period, you can do so in the URL or HTTP body section.

Use static or dynamic date range to specify your date range. For more information, see our article on types of date ranges.