- 3 Minutes to read
How To Create a Data Source
- 3 Minutes to read
- You already have a Dataddo account. If you do not have an account already, sign up for 14-day trial.
Choosing the Connector
- Sign in to your Dataddo account and click on Sources at the top of the page.
- Click on Create Source in the top right corner.
- Choose the connector you would like to extract data from.
Connectors with datasets
Dataset-based connectors contain multiple pre-defined data models known in Dataddo as datasets. They typically represent individual API endpoints for a given service (e.g. Stripe, Gusto or Xero) that provide information about invoices, customers, bills, orders etc.. By default, all the attributes of each dataset are pre-selected, but you can still adjust the selection according to your preferences. Dataddo team puts an extra effort into organizing datasets in well-documented categories as well as labelling the individual attributes with "human-readable" names.
If you are looking for a specific metric or attribute you can use the search feature. If you type a name of specific metric into the search window, Dataddo will respond with datasets where such metric is present.
Connectors without datasets
Some connectors, such as Google Ads, Facebook (except Facebook Graph), Instagram, Salesforce or Hubspot are not dataset-based, thus giving you the complete freedom of composition of the attributes in the Source.
Choosing the Account
- After choosing the connector (and selecting dataset) you will ask to select an account that will be used for authorization and obtaining the data.
- When configuring the source for the first time, click on Add New Account at the bottom of the drop-down. You will be redirected to the authorization/sign-in page for the chosen service to authorize the account.
- If the account is already added, simple select the one you want to use.
Selecting metrics, dimensions and attributes
- By selecting metrics, dimensions or attributes (naming depends on each connector), you define the actual data model of the source (i.e. what columns will be included in the Source).
- Use in conjunction with Test data feature to validate the correct configuration.
Testing the configuration
Use Test data feature to probe your selection of attributes. This is also a great feature for data exploration, when you are just unsure about the actual meaning of certain attributes. Test data will populate them with live data, so you can easily discover values for each attribute.
Snapshotting is a process of collecting the data trough connector. For each of the connector, there is a default setting available, so we strongly recommend to use that. In case you want to configure it manually, please do the following:
- Select the frequency of which your data will be extracted. We recommend selecting Daily.
- If you would like to configure the advanced settings, you may choose your date range and time. However, we recommend you use the default settings.
NOTE: If the date range is available to select, you can load historical data. Read more in our guide.
- Before saving the source, preview your data by clicking on the Test Data button. Adjust the date range to see a more specific range of data.
- Click on Save and your new data source is ready to be added to a flow.
Error: Authorization Issue
- The selected account does not have a sufficient permissions to access the data.
- The selected account is expired or broken. Try to debug a re-authorize it. Some services (such as Linkedin) require regular re-authorization.
Error: There is no data in the source
- You may not have any data in the selected account. Try to select a different account.
- You may not have any data for the selected date range. Try to change the date range.
- You may not have any data for the selected metrics, attributes, or breakdowns. Try to reduce the amount of selected metrics, attributes, or breakdowns.
Error: Bad Request
- The combination of metrics, attributes, breakdowns and other parameters you have selected cannot be queried together. Try to reduce your selection. Also, please refer to the service's documentation to view a full list of which metrics can be included in the same source.
Error: API Limitation
- You might have hit the API limit of the service. This usually happens when you are asking for a longer date range or simply too much data. Try to wait few minutes and then re-try the process again.
- Please contact us and we will help you with the setup and debug the issue. To speed the process of resolving your issue, make sure you provide us with sufficient information.