- 4 Minutes to read
Starting with Dataddo
- 4 Minutes to read
Dataddo allows you to connect your sources and destinations in a few simple steps. However, to get the most out of your experience, let's take it from the beginning.
- How to Connect Data
What is Connector?
A Connector is a service you authorize your account with Dataddo, such as Facebook Insights, Facebook Ads, Google Analytics, Zoho Analytics, and many more.
Some of the services have their endpoints divided, therefore you find more than one connector under one service, for example, LinkedIn Organic and LinkedIn Ads.
What is Source?
In the Dataddo app, the Source is considered one stream or dataset of data with specific configuration settings. Therefore, you can have multiple sources under one connector.
Read more in-depth information about sources here.
You can have two sources under one Facebook Insight connector, each for a different Facebook page.
You can have two sources of the same connector but with different snapshotting settings for different reporting purposes, such as daily, weekly, monthly.
You can have three sources of the same connector e.g.Pipedrive, but with different datasets and metrics: contacts, leads, and organization.
Types of Sources by Structure
- Dataset-based - a data set in the Dataddo app refers to a pre-built set of metrics and attributes example, audience, persons, organization. If you need data from different datasets, you need to create different sources.
- Not dataset-based - all the metrics/attributes can be pulled via one source.
What is Destination?
In Dataddo, destinations are connectors to services usually such as BI dashboarding applications and warehouses. Simply, destinations are locations, where data from sources is sent to.
The main difference between the data warehouses and the dashboarding app is that the data warehouses have been designed to store large volumes of data and generally, they allow for more flexibility when storing this data.
You can use Dashboarding apps without a database, which can be a good solution for small amounts of data.
If the amount of your data grows, the dashboarding app can run slow, and in some cases, you might not be able to use the dashboarding app for such big amounts without prior additional data processing.
If you have a big amount of data, more than 100 000 rows**, we recommend using a data warehouse**.
What is Flow?
A Flow is a connection between a source and a destination. A flow can include multiple sources flowing to one destination.
How to connect data
Step 1 - Create New Source
Sign in to your Dataddo account and click on Sources at the top of the page.
Click on Create Source in the top right corner.
Choose the connector from the list of sources.
First, select the required Dataset and click on Next. (Apply only on some sources)
Click on Add New Account and you will be redirected to the authorization/sign-in page. In case you are asked to provide an API key, Label, Domain, or other information, navigate to the documentation page for the specific connector (e.g. Pipedrive).
Select Metrics, Attributes, and more if required.
Configure your snapshotting preferences by choosing your Data range*, Sync type, Sync frequency, Time, and Timezone.
NOTE: *If the Data range is available to select, you can load historical data. Read more in our guide.
Before Saving, you can Preview your data to make sure of your configuration.
For example, you need your data to be synchronized weekly on Monday early morning, set up the snapshotting accordingly.
You will load historical data later.
More details about how to connect a source can be found here.
Step 2 - Create New Destination
Some destinations have specific steps during configuration. Search the name of the destination in the search bar above for more information.
Click on Create Destination in the top right corner.
From the list of destinations, choose the connector. You can type the name of the connector into the search bar to find it faster.
Fill out all the fields to give Dataddo all the necessary information to connect your data, and click on Save.
More details about how to connect a destination can be found here.
Step 3 Create a New Data Flow
Click on Flows at the top of the page.
Click on Create Flow in the top right corner.
Click on Add Source to connect it to the destination. You can type the connector's name into the search bar to find it faster.
Once you select your data source, click on Add Destination.
From the list of destinations, select the destination. You can also type the name into the search bar.
Configure the destination by filling out necessary fields.
NOTE: Remember to set the synchronization time for the flow with a little delay after the synchronization of your source to let the data load.
You can Name your flow by typing the name into the top.
You can see a Data Preview to make sure of your configuration.
Click on Save flow.
Step 4 - Configure the Data Flow
- Automatic Configuration for Databases - Dataddo will try to automatically create a table when the writing operation is triggered for the first time. Date and time values will be stored as TIMESTAMP type, integers as INTEGER type, floating numerics as FLOAT, and string as a STRING type. If the operation fails, please proceed to Troubleshoot section or continue with a Manual configuration.
- Manual Configuration
- Click on the three dots next to the flow and choose Config.
- The window pops up with the configuration details. Follow the instructions to finish the configuration.
More details about how to create a flow can be found here.