- 5 Minutes to read
Starting with Dataddo
- 5 Minutes to read
Dataddo allows you to connect your sources and destinations in a few simple steps. To get the most out of your experience, let's take it from the beginning.
- How to Connect Data
What is a connector?
A connector is a service's endpoint that Dataddo can connect with to extract your data once your service account has been authorized in the Dataddo app. Connectors include Facebook, Facebook Ads, Google Analytics, Salesforce, Zoho Analytics, and many more.
Some services have multiple endpoints. Therefore, you will find more than one connector under one service. For example, LinkedIn Organic and LinkedIn Ads are two different connectors (or endpoints) for one service (LinkedIn).
What is a source?
In the Dataddo app, a source is considered one dataset with specific configuration settings. Therefore, you can have multiple sources under one connector.
Read more in-depth information about sources here.
You can create two separate sources that both use the Facebook Insight connector. These sources may differ in that they connect to different Facebook pages, for example.
You can have two sources of the same connector but with different snapshotting settings for different reporting purposes, such as daily, weekly, monthly.
You can have three sources of the same connector, such as HubSpot, but each source uses a different dataset with different metrics. Different data sets, and therefore sources, could include contacts, companies, or users, for example.
Types of Sources by Structure
- Dataset-based: A dataset in the Dataddo app refers to a pre-built set of metrics and attributes. For example, a dataset for 'Users' could include metrics such as 'User ID', 'Create Date', etc. Whereas a dataset for 'Companies' would include metrics such as 'Company ID', 'Conversion Date', etc. If you need data from different datasets, you need to create different sources.
- Non dataset-based: All the metrics/attributes can be pulled via one source. However, some connectors do not allow for all combinations of metrics/attributes to be pulled together.
What is a destination?
In Dataddo, destinations are connectors to services, such as dashboarding applications and warehouses. Simply, destinations are locations where data from sources are sent to.
The main difference between data warehouses and dashboarding apps is that data warehouses have been designed to store large volumes of data and generally, they allow for more flexibility when storing this data. Dashboarding apps are more commonly used to visualize data.
You can use dashboarding apps without a warehouse when handling smaller amounts of data.
If you push significant amounts of data directly to a dashboarding app, the dashboard could run slowly or break.
If you have a big amount of data, more than 100,000 rows, we recommend using a data warehouse.
What is a flow?
A flow is the connection between a source and a destination. A flow can include multiple sources flowing to one destination.
How to Connect Data
Step 1: Create a New Source
Sign in to your Dataddo account and click on Sources at the top of the page.
Click on Create Source in the top right corner.
Choose the connector from the list.
For dataset-based sources, select the required dataset and click on Next.
Click on Add New Account and you will be redirected to the authorization/sign-in page of the service you are trying to connect. If you are asked to provide an API key, label, domain, or any other type of information, navigate to the documentation page for that specific connector.
Select your metrics, attributes, and any other optional configuration settings.
Configure your snapshotting preferences by choosing your sync frequency. Use the recommended settings to get the latest available data every day in the early hours of the morning, or open the advanced settings to select the data range*, sync type, time, and timezone.
NOTE: If the date range is available to select, you may load historical data during source creation. Read more in our historical load guide.
Before saving your new source, name your source and preview your data to ensure the configuration is correct.
Save your source and it's ready to be put into a flow to be loaded to your destination.
More details about how to connect a source can be found here.
Step 2: Create a New Destination
Some destinations have specific steps during configuration. Search the name of the destination in the search bar above for more information.
Click on Create Destination in the top right corner.
Select from the list of destination connectors.
Fill out all the fields to give Dataddo all the necessary information to connect your data, and click on Save.
More details about how to connect a destination can be found here.
Step 3: Create a New Data Flow
Click on Flows at the top of the page.
Click on Create Flow in the top right corner.
Click on Add Source to select the source you'd like to add to the flow. You can type the connector's name into the search bar to find it faster.
Once you select your data source, click on Add Destination and select your preferred destination.
Configure the destination by filling out the necessary fields. For more information on specific destination connectors, navigate to that destination's documentation page.
Go to the Scheduling tab to set up the timing of the data sync. Set the sync time to slightly later than the source sync time to ensure your flow will pull the most recent data from the source.
Name your flow and check the data preview to ensure the correct configuration.
Click on Save Flow.
Step 4 - Configure the Data Flow
- Automatic Configuration for Databases
Dataddo will try to automatically create a table when the writing operation is triggered for the first time. Date and time values will be stored as TIMESTAMP type, integers as INTEGER type, floating numerics as FLOAT, and string as a STRING type. If the operation fails, please proceed to the troubleshoot section or continue with a manual configuration.
- Manual Configuration
- Click on the three dots next to the flow and choose Config.
- Follow the instructions on the window pop-up to complete the configuration of the flow.
More details about how to create a flow can be found here.