Data sources
  • Updated on 26 Nov 2019
  • 2 minutes to read
  • Print
  • Share
  • Dark
    Light

Data sources

  • Print
  • Share
  • Dark
    Light

What is data source in Dataddo?

When 3rd party services like Google Analytics or Instagram are connected to the Dataddo platform and a dataset definition is set, a local copy of the dataset is created as a Data source. Conceptually, a data source is equivalent to data storage components you can find in other systems, such as table in SQL databases or sheets in Google Sheets.

Built-in data synchronization

Data in the data sources is not static, since Dataddo offers built-in data synchronization capability. With this feature, you can easily set the data synchronization to hourly, daily, weekly or monthly increments. You can find more details in the data synchronization section.

Connecting to your data

Dataddo offers great flexibility when it comes to connecting to various online data sources. Thanks to our unique and robust data transformation middleware, Dataddo can connect to almost any online service providing it has JSON/CSV/XML based API (this covers most services). Even in the case of proprietary APIs, our team is available to build out new connectors within 1-2 business days.

Although Dataddo is designed to provide unprecedented data integration flexibility, there is a finite number of off-the-shelf connectors with dedicated no-code interfaces that we offer. In case your desired service is not in our off-the-shelf connectors list, you can always use one of our Universal connectors to access your data.

Relations to other Dataddo components

Data sources are a crucial part of Integration flows. There is a 1:N relationships to integration flow, therefore you can include multiple data sources into a single integration flow.

component_relations

Editing data source

Data types and column names

Data types and column names can be edited by clicking on the "Edit" icon for the particular data source. Although Dataddo automatically detects the datatypes of each data source, occassionally, you might need to change the definition. After changing the datatype, please force run the data source synchronization to apply the new definition to the values.
data_source_edit.png

In the modal widow, it is possible to edit the data types and column names of the data source.
data_source_edit_data_types.png

Data source definition

It is NOT possible to edit the chosen attributes (columns) in the data source definition. In order to maintain data consistency, the data source structure, including column ordering, is fixed. If you need to include the different attributes in the source, the best practice is to recreate the source using the “duplicate” button which will initiate the creation of a new data connector with the parameters used in the original source.

recreate_data_source.png

Was this article helpful?