Integration flows
  • Updated on 04 Jun 2019
  • 2 minutes to read
  • Print
  • Share
  • Dark
    Light

Integration flows

  • Print
  • Share
  • Dark
    Light

Integration flows allow you to orchestrate the integration of your data from various online services to your desired destinations including BI tools such as Tableau or Google Data Studio, as well as to big data storages such as Google Big Query or AWS Redshift, file storages or SQL-based data warehouses. Within a single integration flow, you can include data from multiple data sources. This is particularly handy for organizations who handle multiple social network accounts those that need to merge data from different services together for a consolidated output.

Data source orchestration

Each integration flow may contain one or multiple data sources. However, you must make sure that all the sources have the same structure, i.e. they have the same quantity of columns containing the same data types.

Example 1 : Allowed orchestration

The following data sources can be orchestrated within a single integration flow. Both sources have the same number of columns and same order of data types.

Source 1

Column name Column data type
column A DATE
column B STRING
column C STRING
column D FLOAT

Source 2

Column name Column data type
column E DATE
column F STRING
column G STRING
column H FLOAT

Example 2 : Forbidden orchestration

The following data sources cannot be orchestrated within a single integration flow since Source 2 has a different count of columns than source 1.

Source 1

Column name Column data type
column A DATE
column B STRING
column C STRING
column D FLOAT

Source 2

Column name Column data type
column E DATE
column F STRING
column G STRING

Example 3 : Forbidden orchestration

The following data sources cannot be orchestrated within a single integration flow. Although both sources have the same number of columns, they differ in column types.

Source 1

Column name Column data type
column A DATE
column B STRING
column C STRING
column D FLOAT

Source 2

Column name Column data type
column E DATE
column F STRING
column G STRING
column H STRING
Was this article helpful?