- 1 Minute to read
- DarkLight
Data Union
- 1 Minute to read
- DarkLight
Data union allows you to add datasets from multiple sources to a single data flow.
Prerequisites
When creating your sources, make sure they have the exact same schemas, meaning the same
- Number of columns
- Column names
- Data types
How to Add More Sources to One Data Flow
Navigate to the Flows page and click on Create Flow in the top right corner.
Click on Connect Your Data and select the first source.
Hover over the newly added source for the menu to show and click on Combine.
Select Data Union and add as many sources as needed. Click on Save Source in the top right corner.
Add your destination, finish configuring your flow, and click on Save Flow.
Troubleshooting
Maximum Amount of Sources
In Dataddo, it is possible to union up to 100 sources. If you need to union more sources, it will be necessary to create multiple flows.
Different Data Types
To check the data types of your source, click on the three dots, select Edit and navigate to the Data Types tab.
If the data types don’t match (like in this example), you can change the data type of each column easily in the Dataddo app.
Source 1 | Data type |
---|---|
Column A | Float |
Column B | Integer |
Source 2 | Data type |
---|---|
Column A | Integer --> change to Float |
Column B | Integer |
Feel free to contact us and we will help you with the setup. To speed the process of resolving your issue, make sure you provide us with sufficient information.