- 2 Minutes to read
- DarkLight
Data Destinations Overview
- 2 Minutes to read
- DarkLight
A data destination is a location or system where data is sent for further processing, analysis, or storage. This can be:
- Dashboarding applications (e.g. PowerBI, Tableau or Looker Studio)
- Data storages
- On-prem or hosted databases (e.g. MySQL, Postgres, SQL Server)
- Cloud data-warehouses (e.g. Amazon Redshift, Snowflake, Azure SQL Database, Google BigQuery)
- Object storages or data lakes (e.g. Amazon S3, Azure Blob Storage, Google Cloud Storage)
- Business applications (e.g. Salesforce, ExactOnline, Klaviyo)
- Or any other platform designed to receive and manage incoming data
Selecting the Optimal Data Destination
Understanding the various data destinations available and their corresponding benefits is key to establishing an efficient data management strategy. This guide offers insights into different use cases and the data destinations best suited for each. This will assist in aligning your data management decisions with your organization's objectives.
Use Case | Destination |
---|---|
Data visualization, reporting, and BI of simple and small data | For datasets with fewer than ~100K rows not needing complex transformations, a dashboarding app such as Tableau, PowerBI, or Looker Studio is suitable. This avoids the need for an intermediate storage, optimizing data workflows. |
Data visualization, reporting, and BI of complex or large data | For tasks with large or intricate datasets, consider cloud data warehouses like Snowflake, BigQuery, Databricks, or Amazon Redshift. These platforms support significant data volumes and SQL transformations. They also integrate with many BI tools. |
Building a data lake | For constructing a data lake to store large, diverse raw datasets, consider storages such as Amazon S3, Azure Blob Storage, or Google Cloud Storage. |
Intermediate storage for complex ETL processes | For ETL tasks using systems like Databricks or Azure Synapse, services like Amazon S3, Azure Blob Storage, or Google Cloud Storage can act as staging areas for raw data. |
Data activation | To reintroduce enriched data into original applications, you can send data back to platforms like Salesforce, HubSpot, or other CRM/ERP systems. |
Destination Details
On the Destinations page, click on your data destination to see your Destination Details where you can
- Change your data destination name
- Select a different authorizer
Other Data Destination Operations
Duplicate/Clone a Destination
- Click on the Clone Settings button next to your destination.
- Proceed with the on-screen prompts.
Delete a Destination
If you want to delete a data destination, make sure you first delete all data flows the destination is connected to.
To delete a data destination:
- Go to the Destinations page.
- Click the bin icon for the relevant data destination.
- Type DELETE to confirm your action.
Broken Destination Operation
Restart Destination
If a data destination enters a broken state (marked red), you can attempt to restart it. If successful, the destination becomes will start working again. If restarting fails, an error message will let you know where the issue is.
In most cases, you will need to reauthorize your service.
Related Articles
Troubleshooting
Error Reporting Best Practice
Troubleshooting