- 4 Minutes to read
-
DarkLight
Data Destinations FAQ
- 4 Minutes to read
-
DarkLight
What is Snapshotting?
A snapshot represents a data footprint of a system or service at a particular point in time. More information can be found here:
Can I Edit Snapshotting?
Yes. Go to Sources and click on three dots right next to the source you want to edit. Click on the Snapshopping tab and edit the fields accordingly. More information about snapshotting is here.
Data isn’t showing up in the dashboard/warehouse but the source and flow are Live
Make sure that the flow always runs after the source to avoid errors and missing data. For example, you had a source scheduled at 5 am and you change it to 8 am, make sure that the flow is scheduled after 8 am as well, e.g., at 9 am.
This will give a buffer in case the source refresh gets queued and the extraction process gets delayed. There is a function that we can activate to only allow the flow to run once data extraction has been completed.
What are the options for write mode?
- INSERT - The new data will be inserted and appended to the pre-existing data.
- TRUNCATE INSERT - This strategy removes all the contents in the table prior to data insertion.
- INSERT IGNORE - New data will be inserted while ignoring any error message.
- UPSERT - This strategy inserts new rows and updates existing ones. To perform this correctly, it is necessary to set at least one unique key representing one or multiple columns.
For Google Sheets you can choose from truncate_insert and insert, for other warehouses you can select insert, upsert, truncate_insert, or insert_ignore.
What is upsert?
Dataddo sets unique keys to be verified before the data is being written in the warehouse. The advantage of upsert is avoiding duplicity and in every insertion, Dataddo checks the unique key and updates the record in case it already exists. If not, then the new record is inserted normally.
How to set up a write model?
Go to Flows. If you are trying to edit an existing flow, click on the three dots next to the flow, click on edit and you will see a window with the writing modes under the destination. When creating a new flow, first add a source and once you add a destination, you will be asked to set up the writing mode.
Why do I have duplicated data?
In most cases, data duplicates due to incorrect snapshotting settings. When configuring your snapshotting, consider what destination is it for:
- storage, database, warehouse - Choose to Replace sync type
- dashboarding apps - choose to Append for sync type
What is the limit for Google Sheets?
Google sheet has a limit of approximately 5 million cells.
Are there limits for dashboarding applications?
If the amount of your data grows, the dashboarding app can run slow, and in some cases, you might not be able to use the dashboarding app for such big amounts without prior additional data processing.
Can I use a dashboarding application without data storage?
Yes, you can use Dashboarding apps without Data storage. We do not recommend this option if you have a large amount of data.
Why should I use a database or a data warehouse?
If you have a big amount of data, the synchronization can be too slow and you cannot manage duplicities. For example, if you have more than 100 000 rows. We recommend using a warehouse.
Where can I find the Dataddo Google Sheet connector?
Google Sheet connector in the Dataddo app can be found in two places,
- under Sources (when connecting data from Google sheet to other destination),
- or under Destinations (when you want to send data from other sources to Google sheet).
Once you set up the Dataddo Google Sheet, connect your sources and destination via Flows.
Does Dataddo store my data?
When processing your personal data for the purposes such as platform administration, personalization, billing& payments, etc., we may transfer the personal data to third parties. We may also transfer personal data to the relevant authorities in Czech Republic / EU or abroad where such authorities have a legal right to receive the information. For more information check our privacy policy and data processing policy.
Where is my data stored?
Dataddo takes every precaution to protect our users' information. The communication between users and Dataddo servers is encrypted via SSL. While we use SSL encryption to protect the information online, we also do everything in our power to protect the data of our users offline. The servers are always kept in a secure environment.
Data extracted using Dataddo are stored on Dataddo’s servers. Our data processing and storage happens in monitored and highly scalable, best-in-class data centers managed by Amazon Web Services. Data can be physically located in multiple locations around the world in order to maintain the low latency of our services.
In some cases, you may be given the option and/or have chosen the option to have your data processed in a specific region(s) or in the specific data center(s). In such cases we will give you the guarantee such processing will happen in a specified manner and any changes will be communicated to you.
Information about transactions is carried out over this website. No credit card information is stored and transactions themselves are carried out by 3rd party provider.
When processing your personal data for the purposes described above, we may transfer the personal data to third parties. We may also transfer personal data to the relevant authorities in Czech Republic / EU or abroad where such authorities have a legal right to receive the information.
For more information check our privacy policy and data processing policy.