AFAS

AFAS is a Dutch software company that provides business software solutions for various aspects of company management, including HR, finance, payroll, and CRM. Their software aims to help organizations streamline their processes, improve efficiency, and manage different aspects of their operations through integrated software tools.

Authorize Connection to AFAS

In AFAS

To authorize your AFAS account, you will need an AFAS token (= API token).

1. In your AFAS account, create an App Connector that will allow Dataddo to securely extract your data. To do so, refer to the official AFAS documentation (Dutch only).
2. After creating the connection, copy the AFAS token.

In Dataddo

1. On the Authorizers page, click on Authorize New Service and select AFAS.
2. Select your Environment Type and provide your Environment ID.
3. Fill in the generated AFAS token.
4. Rename your authorizer for easier identification and click on Save.

How to Create an AFAS Data Source

How to Load All Your Records

To load historical data, we recommend first checking if fields such as created on or last modified on can be added to your GetConnector. These fields should be available for nearly all GetConnector definitions.

Once all your historical data is extracted, the "created on" or "last modified on fields will allow you to sort your data according to date. As a result, you can keep extracting only the most recent records.

Load All Data in Batches

Loading AFAS historial data will be done in batches.

1. Increase the limit to 50,000 records
By default, the AFAS connector will extract 10,000 records. Increase the limit to 50,000 (recommended maximum) in your source's advanced settings.

Click on your source and navigate to the Advanced Settings tab and change the limit to 50,000 records.

2. Run manual data extraction
Click on the manual data load button to extract the initial 50,000 record. You can check if your extraction was succesful in the logs.

3. Load historical data to your data warehouse
If you are using a data warehouse, navigate to your flow and click on the manual data insert button.

4. Go back to your source and increase the Skip field by 50,000
Navigate back to the Advanced Settings tab of your source and increase the Skip field by 50,000. Next extraction job will skip the previously extracted data and will extract the next 50,000 records.

5. Perform manual data load for your source and flow again

Repeat steps 2-5 until there is no more data left or until you get a number lower than the limit (50,000). Don't forget to increase the Skip field by 50,000 every time or insert your data using upsert write mode to avoid duplicates.

In some cases, sorting data by ID or a similar field will make more sense for the initial historical data load.

Setting up Daily Increments

Once all historical data has been loaded, return your source's settings to the initial state to extract the latest records.

If you expect a few thousands records a day, we recommend setting your limit to 10,000-20,000. Otherwise, extract full 50,000 records daily, in which case we recommend using the the upsert write mode to insert data into your data warehouse.

If you want to extract only yesterday's data (including data what was modified yesterday), we recommend trying a JSON filter. To set a JSON filter up, refer to the official AFAS documentation .

Alternative Approach

In case you cannot sort data using the created on or last modified on fields, you will need to create multiple sources for your GetConnector and extract all data every time. The sources should look as the following:

• 1st source - limit: 50,000, skip: 0
• 2nd source - limit: 50,000, skip: 50,000
• 3rd source - limit: 50,000, skip: 100,000
• Etc. (until you extract all records)

Add all of these sources created for a specific GetConnector into a single flow. The data will be unioned into a single table which will then be inserted into your data warehouse.

You will need to repeat this process for all the GetConnectors that require this approach.

Troubleshooting