How to Use Incremental Push for Efficient Data Export in Dynamics 365?

How to Export Data Entity using Incremental Push in Dynamics 365

Introduction:

Exporting data using an incremental push in Dynamics 365’s Data Management Framework (DMF) is an efficient and performance-optimized way of transferring only the changed records. This feature allows you to export only the records that have been newly created or changed since the last export, making your data exports faster and more efficient, especially when working with large datasets. 

In this blog post, we’ll explore how you can set up and use incremental pushes in DMF to export data from Dynamics 365, step by step. 

High level resolution steps 

  • Enable change tracking for the desired entity. 
  • Configure the export job for Incremental Push. 
  • Run the export job. 
  • Verify that modified records were exported. 

Detailed resolution steps 

Step 1: Enable change tracking for the desired entity 

Before exporting data using Incremental Push, you must enable Change Tracking on the entity you want to export. Navigation: Workspaces -> Data management -> Data entities. In this example, I am using ‘Customer groups’ entity. 

Enable change tracking for the desired entity

Click Enable entire entity 

Enable entire entity

After enabling change tracking below mesaage will appear. 

my view

Step 2: Configure the export job for Incremental Push 

In Customer group form, we have 11 records.  

Go to Data Management -> Export in your Dynamics 365 environment. Click on + New to create a new export project.  

In the Export Project dialog, select the Data Entity for which you enabled Change Tracking.  

Choose Incremental Push as the export method. This tells the system to export only the records that have been modified or added since the last export. 

Note: Use same Export project, so first time it will export all the records, next time onwards it will export only the changes. 

Step 3: Run the export job 

Running the export job without batch. You can run it with a batch depending on the requirement. 

Step 4: Verify the records were exported 

Exported all the 11 records show in below screen shot. 

Download the file and check the exported data. 

Step 5: Change the records in Customer group form and export the same project 

Changed the first 2 records in customer group. 

Go to same Export project “Customer Group Export” and click export now or export in batch. 

Download the file and check the exported data. Modified record has been exported. 

Step 6: Create new record in Customer group and export the same project 

Create new record in customer group. 

Go to same Export project “Customer Group Export” and click export now or export in batch. 

Download the file and check the exported data. New record has been exported.