Skip to main content

October 2023

· One min read

Release number: K75

Modeling enhancements​

Incremental Load resilience enhancement​

When large pipelines that process incrementally fail on initial data migration, a partition strategy can be used to improve stability. Partitioning allows you to specify blocks of data to migrate based off a date column. More detailed information on configuring partitioned source loading.

Incremental load with partitioning

note

  • Enable this feature only on large pipelines and when these failures occur.

  • The value of the date column used for the partition period, cannot change.

Performance Enhancements​

Every release contains performance enhancements and bug fixes to improve Data Hub.