Skip to main content

August 2022

· One min read

Release number: K60

Modeling enhancements​

Existing connector enhancements​

Sage 100 ODBC In-memory join improvements​

Recent performance enhancements were made for the Sage 100 ODBC connector to avoid slow performance in large data sets. This was done by implementing a pagination strategy. Read more about this strategy here

Further improvements were implemented for In-Memory Joins. When pagination strategies are failing at the Pagination Threshold, In-Memory joins can be configured as a fallback strategy.

  1. When join queries are executed, both sides of the query are executed separately and the results joined in the data source.

  2. Header tables are incrementally loaded, then join keys are available to incrementally load only relevant line/detail records.

Pipeline retries during model processing for duplicates​

Configurable data source migration retries during model processing were introduced earlier in the year. It has been expanded to also include retrying when duplicate key exceptions are experienced.

Performance Enhancements​

Every release contains performance enhancements and bug fixes to improve Data Hub.