Skip to main content

Refresh a Semantic layer

Process the Semantic layer

Process the entire model

  1. Verify that the model's tab is selected.

  2. On the Properties panel, click Process Model.

    The Process screen appears.

  3. If any publishable changes are present, use the Publishchanges check box to determine whether or not you want to include them in the process.

    Note

    The Publishchanges check box and the list of publishable changes appear on the Process dialog box if these types of changes are detected in your model; otherwise, this information is hidden.

  4. Specify Processwarehouse and ProcessSemantic layer options.

  5. Notice that All appears in the Pipelines and Database Scripts text boxes since all of your pipelines and scripts are automatically processed when you process the entire model.

  6. IncrementalData Load setting.

    • Dimensional Modeling:

      1. Default Incremental - The regular incremental process allows you to load both new and updated data to the staging database. It is designed as a more inclusive process option than Quick Incremental but typically takes a significant time (many minutes or hours) to execute. When this option is selected, all data sources and pipelines in the model automatically map to the Add & Update incremental load option.

      2. Quick Incremental - This incremental process allows you only to load new data to the staging database and process the model with only this newly added data. It is designed for firms with large volumes of transactions at all times of the day and wants more frequent updates (e.g., hourly) that can often be performed in minutes. When this option is selected, all data sources and pipelines in the model automatically map to the Add Only incremental load option.

      3. Full Refresh - A full (non-incremental) data refresh is performed. This option is slower (often taking several hours) but may need to be performed periodically to ensure integrity for some data sources. For example, where incremental delete is not performed, deleted rows may affect the accuracy of reports produced from the Semantic layer model depending on the source database structure. This type of process is often performed overnight or during non-peak times.

    • Tabular Modeling:

      1. Default Incremental - This incremental setting for Tabular defaults to Quick Incremental.

      2. Quick Incremental - This incremental process allows you only to load new data to the staging database and process the model with only this newly added data. It is designed for firms with large volumes of transactions at all times of the day and wants more frequent updates (e.g., hourly) that can often be performed in minutes. When this option is selected, all data sources and pipelines in the model automatically map to the Add Only incremental load option.

      3. Full Refresh - A full (non-incremental) data refresh is performed. This option is slower (often taking several hours) but may need to be performed periodically to ensure integrity for some data sources. For example, where incremental delete is not performed, deleted rows may affect the accuracy of reports produced from the Semantic layer model depending on the source database structure. This type of process is often performed overnight or during non-peak times.

  7. Click Process.

  8. On the model's Properties panel, examine the Status area to observe the overall process steps as they are completed. You can expand the listed tasks to view the pipelines within them. The pipelines are divided into three main states: processed, processing, and pending. All processed pipelines are listed first, followed by pipelines that are currently processing (marked by the spinning gear icon), and lastly, those pipelines whose processing has not yet started. Within each of these states, the pipelines are listed alphabetically.

  9. Verify that all tasks were completed successfully.

    Note

    If the final task is completed successfully, the overall process was also successful.

  10. If errors occur, you may use a previously published version to resolve the errors.