Merge pull request #8701 from MicrosoftDocs/JasonHQX-patch-4

Update azure-synapse-link-delta-lake.md

Author: Mattp123

powerapps-docs/maker/data-platform/azure-synapse-link-delta-lake.md

@@ -6,7 +6,7 @@ ms.author: jasonhuang
 ms.reviewer: matp
 ms.service: powerapps
 ms.topic: how-to
-ms.date: 06/26/2023
+ms.date: 09/27/2023
 ms.custom: template-how-to
 ---
 # Export Dataverse data in Delta Lake format
@@ -25,6 +25,12 @@ provides the following information and shows you how to perform the following ta
 > - For the Dataverse configuration, append-only is enabled by default to export CSV data in `appendonly` mode. But the delta lake table will have an in-place update structure because the delta lake conversion comes with a periodic merge process.
 > - There are no costs incurred with the creation of Spark pools. Charges are only incurred once a Spark job is executed on the target Spark pool and the Spark instance is instantiated on demand. These costs are related to the usage of Azure Synapse workspace Spark and are billed monthly. The cost of conducting Spark computing mainly depends on the time interval for incremental update and the data volumes. More information: [Azure Synapse Analytics pricing](https://azure.microsoft.com/pricing/details/synapse-analytics/)
 > - It's important to take these additional costs into consideration when deciding to use this feature as they are not optional and must be paid in order to continue using this feature.
+>
+> [!NOTE]
+> The Azure Synapse Link status in Power Apps (make.powerapps.com) reflects the delta lake conversion state:
+> - `Count` shows the number of records in the delta lake table.
+> - `Last synchronized on` Datetime represents the last successful conversion timestamp.
+> - `Sync status` is shown as **active** once the delta lake conversion completes.
 
 ## What is Delta Lake?
 
@@ -38,15 +44,15 @@ Apache Parquet is the baseline format for Delta Lake, enabling you to leverage t
 - **Reliability**: Delta Lake provides ACID transactions, ensuring data consistency and reliability even in the face of failures or concurrent access.
 - **Performance**: Delta Lake leverages the columnar storage format of Parquet, providing better compression and encoding techniques, which can lead to improved query performance compared to query CSV files.
 - **Cost-effective**: The Delta Lake file format is a highly compressed data storage technology that offers significant potential storage savings for businesses. This format is specifically designed to optimize data processing and potentially reduce the total amount of data processed or running time required for on-demand computing.
-- **Data protection compliance**: Delta Lake with Synapse Link provides tools and features including soft-delete and hard-delete to comply various data privacy regulations, including General Data Protection Regulation (GDPR).
+- **Data protection compliance**: Delta Lake with Azure Synapse Link provides tools and features including soft-delete and hard-delete to comply various data privacy regulations, including General Data Protection Regulation (GDPR).
 
-## How Delta Lake works with Synapse Link for Dataverse?
+## How Delta Lake works with Azure Synapse Link for Dataverse?
 
-When setting up an Azure Synapse Link for Dataverse, you can enable the **export to Delta Lake** feature and connect with a Synapse workspace and Spark pool. Synapse Link exports the selected Dataverse tables in CSV format at designated time intervals, processing them through a Delta Lake conversion Spark job. Upon the completion of this conversion process, CSV data is cleaned up for storage saving. Additionally, a series of maintenance jobs are scheduled to run on a daily basis, automatically performing compaction and vacuuming processes to merge and clean up data files to further optimize storage and improve query performance.
+When setting up an Azure Synapse Link for Dataverse, you can enable the **export to Delta Lake** feature and connect with a Synapse workspace and Spark pool. Azure Synapse Link exports the selected Dataverse tables in CSV format at designated time intervals, processing them through a Delta Lake conversion Spark job. Upon the completion of this conversion process, CSV data is cleaned up for storage saving. Additionally, a series of maintenance jobs are scheduled to run on a daily basis, automatically performing compaction and vacuuming processes to merge and clean up data files to further optimize storage and improve query performance.
 
 ## Prerequisites
 
-- Dataverse: You must have the Dataverse **system administrator** security role. Additionally, tables you want to export via Synapse Link must have the **Track changes** property enabled. More information: [Advanced options](create-edit-entities-portal.md#advanced-options)
+- Dataverse: You must have the Dataverse **system administrator** security role. Additionally, tables you want to export via Azure Synapse Link must have the **Track changes** property enabled. More information: [Advanced options](create-edit-entities-portal.md#advanced-options)
 - Azure Data Lake Storage Gen2: You must have an Azure Data Lake Storage Gen2 account and **Owner** and **Storage Blob Data Contributor** role access. Your storage account must enable **Hierarchical namespace** and **public network access** for both initial setup and delta sync. **Allow storage account key access** is required only for the initial setup.  
 - Synapse workspace: You must have a Synapse workspace and **Owner** role in access control(IAM) and the **Synapse Administrator** role access within the Synapse Studio. The Synapse workspace must be in the same region as your Azure Data Lake Storage Gen2 account. The storage account must be added as a linked service within the Synapse Studio. To create a Synapse workspace, go to [Creating a Synapse workspace](/azure/synapse-analytics/get-started-create-workspace).
 - A Spark Pool in the connected Azure Synapse workspace with **Apache Spark Version 3.1** using this [recommended Spark Pool configuration](#recommended-spark-pool-configuration). For information about how to create a Spark Pool, go to [Create new Apache Spark pool](/azure/synapse-analytics/quickstart-create-apache-spark-pool-portal#create-new-apache-spark-pool).
@@ -67,9 +73,9 @@ This configuration can be considered a bootstrap step for average use cases.
 
 1. Sign into [Power Apps](https://make.powerapps.com/?utm_source=padocs&utm_medium=linkinadoc&utm_campaign=referralsfromdoc) and select the environment you want.
 1. On the left navigation pane, select **Azure Synapse Link**. [!INCLUDE [left-navigation-pane](../../includes/left-navigation-pane.md)]
-1. On the command bar select **+ New link**
+1. On the command bar, select **+ New link**
 1. Select **Connect to your Azure Synapse Analytics workspace**, and then select the **Subscription**, **Resource group**, and **Workspace name**.
-1. Select **Use Spark pool for processing**, and then select the pre-created **Spark pool** and **Storage account**.
+1. Select **Use Spark pool for processing**, and then select the precreated **Spark pool** and **Storage account**.
    :::image type="content" source="media/synapse-link-usesparkpool.png" alt-text="Azure Synapse Link for Dataverse configuration that includes spark pool.":::
 
 1. Select **Next**.
@@ -84,14 +90,14 @@ This configuration can be considered a bootstrap step for average use cases.
 
 ## View your data from Synapse workspace
 
-1. Select the Azure Synapse link you want, and then select **Go to Azure Synapse Analytics workspace** on the command bar.
+1. Select the Azure Synapse Link you want, and then select **Go to Azure Synapse Analytics workspace** on the command bar.
 1. Expand **Lake Databases** on the left pane, select **dataverse-***environmentNameorganizationUniqueName*,
 and then expand **Tables**. All Parquet tables are listed and available for analysis with the naming convention
 *DataverseTableName.* **(Non_partitioned Table)**.
 
 ## View your data from Azure Data Lake Storage Gen2
 
-1. Select the Azure Synapse link you want, and then select **Go to Azure data lake** on the command
+1. Select the Azure Synapse Link you want, and then select **Go to Azure data lake** on the command
 bar.
 1. Select the **Containers** under **Data Storage**.
 1. Select **dataverse-* **environmentName-organizationUniqueName*. All parquet files are stored in the