Step-by-Step Guide: Creating an Azure Synapse Link for Dataverse

-

Hello everyone, in this article, we are going to discuss how to connect your Dataverse tables to Azure Synapse workspace. First, we are going to look at what is the Dataverse and What is the Azure Synapse link for Dataverse.

  1. What is Dataverse

Dataverse is a cloud-based storage space formerly known as the Common Data Service (CDS). It allows users to securely store data within sets of tables. We can use Dataverse as a data source for business applications such as the Power Platform and Dynamics 365.


  1. What is Azure Synapse Link for Dataverse?

Azure Synapse Link for Dataverse allows you to easily analyze your Dataverse data using Azure Synapse Analytics without needing to move the data around or use complex processes. It makes data analysis simpler and faster. 

Once the link is established, Azure Synapse Link for Dataverse will export all the initial data and continuously sync any new changes. This allows customers to gain near real-time insights from their data stored in Microsoft Dataverse.


Note : Azure Synapse Link for Dataverse was formerly known as Export to data lake.


1. Prerequisites


Before establishing a link between Dataverse and Azure Synapse Analytics, several prerequisites must be met:

Make sure your Azure Resource Group, Storage Account, and Azure Synapse Analytics Workspace are in the same tenant and region.


Resource Group:

  • You need the Reader role for the resource group.


Azure Data Lake Storage Gen2:


  • You need an Azure Data Lake Storage Gen2 account.
  • Ensure you have Owner and Storage Blob Data Contributor role access.
  • Enable Hierarchical namespace.
  • Recommended replication setting: Read-Access Geo-Redundant Storage (RA-GRS).


Azure Synapse Analytics:

  • You must possess a Synapse workspace.
  • Obtain Service administrator role access within Synapse Studio.
  • Provision the Synapse workspace in the same region as your Azure Data Lake Storage Gen2 account.
  • Provision the Synapse workspace in the same resource group as your Azure Data Lake Storage Gen2 account.
  • Add the storage account as a linked service within Synapse Studio.

Dataverse:


  • Both the Azure Data Lake Storage Gen2 account and Synapse workspace must be created in the same Azure Active Directory (Azure AD) tenant as your Power Apps tenant.
  • Ensure they are created in the same Azure Active Directory (Azure AD) region as your Power Apps environment.
  • You must have the Dataverse System Administrator security role.

Note: Only tables with change tracking enabled can be exported.


Here is the summarized graphic about prerequisites.




Common Issue:

Unable to access storage account. This may be transient as permissions for the application may need time to propagate. Please wait for some time and try again later. If the issue persists, please ensure the storage account is on network accessible by our service and you have the correct role access as described in our documentation. 



The issue arises when attempting to connect Dataverse and Azure Synapse Link. To resolve this, ensure the following:

  • Grant the user Owner and Storage Blob Data Contributor role access for the Storage Account.
  • Assign the user the Service Administrator role access for the Synapse Workspace.

By ensuring these roles are assigned correctly, users should be able to connect Dataverse and Azure Synapse Link without encountering the issue.



2. Connect Dataverse to Synapse workspace

  1. Sign in to https://make.powerapps.com and select your environment.
  2. In the left navigation pane, Click More
  3. Then Click Discover All

  4. Under Data Management Section, Select Azure Synapse Link

  5. Click on the "New link" button located in the middle of the page or on the command bar.

  6. In Select Azure Resource Screen, 
    1. Select the checkbox to Connect to your Azure Synapse Analytics workspace.
    2. Choose Your Subscription.
    3. Choose Your Resource group.
    4. Choose Your Workspace name.
    5. Choose Your Storage account.
    6. Click Next.

  7. In Add Tables Screen,
    1. Select the tables that you want to export.
    2. Click Save.

  8. Now you can see your Synapse Links in the Azure Synapse Link for Dataverse screen.

  9. You can also view your Dataverse data in the Azure Synapse Analytics Workspace.

Comments

  1. Network TopologyApril 5, 2024 at 10:24 AM

    Invaluable insights merging Power Platform, Microsoft 365, and SharePoint - a must-read for developers.
    keep up the excellent work!

    ReplyDelete

Post a Comment

Popular posts from this blog

Remote Desktop Error : Remote Desktop Displays Strange Pattern in White Areas

-
Image
 Hi there, today we are going to look into a common remote desktop issue. It happens when a user connects via remote desktop, and it displays a strange pattern of black boxes showing all over the white spaces. Even after trying to restart, the issue remains the same. To avoid this, you need to clear the remote desktop cache. Ensure that you close all remote desktop sessions before proceeding.  Then navigate to the cache folder. The cache files are usually stored in the C:\Users\[YourUsername]\AppData\Local\Microsoft\Terminal Server Client\Cache folder .  Delete all the files within the Cache folder. These files typically have .bmc, .bmc2, and other similar extensions.
Read more

Power Automate Error: Handling Empty Cells When Uploading Excel Data to SharePoint Lists

-
Image
Error :  The 'inputs.parameters' of workflow operation 'Create_item' of type 'OpenApiConnection' is not valid. Error details: Input parameter 'item/SST' is required to be of type 'Number/double'. The runtime value '""' to be converted doesn't have the expected format 'Number/double'. When users attempt to upload Excel file data using Power Automate, this issue commonly happens. The reason is that the Excel table contains empty cells. Proper configuration in Power Automate is necessary to avoid this problem. It's a simple fix, and I'll show you how to implement it. Before the fix, it looks like this: items('Apply_to_each')['XXX']) Just need to add a condition as below: if(empty(items('Apply_to_each')['XXX']),null,items('Apply_to_each')['XXX']) This formula describes the following: If the value of the 'XXX' field for the current item is empty, it will retu...
Read more