This gem automates the ingestion and upsert of Excel worksheet data from desired Azure Blob storage container into a designated Microsoft Dataverse table (entity). By eliminating manual steps, it streamlines the data pipeline and ensures accurate, consistent, and timely updates. Designed for scalability and reliability, this solution enables seamless, hands-free data integration between cloud-based storage and Dataverse.
Setup Guide
This gem establishes a connection between Azure Blob Storage and Microsoft Dataverse. It retrieves data from the specified worksheet within the Excel file stored in the desired container (as defined in the Excel File parameter), and then performs an upsert into the target Dataverse table, updating existing records or inserting new ones as needed.
To run this gem and connect desired Azure Blob Storage container to Dataverse, configure the parameters that are mentioned below.
Azure Blob Storage
Server HostRequired. Specify the storage account name in the server host URL.Storage AccountRequired. Specify the storage account name.Shared KeyRequired. Specify the shared key.Source FolderRequired. Specify the path to the source folder ending with a trailing slash, for example:container001/Files/Excel/.Excel FileRequired. Specify the source excel file name for example:Automobile.xlsx.WorksheetRequired. Specify the worksheet name.Filter ColumnOptional. Specify a regular expression to exclude unwanted columns from the Excel file.
Microsoft Dataverse
Server HostRequired. Specify the correct instance in the server host URL.Token FileRequired. Select the Rest Token file from the drop-down list. Review the documentation article here on how to generate the token file.ObjectRequired. Specify the target dataverse object (table) name.Ignore Null ValueOptional. Specify to ignore null values and not send for processing.Alternate KeyOptional. Specify alternate key identifier column.
Mapping
MappingOptional. Use this parameter when source and destination columns differ. Specify mappings in a key-value format, with each pair on a new line, e.g., SourceColumn1=DestinationColumn1.
Note This integration only support Shared Key authentication type for Azure Blob Storage.