Connect to Databricks with Azure Blob Storage

Last updated Wed Jun 29 2022

Begin your journey with integrating Azure Databricks, which includes:

  • Quick steps to configure the Microsoft Azure Blob Storage Connector
  • Methods for loading data into Azure Blob with the Message Shape
  • Methods for executing a SQL command within Databricks with the Program Command Shape

Overview

Microsoft Azure Blob Storage is a cloud solution for storing vast amounts of unstructured data. Databricks combines data warehouses and data lakes to provide a unified, open platform for all data. Together, both systems are essential to perform analytics in one platform.

Fully scale data analytics limitlessly by integrating Databricks with Azure Blob Storage. Performing these optimal solutions assist data developers in a collaborative manner to execute interactive analysis and workloads. This approach easily and quickly loads and analyzes small and large amounts of data.

The example process demonstrates the use of Azure Databricks. First, test data is loaded into Azure Blob by the Message Shape to send to the connector. To connect to Azure Blob, configure the Microsoft Azure Blob Storage Connector with the appropriate credentials. Next, the Program Command Shape executes a SQL command to pull data from Azure Blob Storage to a table of records. Last, the newly created file is deleted once data in Azure Blob has been consumed.

Streamline data ingestion and management with Azure Databricks. Utilizing this solution ensures automation and reliability to deliver simple, open, and multi-cloud functionalities.

The recipe qualifies for Boomi’s Recipe Program

This Recipe is eligible for Boomi’s Recipe Program – that bundles free expertise from the Boomi PSO team included in the price of this prebuilt offering. The Boomi experts will help you get set up faster than ever, allowing you to get the most out of the Boomi AtomSphere Platform.

Learn More

Related Solutions

Recipe

Connect to Databricks with AWS S3

Effectively integrate with AWS S3 Databricks by loading data into AWS and executing commands within Databricks.
Learn more

Recipe

Connect with Microsoft Azure Cosmos Database

Transfer data to/from the Azure Cosmos DB server. Deliver high-performing operations powered by the Cosmos DB.
Learn more

Recipe

Start Analytical Logging with Azure

Interpret and analyze vast amounts of data with Azure Log Analytics. Improve efficiency by comprehensively creating, analyzing, and writing entries.
Learn more