Connect to Databricks with Azure Blob Storage
Last updated Wed Jun 29 2022
Begin your journey with integrating Azure Databricks, which includes:
- Quick steps to configure the Microsoft Azure Blob Storage Connector
- Methods for loading data into Azure Blob with the Message Shape
- Methods for executing a SQL command within Databricks with the Program Command Shape
Microsoft Azure Blob Storage is a cloud solution for storing vast amounts of unstructured data. Databricks combines data warehouses and data lakes to provide a unified, open platform for all data. Together, both systems are essential to perform analytics in one platform.
Fully scale data analytics limitlessly by integrating Databricks with Azure Blob Storage. Performing these optimal solutions assist data developers in a collaborative manner to execute interactive analysis and workloads. This approach easily and quickly loads and analyzes small and large amounts of data.
The example process demonstrates the use of Azure Databricks. First, test data is loaded into Azure Blob by the Message Shape to send to the connector. To connect to Azure Blob, configure the Microsoft Azure Blob Storage Connector with the appropriate credentials. Next, the Program Command Shape executes a SQL command to pull data from Azure Blob Storage to a table of records. Last, the newly created file is deleted once data in Azure Blob has been consumed.
Streamline data ingestion and management with Azure Databricks. Utilizing this solution ensures automation and reliability to deliver simple, open, and multi-cloud functionalities.
The recipe qualifies for Boomi’s Recipe Program
This Recipe is eligible for Boomi’s Recipe Program – that bundles free expertise from the Boomi PSO team included in the price of this prebuilt offering. The Boomi experts will help you get set up faster than ever, allowing you to get the most out of the Boomi AtomSphere Platform.