Upload dbt Logs to Azure Blob Storage

Use Azure Blob Storage to house a historical log of dbt runs.

Try it Out

Upload dbt Logs to Azure Blob Storage

Need a running record of dbt runs and tests to live on the cloud for long-term analysis? Shipyard makes it easy to immediately upload your log files to Azure Blob Storage after running a dbt CLI command. Simply connect the two Blueprints together and upload all of the files that live in your dbt logs folder. Use Shipyard's platform environment variables to generate dynamic IDs that can be tied back to the execution where the log was created.

Empower your Data Team to:
• Connect
dbt (Data Build Tool)
and
Azure Blob Storage
with your entire data stack

• Build resilient data pipelines with peace of mind

• Spend less time on infrastructure and ops

• Enhance the visibility of data operations

Connects:

dbt (Data Build Tool)

To

Azure Blob Storage

Used for:

Data Logging

Used by:

Data Engineering

Analytics Engineer

How to Set Up (5 Minutes):

1) Navigate to the Blueprint Library in Shipyard.

2) Add the "
dbt - Execute Command
" and the "
Azure Blob Storage - Upload Files
" Blueprints to your organization.

3) Navigate to a project of your choosing.

4) Click the "+New" Vessel button at the top. Click "With a Blueprint".

5) On the next screen, select your "
dbt - Execute Command
" Blueprint. Fill out all of the required fields and credentials. Once done, click "Next Step".

6) Complete the remaining steps on the wizard and press "Save & Finish".

7) Repeat steps 4-6 with the "
Azure Blob Storage - Upload Files
" Blueprint.

8) Once your two Vessels are independently created, navigate to your project and click the "+New" Fleet button at the top.

9) Click on the canvas to add your two newly created Vessels. Click and drag between the Vessels to link them together. Once finished, click "Next Step".

10) Complete the remaining steps on the wizard and press "Save & Finish".

Congratulations! You've successfully set up required components to
Upload dbt Logs to Azure Blob Storage
.

Get Started in Under 5 Minutes

It's easy to
Upload dbt Logs to Azure Blob Storage
using Shipyard. Once you add Blueprints to your organization from our Blueprint Library, it's a matter of filling out a form, providing credentials, and connecting everything together. There's no code for you to touch or infrastructure for you to manage. We do all of the heavy lifting so you can focus on building more data solutions for your business.

1

Add the
dbt - Execute Command
and
Azure Blob Storage - Upload Files
Blueprints to your organization

2

Create New Vessels with the Blueprints.

3

Connect your Vessels as part of a Fleet

Experience how quickly you can build solutions with

dbt (Data Build Tool)

and

Azure Blob Storage

Start Building

Connect your entire Data Stack