Run dbt Cloud After Verifying Data Loads in Google BigQuery

Execute DBT immediately after running a query in Google BigQuery to verify that data exists.

Get Started ➞

Run dbt Cloud After Verifying Data Loads in Google BigQuery

Sometimes, you have to use external systems like Fivetran to load data into your datawarehouse. How can you verify when these systems have successfully loaded your data? With Shipyard, you can run SQL queries to verify that new rows are loaded for various timestamps, IDs, etc. in Google BigQuery. If data is found, you can immediately kick off dbt models related to these datasets. This setup makes it easier to spread out the execution of your dbt models and guarantee that they run as soon as the right data is loaded.

Empower your Data Team to:
• Connect
Google BigQuery
and
dbt Cloud
with your entire data stack

• Build resilient data pipelines with peace of mind

• Spend less time on infrastructure and ops

• Enhance the visibility of data operations

Connects:

Google BigQuery

To

dbt Cloud

Used for:

Data Transformation

Data Pipelines

Used by:

Analytics Engineer

Data Engineering

How to Set Up (5 Minutes):

1) Navigate to the Blueprint Library in Shipyard.

2) Add the "
Google BigQuery - Execute Query
" and the "
dbt Cloud - Execute Job
" Blueprints to your organization.

3) Navigate to a project of your choosing.

4) Click the "+New" Vessel button at the top. Click "With a Blueprint".

5) On the next screen, select your "
Google BigQuery - Execute Query
" Blueprint. Fill out all of the required fields and credentials. Once done, click "Next Step".

6) Complete the remaining steps on the wizard and press "Save & Finish".

7) Repeat steps 4-6 with the "
dbt Cloud - Execute Job
" Blueprint.

8) Once your two Vessels are independently created, navigate to your project and click the "+New" Fleet button at the top.

9) Click on the canvas to add your two newly created Vessels. Click and drag between the Vessels to link them together. Once finished, click "Next Step".

10) Complete the remaining steps on the wizard and press "Save & Finish".

Congratulations! You've successfully set up required components to
Run dbt Cloud After Verifying Data Loads in Google BigQuery
.

Get Started in Under 5 Minutes

It's easy to
Run dbt Cloud After Verifying Data Loads in Google BigQuery
using Shipyard. Once you select a Blueprint from our Blueprint Library, it's a matter of filling out a form, providing credentials, and connecting everything together.

There's no code for you to touch or infrastructure for you to manage, but you can always incorporate your own code if you would like.

We do all of the heavy lifting so you can focus on building more data solutions for your business.

1

Select the
Google BigQuery - Execute Query
and
dbt Cloud - Execute Job
Blueprints while on the Fleet Builder.

2

Fill out a few details to build new Vessels with the Blueprints.

3

Connect your Vessels together.

4

Create schedule or webhook Triggers to automate your work.

Experience how quickly you can build solutions with

Google BigQuery

and

dbt Cloud

Get Started ➞

Connect your entire Data Stack

Ready to get started?

See how quickly you can build workflows with our free Developer Plan.