Build Your Data Pipeline Brick by Brick
Integrations

Build Your Data Pipeline Brick by Brick

Steven Johnson
Steven Johnson

Our team at Shipyard is continuing to work to deliver native low-code Blueprint Integrations with as many vendors in the data space as possible. We've heard from our community that we were missing a big player in the space...until today.

Introducing our Databricks Blueprints

We are happy to announce that Shipyard now has 4 low-code Blueprints to control files inside of Databricks. The combination of Shipyard and Databricks will give you the power to take control of your Databricks files.

By providing your credentials from Databricks, you can mix and match blueprints to:

Databricks Blueprints

Quickly Take Action with Your Data

In Shipyard, you can use the Download File Databricks Blueprint to allow your team take action on your data quicker than ever before. Here are some examples of workflows that can be connected to the Download File Blueprint:

  • Send the downloaded file to a stakeholder using Email or Slack
  • Upload the file to Amazon S3
  • Use the data in a custom Python script
  • Upload the data into a Google Sheet
Example Workflow

Get External Data into Databricks

Databricks gives you the power to work with your data. However, you have to be able to get your data into Databricks before you can work with it. Thankfully, Shipyard now has a Blueprint to help you do just that! Our native low-code Upload File Blueprint allows you to quickly take a file and get it into Databricks.

Manage Your Files like a Pro

Sometimes you have the files you need in Databricks already, and you just want some tools to help manage them. Along with downloading and uploading files, we have two other Blueprints that will allow you to manage your Databricks File System. Shipyard allows you to rename, move, and delete files from Databricks with native Blueprints.

Get Started Today

Databricks Blueprints are now available to all users and can be tested with any account. Sign up for our free Developer Plan to start automating your data orchestration process with Databricks.

We're looking forward to seeing how users will take advantage of this functionality to quickly launch, monitor, and share data pipelines!


About Shipyard:
Shipyard is a modern data orchestration platform for data engineers to easily connect tools, automate workflows, and build a solid data infrastructure from day one.

Shipyard offers low-code templates that are configured using a visual interface, replacing the need to write code to build data workflows while enabling data engineers to get their work into production faster. If a solution can’t be built with existing templates, engineers can always automate scripts in the language of their choice to bring any internal or external process into their workflows.

The Shipyard team has built data products for some of the largest brands in business and deeply understands the problems that come with scale. Observability and alerting are built into the Shipyard platform, ensuring that breakages are identified before being discovered downstream by business teams.

With a high level of concurrency and end-to-end encryption, Shipyard enables data teams to accomplish more without relying on other teams or worrying about infrastructure challenges, while also ensuring that business teams trust the data made available to them.

For more information, visit www.shipyardapp.com or get started with our free Developer Plan.