Skip to main content

Databricks - Move or Rename Files on DBFS

Overview​

Easily import one or more files from Shipyard to your Databricks File System (DBFS). The match type selected greatly affects how this Blueprint works.

Variables​

NameReferenceTypeRequiredDefaultOptionsDescription
Original Databricks Folder NameDATABRICKS_SOURCE_FOLDER_NAMEAlphanumericβž–--Name of the Databricks File System folder where the file you want to move lives. If left blank, selects from /FileStore/.
Original Databricks File Name Match TypeDATABRICKS_SOURCE_FILE_NAME_MATCH_TYPESelectβœ…exact_matchExact Match: exact_match

Regex Match: regex_match

Determines if the text in "Original Databricks File Name" will look for one file with exact match, or multiple files using regex.
Original Databricks File NameDATABRICKS_SOURCE_FILE_NAMEAlphanumericβœ…--Name of the target file on the Databricks File System (DBFS). Can be regex if "Match Type" is set accordingly.
New Databricks Folder NameDATABRICKS_DESTINATION_FOLDER_NAMEAlphanumericβž–--Name of the folder where you want to move the Databricks files to in the Databricks File System (DBFS). If left blank, selects from /FileStore/.
New Databricks File NameDATABRICKS_DESTINATION_FILE_NAMEAlphanumericβž–--What to name the file(s) being moved or renamed. If left blank, defaults to the original file name(s).
Workspace Instance URLDATABRICKS_INSTANCE_URLAlphanumericβœ…--The subdomain, domain, and top-level domain (TLD) of your Databricks Workspace URL.
Access TokenDATABRICKS_ACCESS_TOKENPasswordβœ…--The personal access token associated with the provided Workspace Instance.

YAML​

Below is the YAML template for this Blueprint and can be used in the Fleet YAML Editor.

source:
blueprint: Databricks - Move or Rename Files on DBFS
inputs:
DATABRICKS_SOURCE_FOLDER_NAME: null
DATABRICKS_SOURCE_FILE_NAME_MATCH_TYPE: exact_match ## REQUIRED
DATABRICKS_SOURCE_FILE_NAME: null ## REQUIRED
DATABRICKS_DESTINATION_FOLDER_NAME: null
DATABRICKS_DESTINATION_FILE_NAME: null
DATABRICKS_INSTANCE_URL: null ## REQUIRED
DATABRICKS_ACCESS_TOKEN: null ## REQUIRED
type: BLUEPRINT
guardrails:
retry_count: 1
retry_wait: 0h0m0s
runtime_cutoff: 1h0m0s
exclude_exit_code_ranges:
- '200'
- '201'
- '202'
- '203'
- '212'
- '214'