Skip to main content

Databricks - Delete Files from DBFS

Overview​

Delete one or more files from your Databricks File System (DBFS). The match type selected greatly affects how this Blueprint works.

Variables​

NameReferenceTypeRequiredDefaultOptionsDescription
Databricks Folder NameDATABRICKS_SOURCE_FOLDER_NAMEAlphanumericβž–--Name of the folder where you want to upload the local file(s) in the Databricks File System (DBFS). If left blank, uploads to /FileStore/.
Databricks File Name Match TypeDATABRICKS_SOURCE_FILE_NAME_MATCH_TYPESelectβœ…exact_matchExact Match: exact_match

Regex Match: regex_match

Determines if the text in "Databricks File Name" will look for one file with exact match, or multiple files using regex.
Databricks File NameDATABRICKS_SOURCE_FILE_NAMEAlphanumericβž–--What to name the file(s) being uploaded. If left blank, defaults to the original file name(s).
Workspace Instance URLDATABRICKS_INSTANCE_URLAlphanumericβœ…--The subdomain, domain, and top-level domain (TLD) of your Databricks Workspace URL.
Access TokenDATABRICKS_ACCESS_TOKENPasswordβœ…--The personal access token associated with the provided Workspace Instance.

YAML​

Below is the YAML template for this Blueprint and can be used in the Fleet YAML Editor.

source:
blueprint: Databricks - Delete Files from DBFS
inputs:
DATABRICKS_SOURCE_FOLDER_NAME: null
DATABRICKS_SOURCE_FILE_NAME_MATCH_TYPE: exact_match ## REQUIRED
DATABRICKS_SOURCE_FILE_NAME: null
DATABRICKS_INSTANCE_URL: null ## REQUIRED
DATABRICKS_ACCESS_TOKEN: null ## REQUIRED
type: BLUEPRINT
guardrails:
retry_count: 1
retry_wait: 0h0m0s
runtime_cutoff: 1h0m0s
exclude_exit_code_ranges:
- '200'
- '201'
- '202'
- '203'
- '212'
- '214'