Skip to main content

Google Cloud Storage - Download Files to Shipyard

Overview​

Quickly export one or more files from a Google Cloud Storage (GCS) bucket. The match type selected greatly affects how this Blueprint works.

Variables​

NameReferenceTypeRequiredDefaultOptionsDescription
Bucket NameGCS_BUCKET_NAMEAlphanumericβœ…--Name of the GCS bucket to fetch the file from.
GCS Folder NameGCS_SOURCE_FOLDER_NAMEAlphanumericβž–--Name of the folder where the file is stored in the GCS Bucket. If left blank, looks in the root directory.
GCS File Name Match TypeGCS_SOURCE_FILE_NAME_MATCH_TYPESelectβœ…exact_matchExact Match: exact_match

Regex Match: regex_match

Determines if the text in "GCS File Name" will look for one file with exact match, or multiple files using regex.
GCS File NameGCS_SOURCE_FILE_NAMEAlphanumericβœ…--Name of the target file in the GCS bucket. Can be regex if "Match Type" is set accordingly.
Shipyard Folder NameGCS_DESTINATION_FOLDER_NAMEAlphanumericβž–--Folder where the file(s) should be downloaded. Leaving blank will place the file in the home directory.
Shipyard File NameGCS_DESTINATION_FILE_NAMEAlphanumericβž–--What to name the file(s) being downloaded. If left blank, defaults to the original file name(s).
Service AccountGOOGLE_APPLICATION_CREDENTIALSPasswordβœ…--JSON from a Google Cloud Service account key.

YAML​

Below is the YAML template for this Blueprint and can be used in the Fleet YAML Editor.

source:
blueprint: Google Cloud Storage - Download Files to Shipyard
inputs:
GCS_BUCKET_NAME: null ## REQUIRED
GCS_SOURCE_FOLDER_NAME: null
GCS_SOURCE_FILE_NAME_MATCH_TYPE: exact_match ## REQUIRED
GCS_SOURCE_FILE_NAME: null ## REQUIRED
GCS_DESTINATION_FOLDER_NAME: null
GCS_DESTINATION_FILE_NAME: null
GOOGLE_APPLICATION_CREDENTIALS: null ## REQUIRED
type: BLUEPRINT
guardrails:
retry_count: 1
retry_wait: 0h0m0s
runtime_cutoff: 1h0m0s
exclude_exit_code_ranges:
- '202'
- '207'