Skip to main content

Google Cloud Storage (GCS)

Required extra

This connection requires the gcs and duckdb extras. See Installation.

The Amazon S3 integration also works with files on Google Cloud Storage through its interoperability. Use https://storage.googleapis.com as the endpoint URL and the s3:// scheme for the location.

Server

servers:
- server: production
type: s3
endpointUrl: https://storage.googleapis.com
location: s3://bucket-name/path/*/*.json # use s3:// instead of gs://
format: json
delimiter: new_line # new_line, array, or none

Environment variables

VariableExampleDescription
DATACONTRACT_S3_ACCESS_KEY_IDGOOG1EZZZ...The GCS HMAC Key ID
DATACONTRACT_S3_SECRET_ACCESS_KEYPDWWpb...The GCS HMAC Key secret