PluginsGoogle CloudTasksGcs

Compose​Compose

yaml
type: "io.kestra.plugin.gcp.gcs.Compose"

List file on a GCS bucket.

Examples

Concat files in a bucket

yaml
id: gcp_gcs_compose
namespace: company.team

tasks:
  - id: compose
    type: io.kestra.plugin.gcp.gcs.Compose
    list:
      from: "gs://my_bucket/dir/"
    to: "gs://my_bucket/destination/my-compose-file.txt"

Properties

list

The directory to list

allowEmpty

  • Type: boolean
  • Dynamic: ❌
  • Required: ❌
  • Default: false

if true, don't failed if no result

impersonatedServiceAccount

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The GCP service account to impersonate.

projectId

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The GCP project ID.

scopes

  • Type: array
  • SubType: string
  • Dynamic: ✔️
  • Required: ❌
  • Default: [ "https://www.googleapis.com/auth/cloud-platform" ]

The GCP scopes to be used.

serviceAccount

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The GCP service account.

to

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The destination path

Outputs

uri

  • Type: string
  • Required: ❌
  • Format: uri

Definitions

io.kestra.plugin.gcp.gcs.Compose-List

  • from
    • Type: string
    • Dynamic: ✔️
    • Required: ✔️
  • filter
    • Type: string
    • Dynamic: ❌
    • Required: ❌
    • Default: BOTH
    • Possible Values:
      • FILES
      • DIRECTORY
      • BOTH
  • listingType
    • Type: string
    • Dynamic: ❌
    • Required: ❌
    • Default: DIRECTORY
    • Possible Values:
      • RECURSIVE
      • DIRECTORY
  • regExp
    • Type: string
    • Dynamic: ✔️
    • Required: ❌