PluginsAzureTasksStorageAdls

Upload​Upload

yaml
type: "io.kestra.plugin.azure.storage.adls.Upload"

Upload a file to the Azure Data Lake Storage.

Examples

Download a json file and upload it to Azure Data Lake Storage.

yaml
id: azure_data_lake_storage_upload
namespace: company.team

tasks:
  - id: download_request
    type: io.kestra.plugin.core.http.Download
    uri: adls/product_data/product.json

  - id: upload_file
    type: io.kestra.plugin.azure.storage.adls.Upload
    filePath: "path/to/file/product.json"
    from: "{{ outputs.download_request.uri }}"
    connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
    fileSystem: "tasks"
    endpoint: "https://yourblob.blob.core.windows.net"

Properties

endpoint

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The blob service endpoint.

filePath

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

File path

Full path of the file in its file system

fileSystem

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The name of the file systems. If the path name contains special characters, pass in the url encoded version of the path name.

connectionString

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

Connection string of the Storage Account.

from

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The file from the internal storage to upload to the Azure Data Lake Storage.

sasToken

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

sharedKeyAccountAccessKey

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

Shared Key access key for authenticating requests.

sharedKeyAccountName

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

Shared Key account name for authenticating requests.

Outputs

file

Definitions

com.azure.storage.file.datalake.models.AccessTier

com.azure.storage.file.datalake.models.ArchiveStatus

io.kestra.plugin.azure.storage.adls.models.AdlsFile

  • accessControlList
    • Type: array
    • SubType: string
    • Dynamic: ❌
    • Required: ❓
  • archiveStatus
  • archiveTier
  • contentEncoding
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • contentLanguage
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • contentMd5
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • contentType
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • creationTime
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Format: date-time
  • eTag
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • fileName
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • fileSystem
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • group
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • isDirectory
    • Type: boolean
    • Dynamic: ❌
    • Required: ❓
  • lastModifed
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Format: date-time
  • leaseDuration
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Possible Values:
      • INFINITE
      • FIXED
  • leaseState
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Possible Values:
      • AVAILABLE
      • LEASED
      • EXPIRED
      • BREAKING
      • BROKEN
  • leaseStatus
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Possible Values:
      • LOCKED
      • UNLOCKED
  • name
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • owner
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • permissions
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • size
    • Type: integer
    • Dynamic: ❌
    • Required: ❓
  • uri
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Format: uri