PluginsAzureTasksStorageAdls

Reads​Reads

yaml
type: "io.kestra.plugin.azure.storage.adls.Reads"

Read all files from an Azure Data Lake Storage directory.

Examples

yaml
id: azure_storage_datalake_readq
namespace: company.team

tasks:
  - id: read_file
    type: io.kestra.plugin.azure.storage.adls.Reads
    connectionString: "{{ secret('AZURE_CONNECTION_STRING') }}"
    fileSystem: "tasks"
    endpoint: "https://yourblob.blob.core.windows.net"
    directoryPath: "path/to/my/directory/"

Properties

directoryPath

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

Directory Name

endpoint

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The blob service endpoint.

fileSystem

  • Type: string
  • Dynamic: ✔️
  • Required: ✔️

The name of the file systems. If the path name contains special characters, pass in the url encoded version of the path name.

connectionString

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

Connection string of the Storage Account.

sasToken

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

The SAS token to use for authenticating requests.

This string should only be the query parameters (with or without a leading '?') and not a full URL.

sharedKeyAccountAccessKey

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

Shared Key access key for authenticating requests.

sharedKeyAccountName

  • Type: string
  • Dynamic: ✔️
  • Required: ❌

Shared Key account name for authenticating requests.

Outputs

files

  • Type: array
  • SubType: AdlsFile
  • Required: ❌

outputFiles

  • Type: object
  • SubType: string
  • Required: ❌

Definitions

com.azure.storage.file.datalake.models.AccessTier

com.azure.storage.file.datalake.models.ArchiveStatus

io.kestra.plugin.azure.storage.adls.models.AdlsFile

  • accessControlList
    • Type: array
    • SubType: string
    • Dynamic: ❌
    • Required: ❓
  • archiveStatus
  • archiveTier
  • contentEncoding
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • contentLanguage
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • contentMd5
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • contentType
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • creationTime
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Format: date-time
  • eTag
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • fileName
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • fileSystem
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • group
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • isDirectory
    • Type: boolean
    • Dynamic: ❌
    • Required: ❓
  • lastModifed
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Format: date-time
  • leaseDuration
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Possible Values:
      • INFINITE
      • FIXED
  • leaseState
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Possible Values:
      • AVAILABLE
      • LEASED
      • EXPIRED
      • BREAKING
      • BROKEN
  • leaseStatus
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Possible Values:
      • LOCKED
      • UNLOCKED
  • name
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • owner
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • permissions
    • Type: string
    • Dynamic: ❌
    • Required: ❓
  • size
    • Type: integer
    • Dynamic: ❌
    • Required: ❓
  • uri
    • Type: string
    • Dynamic: ❌
    • Required: ❓
    • Format: uri