Blueprints

Extract and process data from DynamoDB

Source

yaml
id: scan-dynamodb-table
namespace: company.team

tasks:
  - id: extract_data
    type: io.kestra.plugin.aws.dynamodb.Scan
    tableName: demo
    fetchType: FETCH
    region: "{{ secret('AWS_DEFAULT_REGION') }}"
    accessKeyId: "{{ secret('AWS_ACCESS_KEY_ID') }}"
    secretKeyId: "{{ secret('AWS_SECRET_ACCESS_KEY') }}"

  - id: process_data
    type: io.kestra.plugin.scripts.shell.Commands
    taskRunner:
      type: io.kestra.plugin.core.runner.Process
    commands:
      - echo {{ outputs.extract_data.rows }}

About this blueprint

AWS Data Task Runner

This flow scans a DynamoDB table and outputs the extracted data as a JSON string. The subsequent task processes that data. The tableName property must point to an already existing DynamoDB table. It's recommended to set the accessKeyId and secretKeyId properties as secrets. This flow assumes AWS credentials stored as secrets AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY and AWS_DEFAULT_REGION.

Scan

Commands

Process

New to Kestra?

Use blueprints to kickstart your first workflows.

Get started with Kestra