BatchCreate

Batch-insert data to a Weaviate database.

Data can be either in an ION-serialized file format or as a list of key-value pairs. If the schema doesn't exist yet, it will be created automatically.

yaml
type: "io.kestra.plugin.weaviate.BatchCreate"

Send batch object creation request to a Weaviate database.

yaml
id: weaviate_batch_load
namespace: company.team

tasks:
  - id: batch_load
    type: io.kestra.plugin.weaviate.BatchCreate
    url: "https://demo-cluster-id.weaviate.network"
    apiKey: "{{ secret('WEAVIATE_API_KEY') }}"
    className: WeaviateDemo
    objects:
      - textField: "some text"
        numField: 24
      - textField: "another text"
        numField: 42

Send batch object creation request to a Weaviate database using an ION input file e.g. passed from output of another task.

yaml
id: weaviate_batch_insert
namespace: company.team

tasks:
  - id: extract
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/ion/ingest.ion

  - id: batch_insert
    type: io.kestra.plugin.weaviate.BatchCreate
    url: "https://demo-cluster-id.weaviate.network"
    apiKey: "{{ secret('WEAVIATE_API_KEY') }}"
    className: Titles
    objects: "{{ outputs.extract.uri }}"

Dynamic NO

Objects to create with their properties

ION File URI or the list of objects to insert

Dynamic YES

Min length 1

Connection URL

Example: localhost: 8080 or https://cluster-id.weaviate.network

Dynamic YES

API key to authenticate with a managed Weaviate cluster

If not provided, the anonymous authentication scheme will be used.

Dynamic YES

Class name where you want to insert data

SubType string

Dynamic YES

Additional headers to add to the request e.g. to authenticate with OpenAI API

​Batch​Create

BatchCreate