Batch Connector

Modified on Wed, 06 Sep 2023

8 minutes read

This document is a draft version and subject to further review and revision. Please refrain from distributing or relying on its contents as final.

What are Batch Connectors?

Batch connector defines the structure of an input file mapped to the different data elements or business objects that can be extracted from that file. Batch connectors can be fixed-width file definitions based on defined specifications from external providers or simply delimited files. Batch connectors can be reused across different data pipelines.

How to Add New Batch Connectors?

  1. Click on the New Batch Connector option in the Process Dashboard.
  2. Add providers for the external data source.
  3. Select the appropriate data format (Delimited Text Files/Fixed Width Files).
  4. Upload a sample file to help the system understand the data structure.
  5. Click the Create button configuration for the Batch Connector.
  6. Enable the option to identify headers from the CSV file (to specify column specifications based on the record structure).
  7. Run the configuration.

How to Export Batch Connectors?

You can export batch connectors using the export option so that they can be used further in the data pipelines. While exporting, the configurations are added to the component library.