The Kafka output in ArcGIS Velocity can be used to send output features to a topic in an externally accessible Kafka broker. A Kafka message is sent for each output feature sent to the output.
For more information about Kafka, see Apache Kafka.
Examples
The following are example use cases for the output:
- An analyst configures a real-time analytic to process and analyze events ingested by a feed and sends the resulting features to a Kafka topic.
- A financial analyst sends real-time stock trade updates to a Kafkatopic, enabling instant data access.
- After performing analysis in a big data analytic, a researcher wants to send the output spatial or tabular features to Kafka.
Usage note
The Kafka broker must be externally accessible on the internet.
Parameters
The following are the parameters for the output:
| Parameter | Description | Data type |
|---|---|---|
| Brokers | A comma-delimited list of Kafka brokers, specified as server:port—for example: machine1.domain.com:9092,machine2.domain.com:9092,machine3.domain.com:9092. | String |
| Topic | The Kafka topic the output sends messages to. | String |
| Authentication | Specifies the type of authentication to access the HTTP endpoint. Authentication options are None, SASL/PLAIN, SASL/SCRAM-SHA-256, and SASL/SCRAM-SHA-512. | String |
| Use SSL | Specifies whether Velocity uses SSL (SASL_SSL) in attempting to connect to the Kafka broker. Note:This should match the configuration the broker has on a specified port. If you disable it, Velocity connects via PLAINTEXT. | Boolean |
| Username | Specifies the username for accessing the Kafka broker. This parameter only applies when Authentication is set to SASL/PLAIN, SASL/SCRAM-SHA-256, or SASL/SCRAM-SHA-512. | String |
| Password | Specifies the password for accessing the Kafka broker. This parameter only applies when Authentication is set to SASL/PLAIN, SASL/SCRAM-SHA-256, or SASL/SCRAM-SHA-512. | String |
| Output format name | The format for outgoing messages. Both delimited and JSON formats are supported. | String |