Azure Kafka

You can create an Azure Kafka connection to connect to the Azure Kafka Event Hub. This enables data sources implemented as Kafka clients to send messages to SOSS objects running in a ScaleOut Active Caching message module.

Connecting to Kafka

When creating an Azure Kafka connection using the Active Caching UI, you need to specify a connection string to the Azure Kafka Event Hub. This connection string can be obtained from the Azure UI under Shared access policies as a connection string key (either the primary or secondary connection string key).

Configuring Topics

Specify each module’s topics as a comma-separated list of the form:

<module name>,<topic for sending to SOSS objects>

Each list is specified on a separate line.

Note

Topics specified in the configuration must already exist. You can create the topics using the Kafka APIs or via Kafka convenience scripts

Note

By default, Kafka consumers use the configuration property “auto.offset.reset=latest”. If the topic for messaging MSG module SOSS objects already exists and contains messages that the Kafka connection should read, please specify the configuration property “auto.offset.reset=earliest”. Please read more about this configuration property from Apache Kafka’s documentation.