Jan 23, 2020

Notes on getting data into InfluxDB from Kafka with Kafka Connect

You can download the InfluxDB connector for Kafka Connect here. Documentation for it is here.

When a message from your source Kafka topic is written to InfluxDB the InfluxDB values are set thus:

  • Timestamp is taken from the Kafka message timestamp (which is either set by your producer, or the time at which it was received by the broker)

  • Tag(s) are taken from the tags field in the message. This field must be a map type - see below

  • Value fields are taken from the rest of the message, and must be numeric or boolean

  • Measurement name can be specified as a field of the message, or hardcoded in the connector config.

Continue Reading