The problem - nested messages in Kafka Data comes into Kafka in many shapes and sizes. Sometimes it's from CDC tools, and may be nested like »
Using the Elasticsearch Kafka Connect connector to stream events from a Kafka topic to Elasticsearch. curl -X "POST" "http://kafka-connect:8083/connectors/" \ -H "Content-Type: application/json" »
Check out the jmxterm repository / Download jmxterm from http://wiki.cyclopsgroup.org/jmxterm/ Launch: java -jar ~/Downloads/jmxterm-1.0.0-uber.jar --url localhost:30002 You can »
To help future Googlers… with the Confluent docker images for Kafka, KSQL, Kafka Connect, etc, if you want to access JMX metrics from within, you just »
(SO answer repost) You can use kafkacat to send messages to Kafka that include line breaks. To do this, use its -D operator to specify a »
KSQL provides the ability to create windowed aggregations. For example, count the number of messages in a 1 minute window, grouped by a particular column: CREATE »
Short and sweet this one. I've written in the past how I love Markdown but I've actually moved on from that and now firmly throw my »
There's lots going on in the next few months :-) I'm particularly excited to be speaking at several notable conferences for the first time, including JavaZone, »
This question comes up on StackOverflow and such places a lot, so here's something to try and help. tl;dr : You need to set advertised.listeners »
So you've got a code sample you want to share in a presentation, but whilst it looks beautiful in your text-editor with syntax highlighting, it's fugly »
In this article I demonstrated how to use KSQL to filter streams of network event data. As well as filtering, KSQL can be used to easily »
Hacky way to keep config files in sync when there's a new version of some software. Caveat : probably completely wrong, may not pick up config entries »
The Kafka Connect JDBC Connector by default does not cope so well with: NUMBER columns with no defined precision/scale. You may end up with apparent »
(preserving this StackOverflow answer for posterity and future Googlers) tl;dr When doing a stream-table join, your table messages must already exist (and must be timestamped) »
tl;dr Use curl to pull data from the Mockaroo REST endpoint, and pipe it into kafkacat, thus: curl -s "https://api.mockaroo.com/api/d5a195e0? »
Disclaimer: I am not a MongoDB person. These steps may or may not be appropriate and proper. But they worked for me :) Feel free to post »
DISCLAIMER: I am not a MongoDB person (even if it is Web Scale X-D) - below instructions may work for you, they may not. Use with »
Debezium is a CDC tool that can stream changes from MySQL, MongoDB, and PostgreSQL into Kafka, using Kafka Connect. In this article we'll see how to »
io.confluent.ksql.exception.KafkaTopicException: Topic 'KSQL_NOTIFY' does not conform to the requirements Partitions:1 v 4. Replication: 1 v 1 Why? Because the topic »
This article is part of a series exploring Streaming ETL in practice. You can read about setting up the ingest of realtime events from a standard »