rmoff's random ramblings
Interesting Links Categories Search RSS
Home Categories Interesting Links Search RSS linkedin twitter bluesky youtube talks github
24 Mar 2018 · debezium

Streaming Data from MySQL into Kafka with Kafka Connect and Debezium

Debezium is a CDC tool that can stream changes from MySQL, MongoDB, and PostgreSQL into Kafka, using Kafka Connect. In this article we’ll see how to set it up and examine the format of the data. …

  • 06 Mar 2018 KSQL: Topic … does not conform to the requirements
  • 06 Mar 2018 Streaming data from Kafka into Elasticsearch
    kafka connect
  • 06 Mar 2018 Installing the Python Kafka library from Confluent - troubleshooting some silly errors…
    Apache Kafka
  • 06 Mar 2018 Why Do We Need Streaming ETL?
    streaming
  • 01 Feb 2018 HOWTO: Oracle GoldenGate + Apache Kafka + Schema Registry + Swingbench
    apache kafka
  • 03 Jan 2018 Kafka - AdminClient - Connection to node -1 could not be established. Broker may not be available
    Apache Kafka
  • 21 Nov 2017 Installing Oracle GoldenGate for Big Data 12.3.1 with Kafka Connect and Confluent Platform
    goldengate
  • 29 Sep 2017 Where will I be at OpenWorld / Oak Table World?
    oracle
  • 20 Sep 2017 Apache Kafka™ talks at Oracle OpenWorld, JavaOne, and Oak Table World 2017
    Apache Kafka
  • 12 Sep 2017 Oracle GoldenGate / Kafka Connect Handler troubleshooting
    goldengate
  • 12 Sep 2017 What is Markdown, and Why is it Awesome?
    markdown
  • 11 Sep 2017 Conferences & Meetups at which I’ll be speaking - 2017
    conferences
  • 06 Sep 2017 Kafka Connect - JsonDeserializer with schemas.enable requires “schema” and “payload” fields
    kafka connect
  • 08 Aug 2017 Simple export/import of Data Sources in Grafana
    curl
  • 21 Jun 2017 Linux - USB disk connection problems - uas: probe failed with error -12
    lsblk
  • 12 Jun 2017 Configuring Kafka Connect to log REST HTTP messages to a separate file
    Apache Kafka
  • 12 May 2017 kafka.common.KafkaException: No key found on line 1
    Apache Kafka
  • 11 Mar 2017 Keeping Up with the Deluge
    reading
  • 11 Mar 2017 Install qemu on AWS EC2 Amazon Linux
    qemu
  • 11 Mar 2017 Mount VMDK/OVF/OVA on Amazon Web Services (AWS) EC2
    vmdk
  • 11 Mar 2017 Little Technology Wins
    headphones
  • 10 Mar 2017 Time For a Change
    career
  • 20 Jan 2017 HBase crash after resuming suspended VM
    hbase
  • 18 Jan 2017 Kibana Timelion - Anomaly Detection
    kibana
  • 16 Jan 2017 Streaming / Unbounded Data - Resources
  • 02 Dec 2016 kafka-avro-console-producer - Error registering Avro schema / io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException
    Apache Kafka
  • 29 Nov 2016 Oracle GoldenGate -> Kafka Connect - “Failed to serialize Avro data”
    ogg
  • 24 Nov 2016 Kafka Connect - java.lang.IncompatibleClassChangeError
    Apache Kafka
  • 14 Oct 2016 boto / S3 errors
    boto
  • 29 Jul 2016 OGG-15051 oracle.goldengate.util.GGException: Class not found: “kafkahandler”
    Apache Kafka
  • 28 Jul 2016 OGG - Class not found: “com.company.kafka.CustomProducerRecord”
    ogg
  • 27 Jul 2016 Kafka Connect JDBC - Oracle - Number of groups must be positive
    Apache Kafka
  • 19 Jul 2016 Kafka Connect - HDFS with Hive Integration - SchemaProjectorException - Schema version required
    Apache Kafka
  • 18 Jul 2016 Configuring UPS/apcupsd
    apcupsd
  • 13 Jul 2016 Spark sqlContext.read.json - java.io.IOException: No input paths specified in job
    spark
  • 05 Jul 2016 Proxmox 4 Containers - ssh - ssh_exchange_identification: read: Connection reset by peer
    proxmox
  • 05 Jul 2016 Reset Hue password
    hue
  • 20 Jun 2016 Apache Drill - conflicting jar problem - “No current connection”
    apache drill
  • 15 Jun 2016 ClassNotFoundException with MongoDB-Hadoop in Hive
    mogodb
  • 15 Jun 2016 Erroneous SwapFree on LXC causes problems with CDH install
    lxc
  • 08 Jun 2016 Reviving a bricked EdgeRouter Lite (ERL) from a Mac
    edgemax
  • 07 Jun 2016 Running a Docker Container on Proxmox for BitTorrent Sync
    docker
  • 07 Jun 2016 Importing VMWare and VirtualBox VMs to Proxmox
    proxmox
  • 07 Jun 2016 Commissioning my Proxmox Server - OS and filesystems
    proxmox
  • 07 Jun 2016 A New Arrival
    proxmox
  • 06 Jun 2016 New version of BigDataLite VM from Oracle
    oracle
  • 01 Jun 2016 OBIEE 12c blog posts
    obiee12c
  • 01 Jun 2016 Presentation Services Logsources in OBIEE 12c
    sawserver
  • 28 May 2016 Lifting the Lid on OBIEE 12c Web Services - Part 2
    OBIEE
Robin Moffatt
Writing about data engineering, Kafka, Flink, and whatever else catches his eye. Enjoys running, good beer, and fried breakfasts—but not at the same time.
Popular Categories
  • AI (13)
  • Apache Flink (27)
  • Apache Iceberg (8)
  • dbt (9)
  • DuckDB (13)
  • Go (22)
  • Golang (22)
  • kafka connect (9)
  • kcat (kafkacat) (23)
  • ksqlDB (28)
  • Single Message Transform (16)
  • Stumbling into AI (13)
  • TwelveDaysOfSMT (13)
View all categories
  • ««
  • «
  • 5
  • 6
  • 7
  • 8
  • 9
  • »
  • »»
© 2026 · @rmoff · AI Disclosure