rmoff's random ramblings

24 Mar 2018 · debezium

Streaming Data from MySQL into Kafka with Kafka Connect and Debezium

Debezium is a CDC tool that can stream changes from MySQL, MongoDB, and PostgreSQL into Kafka, using Kafka Connect. In this article we’ll see how to set it up and examine the format of the data. …

06 Mar 2018 KSQL: Topic … does not conform to the requirements
06 Mar 2018 Streaming data from Kafka into Elasticsearch
kafka connect
06 Mar 2018 Installing the Python Kafka library from Confluent - troubleshooting some silly errors…
Apache Kafka
06 Mar 2018 Why Do We Need Streaming ETL?
streaming
01 Feb 2018 HOWTO: Oracle GoldenGate + Apache Kafka + Schema Registry + Swingbench
apache kafka
03 Jan 2018 Kafka - AdminClient - Connection to node -1 could not be established. Broker may not be available
Apache Kafka
21 Nov 2017 Installing Oracle GoldenGate for Big Data 12.3.1 with Kafka Connect and Confluent Platform
goldengate
29 Sep 2017 Where will I be at OpenWorld / Oak Table World?
oracle
20 Sep 2017 Apache Kafka™ talks at Oracle OpenWorld, JavaOne, and Oak Table World 2017
Apache Kafka
12 Sep 2017 Oracle GoldenGate / Kafka Connect Handler troubleshooting
goldengate
12 Sep 2017 What is Markdown, and Why is it Awesome?
markdown
11 Sep 2017 Conferences & Meetups at which I’ll be speaking - 2017
conferences
06 Sep 2017 Kafka Connect - JsonDeserializer with schemas.enable requires “schema” and “payload” fields
kafka connect
08 Aug 2017 Simple export/import of Data Sources in Grafana
curl
21 Jun 2017 Linux - USB disk connection problems - uas: probe failed with error -12
lsblk
12 Jun 2017 Configuring Kafka Connect to log REST HTTP messages to a separate file
Apache Kafka
12 May 2017 kafka.common.KafkaException: No key found on line 1
Apache Kafka
11 Mar 2017 Keeping Up with the Deluge
reading
11 Mar 2017 Install qemu on AWS EC2 Amazon Linux
qemu
11 Mar 2017 Mount VMDK/OVF/OVA on Amazon Web Services (AWS) EC2
vmdk
11 Mar 2017 Little Technology Wins
headphones
10 Mar 2017 Time For a Change
career
20 Jan 2017 HBase crash after resuming suspended VM
hbase
18 Jan 2017 Kibana Timelion - Anomaly Detection
kibana
16 Jan 2017 Streaming / Unbounded Data - Resources
02 Dec 2016 kafka-avro-console-producer - Error registering Avro schema / io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException
Apache Kafka
29 Nov 2016 Oracle GoldenGate -> Kafka Connect - “Failed to serialize Avro data”
ogg
24 Nov 2016 Kafka Connect - java.lang.IncompatibleClassChangeError
Apache Kafka
14 Oct 2016 boto / S3 errors
boto
29 Jul 2016 OGG-15051 oracle.goldengate.util.GGException: Class not found: “kafkahandler”
Apache Kafka
28 Jul 2016 OGG - Class not found: “com.company.kafka.CustomProducerRecord”
ogg
27 Jul 2016 Kafka Connect JDBC - Oracle - Number of groups must be positive
Apache Kafka
19 Jul 2016 Kafka Connect - HDFS with Hive Integration - SchemaProjectorException - Schema version required
Apache Kafka
18 Jul 2016 Configuring UPS/apcupsd
apcupsd
13 Jul 2016 Spark sqlContext.read.json - java.io.IOException: No input paths specified in job
spark
05 Jul 2016 Proxmox 4 Containers - ssh - ssh_exchange_identification: read: Connection reset by peer
proxmox
05 Jul 2016 Reset Hue password
hue
20 Jun 2016 Apache Drill - conflicting jar problem - “No current connection”
apache drill
15 Jun 2016 ClassNotFoundException with MongoDB-Hadoop in Hive
mogodb
15 Jun 2016 Erroneous SwapFree on LXC causes problems with CDH install
lxc
08 Jun 2016 Reviving a bricked EdgeRouter Lite (ERL) from a Mac
edgemax
07 Jun 2016 Running a Docker Container on Proxmox for BitTorrent Sync
docker
07 Jun 2016 Importing VMWare and VirtualBox VMs to Proxmox
proxmox
07 Jun 2016 Commissioning my Proxmox Server - OS and filesystems
proxmox
07 Jun 2016 A New Arrival
proxmox
06 Jun 2016 New version of BigDataLite VM from Oracle
oracle
01 Jun 2016 OBIEE 12c blog posts
obiee12c
01 Jun 2016 Presentation Services Logsources in OBIEE 12c
sawserver
28 May 2016 Lifting the Lid on OBIEE 12c Web Services - Part 2
OBIEE