HOWTO: Oracle GoldenGate + Apache Kafka + Schema Registry + Swingbench
This is the detailed step-by-step if you want to recreate the process I describe in the Confluent blog here
I used Oracle’s Oracle Developer Days VM, which comes preinstalled with Oracle 12cR2. You can see the notes on how to do this here. These notes take you through installing and configuring:
- Swingbench, to create a sample “Order Entry” schema and simulate events on the Oracle database
- Oracle GoldenGate (OGG, forthwith) and Oracle GoldenGate for Big Data (OGG-BD, forthwith)
- I’m using Oracle GoldenGate 12.3.1 which includes the Kafka Connect handler as part of its distribution. A connector for earlier versions can be found here. Some of the syntax may differ in the configuration below - if you hit problems then check out an article that I wrote with an earlier version of the tool.
- OGG
extractfrom the Order Entry schema - Confluent Platform
- KSQL
- Elasticsearch
From this point, I’ll now walk through configuring OGG-BD with the Kafka Connect handler