rmoff's random ramblings
about talks

Data Engineering: Resources

Published Sep 14, 2022 by in Data Engineering at https://rmoff.net/2022/09/14/data-engineering-resources/

As I’ve been reading and exploring the current world of data engineering I’ve been adding links to my Raindrop.io collection, so check that out. In addition, below are some specific resources that I’d recommend.

Articles 🔗

  • Tristan Handy - The Modern Data Stack: Past, Present, and Future

  • Maxime Beauchemin - The Rise of the Data Engineer

Newsletters 🔗

  • benn.substack | Benn Stancil | Substack

  • davidj.substack | David Jayatillake | Substack

  • Data Engineering Weekly | Ananth Packkildurai | Substack

Podcasts 🔗

The main podcast that I listen to in this area is the Data Engineering Podcast. Here are some ones I’ve particularly enjoyed:

  • Joe Reis Flips The Script And Interviews Tobias Macey About The Data Engineering Podcast

  • Implementations

    • Charting the Path of Riskified’s Data Platform Journey

    • Customer Analytics At Scale With Segment

    • Building A Real Time Event Data Warehouse For Sentry

    • How Shopify Is Building Their Production Data Warehouse Using DBT

    • Evolving And Scaling The Data Platform at Yotpo

    • Insights And Advice On Building A Data Lake Platform From Someone Who Learned The Hard Way

    • Shining A Light on Shadow IT In Data And Analytics

  • Technology

    • Build Your Data Analytics Like An Engineer With DBT

    • Charting A Path For Streaming Data To Fill Your Data Lake With Hudi

    • Add Version Control To Your Data Lake With LakeFS


Data Engineering in 2022 🔗

  • Introduction

  • Storage and Access

  • Exploring LakeFS with Jupyter and PySpark

  • Architectures & Terminology

  • Exploring dbt with DuckDB

  • Wrangling the feedback data from Current 22 with dbt

  • ELT tools

  • Query & Transformation Engines [TODO]


Robin Moffatt

Robin Moffatt works on the DevRel team at Confluent. He likes writing about himself in the third person, eating good breakfasts, and drinking good beer.

Story logo

© 2025