PyCon Israel 2024

How we deleted a dozen files and 10,000 lines of code and got control of our Airflow DAGs
09-16, 16:00–16:20 (Asia/Jerusalem), Hall 7
Language: English

Airflow is great, but it's notoriously hard to avoid duplicate code. We'll show you how we got into technical debt, and how we got out of it. We'll share our powerful and reusable class library, and the stories behind its development.


The challenge of writing reusable Airflow code, and the nightmare of technical debt.
How we built a powerful and easy to use class library for our Airflow DAGs.
What to do -- and what not to do -- when refactoring.
Development tradeoffs, and managing technical debt.


Expected experience level of participants

Advanced

Target audience

Developers

Gil is a Data Engineer for Wix's great Data Science team.

Previously he was Director of Engineering and VP of Product Management at Answers.com.