PyCon Israel 2024

Your locale preferences have been saved. We like to think that we have excellent support for English in pretalx, but if you encounter issues or errors, please contact us!

How we deleted a dozen files and 10,000 lines of code and got control of our Airflow DAGs
09-16, 16:00–16:20 (Asia/Jerusalem), Hall 7
Language: English

Airflow is great, but it's notoriously hard to avoid duplicate code. We'll show you how we got into technical debt, and how we got out of it. We'll share our powerful and reusable class library, and the stories behind its development.

The challenge of writing reusable Airflow code, and the nightmare of technical debt.
How we built a powerful and easy to use class library for our Airflow DAGs.
What to do -- and what not to do -- when refactoring.
Development tradeoffs, and managing technical debt.

Expected experience level of participants –

Advanced

 Target audience –

Developers
Gil Reich

Gil is a Data Engineer for Wix's great Data Science team.

Previously he was Director of Engineering and VP of Product Management at Answers.com.