Loading…
September 13-16, 2022
Dublin, Ireland + Virtual
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for Open Source Summit Europe 2022 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Irish Standard Time (UTC +1). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Back To Schedule
Wednesday, September 14 • 12:10 - 12:50
Airflow: Save Tons of Money by Using Deferrable Operators - Kaxil Naik, Astronomer

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
Apache Airflow 2.2 introduced the concept of Deferrable Tasks that uses Python's async feature. All the Airflow sensors and poll-based operators can be hugely optimized to save tons of money by freeing up worker slots when polling. This session will cover the following topics: - Introduction to the concept of deferrable operator - When to use them & Why? - Writing Custom deferrable operators & Sensors - Advantages over Smart Sensors and reschedule mode for sensor
Speakers
avatar for Kaxil Naik

Kaxil Naik

Director of Airflow Engineering, Astronomer
Kaxil is a committer and PMC member of the Apache Airflow Project and until recently was the release manager of the project. He is currently the Director of Airflow Engineering Team @ Astronomer. Currently, he is one of the top three committers of the Airflow Project based on the... Read More →

Airflow Save Tons of Money by Using Deferrable Operators pdf
Wednesday September 14, 2022 12:10 - 12:50 IST
Wicklow Meeting Room 2 (Level 2)
  Open AI & Data Forum, Data