Loading…
September 13-16, 2022
Dublin, Ireland + Virtual
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for Open Source Summit Europe 2022 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Irish Standard Time (UTC +1). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Back To Schedule
Friday, September 16 • 13:55 - 14:35
Containerizing & Orchestrating Hadoop Infrastructure at Scale - Mithun (Matt) Mathew, Uber

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
Hadoop powers the entire batch analytics Data stack at Uber supporting various use cases ranging from trip/delivery ETA prediction to decision making for promotions and pricing. After operating Hadoop on bare-metal for 5 years, the Data team at Uber took a major leap towards adopting containers for deployment and automation of Hadoop infrastructure. In this session, Matt will discuss the technical challenges faced during the containerization journey, designing a 0 downtime migration for a system that launches 20+ million containers per day, and how the project transformed their team's culture on operating Hadoop efficiently at Uber. Also refer their 2021 blog on this topic: https://eng.uber.com/hadoop-container-blog/
Speakers
avatar for Mithun (Matt) Mathew

Mithun (Matt) Mathew

Software Engineer, Uber
Matt is a software engineer with the Data team at Uber. He started working on cluster management systems as a developer on Apache Ambari. He currently leads the effort to containerize Data infrastructure. He is passionate about infrastructure automation and focuses on incremental... Read More →

2022 09 16 Containerizing & Orchestrating Hadoop Infrastructure at Scale pdf
Friday September 16, 2022 13:55 - 14:35 IST
Wicklow Hall 2A (Level 2)
  ContainerCon, Container Runtimes + Management and Orchestration