Peloton – Uber’s Webscale Unified Scheduler on Mesos & Kubernetes

Peloton – Uber’s Webscale Unified Scheduler on Mesos & Kubernetes

  • October 5, 2019
Table of Contents

Peloton – Uber’s Webscale Unified Scheduler on Mesos & Kubernetes

Mayank Bansal and Min Cai present Peloton, a Unified Resource Scheduler for collocating heterogeneous workloads in shared Mesos clusters. Its goal is to manage compute resources more efficiently while providing hierarchical max-min fairness guarantees for different teams. Peloton schedules large-scale batch jobs with millions of tasks and supports distributed TensorFlow jobs with thousands of GPUs.

Source: infoq.com

Tags :
Share :
comments powered by Disqus

Related Posts

A videogame that powers quantum entanglement experiments

A videogame that powers quantum entanglement experiments

The random number generator Abellan wanted to use? Randos online. His group would design a game that used the 1 and 0 keys on a phone or computer keyboard as controller buttons.

Read More
Sessionizing Uber Trips in Real Time

Sessionizing Uber Trips in Real Time

Uber’s many data flows required modeling the data associated with a specific task, such as a rider trip, into a state machine. The state machine lets engineers focus on just the events needed to successfully accomplish a trip. In one sense, Uber’s challenge of efficiently matching riders and drivers in the real world comes down to the question of how to collect, store, and logically arrange data.

Read More