Ling Liu's SC13 paper "Large Graph Processing Without the Overhead" featured by HPCwire.
Another list highlighting Open Source Software Releases.
Second GraphLab workshop should be even bigger than the first! GraphLab is a new programming framework for graph-style data analytics.
Hierarchical Scheduling for Diverse Datacenter Workloads
4th ACM Symposium on Cloud Computing (SOCC’13), October 2013.
Arka Bhattacharya, Eric Friedman*, Ali Ghodsi, Scott Shenker, Ion Stoica
University of California, Berkeley
*International Computer Science Institute, Berkeley
There has been a recent industrial effort to develop multi-resource hierarchical schedulers. However, the existing implementations have some shortcomings in that they might leave resources unallocated or starve certain jobs. This is because the multi-resource setting introduces new challenges for hierarchical scheduling policies. We provide an algorithm, which we implement in Hadoop, that generalizes the most commonly used multi-resource scheduler, DRF , to support hierarchies. Our evaluation shows that our proposed algorithm, H-DRF, avoids the starvation and resource inefficiencies of the existing open-source schedulers and outperforms slot scheduling.
FULL PAPER: pdf