Distributed resource management across process boundaries

Lalith Suresh, Peter Bodik, Ishai Menache, Marco Canini, Florin Ciucu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

22 Scopus citations

Abstract

Multi-tenant distributed systems composed of small services, such as Service-oriented Architectures (SOAs) and Micro-services, raise new challenges in attaining high performance and efficient resource utilization. In these systems, a request execution spans tens to thousands of processes, and the execution paths and resource demands on different services are generally not known when a request first enters the system. In this paper, we highlight the fundamental challenges of regulating load and scheduling in SOAs while meeting end-to-end performance objectives on metrics of concern to both tenants and operators. We design Wisp, a framework for building SOAs that transparently adapts rate limiters and request schedulers system-wide according to operator policies to satisfy end-to-end goals while responding to changing system conditions. In evaluations against production as well as synthetic workloads, Wisp successfully enforces a range of end-to-end performance objectives, such as reducing average latencies, meeting deadlines, providing fairness and isolation, and avoiding system overload.

Original languageEnglish (US)
Title of host publicationSoCC 2017 - Proceedings of the 2017 Symposium on Cloud Computing
PublisherAssociation for Computing Machinery, Inc
Pages611-623
Number of pages13
ISBN (Electronic)9781450350280
DOIs
StatePublished - Sep 24 2017
Event2017 Symposium on Cloud Computing, SoCC 2017 - Santa Clara, United States
Duration: Sep 24 2017Sep 27 2017

Publication series

NameSoCC 2017 - Proceedings of the 2017 Symposium on Cloud Computing

Conference

Conference2017 Symposium on Cloud Computing, SoCC 2017
Country/TerritoryUnited States
CitySanta Clara
Period09/24/1709/27/17

Keywords

  • Microservices
  • Rate limiting
  • Resource management
  • Scheduling
  • Service-oriented architectures

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Theoretical Computer Science

Fingerprint

Dive into the research topics of 'Distributed resource management across process boundaries'. Together they form a unique fingerprint.

Cite this