Large-Scale System Monitoring Experiences and Recommendations Workshop paper: HPCMASPA 2018

Ville Ahlgren; Stefan Andersson; Jim Brandt; Nicholas P. Cardo; Sudheer Chunduri; Jeremy Enos; Parks Fields; Ann Gentile; Richard Gerber; Michael Gienger; Joe Greenseid; Annette Greiner; Bilel Hadri; Yun (Helen) He; Dennis Hoppe; Urpo Kaila; Kaki Kelly; Mark Klein; Alex Kristiansen; Steve Leak; Mike Mason; Kevin Pedretti; Jean-Guillaume Piccinali; Jason Repik; Jim Rogers; Susanna Salminen; Mike Showerman; Cary Whitney; Jim Williams

doi:10.1109/CLUSTER.2018.00069

Large-Scale System Monitoring Experiences and Recommendations Workshop paper: HPCMASPA 2018

Ville Ahlgren, Stefan Andersson, Jim Brandt, Nicholas P. Cardo, Sudheer Chunduri, Jeremy Enos, Parks Fields, Ann Gentile, Richard Gerber, Michael Gienger, Joe Greenseid, Annette Greiner, Bilel Hadri, Yun (Helen) He, Dennis Hoppe, Urpo Kaila, Kaki Kelly, Mark Klein, Alex Kristiansen, Steve LeakMike Mason, Kevin Pedretti, Jean-Guillaume Piccinali, Jason Repik, Jim Rogers, Susanna Salminen, Mike Showerman, Cary Whitney, Jim Williams

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

8 Scopus citations

Abstract

Monitoring of High Performance Computing (HPC) platforms is critical to successful operations, can provide insights into performance-impacting conditions, and can inform methodologies for improving science throughput. However, monitoring systems are not generally considered core capabilities in system requirements specifications nor in vendor development strategies. In this paper we present work performed at a number of large-scale HPC sites towards developing monitoring capabilities that fill current gaps in ease of problem identification and root cause discovery. We also present our collective views, based on the experiences presented, on needs and requirements for enabling development by vendors or users of effective sharable end-to-end monitoring capabilities.

Original language	English (US)
Title of host publication	2018 IEEE International Conference on Cluster Computing (CLUSTER)
Publisher	IEEE
Pages	532-542
Number of pages	11
ISBN (Print)	9781538683194
DOIs	https://doi.org/10.1109/CLUSTER.2018.00069
State	Published - 2018

Bibliographical note

KAUST Repository Item: Exported on 2021-08-20
Acknowledgements: This research was supported by and used resources of the Argonne Leadership Computing Facility, which is a U.S. Department of Energy Office of Science User Facility operated under contract DE-AC02-06CH11357. This document is approved for release under LA-UR-18-26485.

Access to Document

10.1109/CLUSTER.2018.00069

Cite this

Ahlgren, V., Andersson, S., Brandt, J., Cardo, N. P., Chunduri, S., Enos, J., Fields, P., Gentile, A., Gerber, R., Gienger, M., Greenseid, J., Greiner, A., Hadri, B., He, Y., Hoppe, D., Kaila, U., Kelly, K., Klein, M., Kristiansen, A., ... Williams, J. (2018). Large-Scale System Monitoring Experiences and Recommendations Workshop paper: HPCMASPA 2018. In 2018 IEEE International Conference on Cluster Computing (CLUSTER) (pp. 532-542). IEEE. https://doi.org/10.1109/CLUSTER.2018.00069

@inproceedings{cafe78d9bc7f44caa251ef494f655e9d,

title = "Large-Scale System Monitoring Experiences and Recommendations Workshop paper: HPCMASPA 2018",

abstract = "Monitoring of High Performance Computing (HPC) platforms is critical to successful operations, can provide insights into performance-impacting conditions, and can inform methodologies for improving science throughput. However, monitoring systems are not generally considered core capabilities in system requirements specifications nor in vendor development strategies. In this paper we present work performed at a number of large-scale HPC sites towards developing monitoring capabilities that fill current gaps in ease of problem identification and root cause discovery. We also present our collective views, based on the experiences presented, on needs and requirements for enabling development by vendors or users of effective sharable end-to-end monitoring capabilities.",

author = "Ville Ahlgren and Stefan Andersson and Jim Brandt and Cardo, {Nicholas P.} and Sudheer Chunduri and Jeremy Enos and Parks Fields and Ann Gentile and Richard Gerber and Michael Gienger and Joe Greenseid and Annette Greiner and Bilel Hadri and He, {Yun (Helen)} and Dennis Hoppe and Urpo Kaila and Kaki Kelly and Mark Klein and Alex Kristiansen and Steve Leak and Mike Mason and Kevin Pedretti and Jean-Guillaume Piccinali and Jason Repik and Jim Rogers and Susanna Salminen and Mike Showerman and Cary Whitney and Jim Williams",

note = "KAUST Repository Item: Exported on 2021-08-20 Acknowledgements: This research was supported by and used resources of the Argonne Leadership Computing Facility, which is a U.S. Department of Energy Office of Science User Facility operated under contract DE-AC02-06CH11357. This document is approved for release under LA-UR-18-26485.",

year = "2018",

doi = "10.1109/CLUSTER.2018.00069",

language = "English (US)",

isbn = "9781538683194",

pages = "532--542",

booktitle = "2018 IEEE International Conference on Cluster Computing (CLUSTER)",

publisher = "IEEE",

}

Ahlgren, V, Andersson, S, Brandt, J, Cardo, NP, Chunduri, S, Enos, J, Fields, P, Gentile, A, Gerber, R, Gienger, M, Greenseid, J, Greiner, A, Hadri, B, He, Y, Hoppe, D, Kaila, U, Kelly, K, Klein, M, Kristiansen, A, Leak, S, Mason, M, Pedretti, K, Piccinali, J-G, Repik, J, Rogers, J, Salminen, S, Showerman, M, Whitney, C & Williams, J 2018, Large-Scale System Monitoring Experiences and Recommendations Workshop paper: HPCMASPA 2018. in 2018 IEEE International Conference on Cluster Computing (CLUSTER). IEEE, pp. 532-542. https://doi.org/10.1109/CLUSTER.2018.00069

TY - GEN

T1 - Large-Scale System Monitoring Experiences and Recommendations Workshop paper: HPCMASPA 2018

AU - Ahlgren, Ville

AU - Andersson, Stefan

AU - Brandt, Jim

AU - Cardo, Nicholas P.

AU - Chunduri, Sudheer

AU - Enos, Jeremy

AU - Fields, Parks

AU - Gentile, Ann

AU - Gerber, Richard

AU - Gienger, Michael

AU - Greenseid, Joe

AU - Greiner, Annette

AU - Hadri, Bilel

AU - He, Yun (Helen)

AU - Hoppe, Dennis

AU - Kaila, Urpo

AU - Kelly, Kaki

AU - Klein, Mark

AU - Kristiansen, Alex

AU - Leak, Steve

AU - Mason, Mike

AU - Pedretti, Kevin

AU - Piccinali, Jean-Guillaume

AU - Repik, Jason

AU - Rogers, Jim

AU - Salminen, Susanna

AU - Showerman, Mike

AU - Whitney, Cary

AU - Williams, Jim

N1 - KAUST Repository Item: Exported on 2021-08-20 Acknowledgements: This research was supported by and used resources of the Argonne Leadership Computing Facility, which is a U.S. Department of Energy Office of Science User Facility operated under contract DE-AC02-06CH11357. This document is approved for release under LA-UR-18-26485.

PY - 2018

Y1 - 2018

N2 - Monitoring of High Performance Computing (HPC) platforms is critical to successful operations, can provide insights into performance-impacting conditions, and can inform methodologies for improving science throughput. However, monitoring systems are not generally considered core capabilities in system requirements specifications nor in vendor development strategies. In this paper we present work performed at a number of large-scale HPC sites towards developing monitoring capabilities that fill current gaps in ease of problem identification and root cause discovery. We also present our collective views, based on the experiences presented, on needs and requirements for enabling development by vendors or users of effective sharable end-to-end monitoring capabilities.

AB - Monitoring of High Performance Computing (HPC) platforms is critical to successful operations, can provide insights into performance-impacting conditions, and can inform methodologies for improving science throughput. However, monitoring systems are not generally considered core capabilities in system requirements specifications nor in vendor development strategies. In this paper we present work performed at a number of large-scale HPC sites towards developing monitoring capabilities that fill current gaps in ease of problem identification and root cause discovery. We also present our collective views, based on the experiences presented, on needs and requirements for enabling development by vendors or users of effective sharable end-to-end monitoring capabilities.

UR - http://hdl.handle.net/10754/670699

UR - https://ieeexplore.ieee.org/document/8514913/

UR - http://www.scopus.com/inward/record.url?scp=85057218940&partnerID=8YFLogxK

U2 - 10.1109/CLUSTER.2018.00069

DO - 10.1109/CLUSTER.2018.00069

M3 - Conference contribution

SN - 9781538683194

SP - 532

EP - 542

BT - 2018 IEEE International Conference on Cluster Computing (CLUSTER)

PB - IEEE

ER -

Large-Scale System Monitoring Experiences and Recommendations Workshop paper: HPCMASPA 2018

Abstract

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this