Robust bivariate error detection in skewed data with application to historical radiosonde winds

Ying Sun, Amanda S. Hering, Joshua M. Browning

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

The global historical radiosonde archives date back to the 1920s and contain the only directly observed measurements of temperature, wind, and moisture in the upper atmosphere, but they contain many random errors. Most of the focus on cleaning these large datasets has been on temperatures, but winds are important inputs to climate models and in studies of wind climatology. The bivariate distribution of the wind vector does not have elliptical contours but is skewed and heavy-tailed, so we develop two methods for outlier detection based on the bivariate skew-t (BST) distribution, using either distance-based or contour-based approaches to flag observations as potential outliers. We develop a framework to robustly estimate the parameters of the BST and then show how the tuning parameter to get these estimates is chosen. In simulation, we compare our methods with one based on a bivariate normal distribution and a nonparametric approach based on the bagplot. We then apply all four methods to the winds observed for over 35,000 radiosonde launches at a single station and demonstrate differences in the number of observations flagged across eight pressure levels and through time. In this pilot study, the method based on the BST contours performs very well.
Original languageEnglish (US)
Pages (from-to)e2431
JournalEnvironmetrics
Volume28
Issue number3
DOIs
StatePublished - Jan 17 2017

Bibliographical note

KAUST Repository Item: Exported on 2020-10-01
Acknowledged KAUST grant number(s): OSR-2015-CRG4-2582
Acknowledgements: The authors would like to thank Adelchi Azzalini, Douglas Nychka, SteveWorley, and Joey Comeaux for discussions and ideas that helped to direct and focus this work. In addition, we are grateful to two referees for providing useful comments on the paper. This publication is based upon work supported by the King Abdullah University of Science and Technology (KAUST) Office of Sponsored Research (OSR) under Award OSR-2015-CRG4-2582.

Fingerprint

Dive into the research topics of 'Robust bivariate error detection in skewed data with application to historical radiosonde winds'. Together they form a unique fingerprint.

Cite this