Sparse reduced-rank regression with covariance estimation

Lisha Chen, Jianhua Z. Huang

Research output: Contribution to journalArticlepeer-review

10 Scopus citations

Abstract

Improving the predicting performance of the multiple response regression compared with separate linear regressions is a challenging question. On the one hand, it is desirable to seek model parsimony when facing a large number of parameters. On the other hand, for certain applications it is necessary to take into account the general covariance structure for the errors of the regression model. We assume a reduced-rank regression model and work with the likelihood function with general error covariance to achieve both objectives. In addition we propose to select relevant variables for reduced-rank regression by using a sparsity-inducing penalty, and to estimate the error covariance matrix simultaneously by using a similar penalty on the precision matrix. We develop a numerical algorithm to solve the penalized regression problem. In a simulation study and real data analysis, the new method is compared with two recent methods for multivariate regression and exhibits competitive performance in prediction and variable selection.
Original languageEnglish (US)
Pages (from-to)461-470
Number of pages10
JournalStatistics and Computing
Volume26
Issue number1-2
DOIs
StatePublished - Dec 9 2014
Externally publishedYes

Bibliographical note

KAUST Repository Item: Exported on 2020-10-01
Acknowledged KAUST grant number(s): KUS-CI-016-04, GRP-CF-2011-19-P-Gao-Huang
Acknowledgements: Huang’s work was partially supported by NSF grant DMS-1208952 and by Award Numbers KUS-CI-016-04 and GRP-CF-2011-19-P-Gao-Huang, made by King Abdullah University of Science and Technology (KAUST).
This publication acknowledges KAUST support, but has no KAUST affiliated authors.

Fingerprint

Dive into the research topics of 'Sparse reduced-rank regression with covariance estimation'. Together they form a unique fingerprint.

Cite this