Sparse principal component regression via singular value decomposition approach

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

Principal component regression (PCR) is a two-stage procedure: the first stage performs principal component analysis (PCA) and the second stage builds a regression model whose explanatory variables are the principal components obtained in the first stage. Since PCA is performed using only explanatory variables, the principal components have no information about the response variable. To address this problem, we present a one-stage procedure for PCR based on a singular value decomposition approach. Our approach is based upon two loss functions, which are a regression loss and a PCA loss from the singular value decomposition, with sparse regularization. The proposed method enables us to obtain principal component loadings that include information about both explanatory variables and a response variable. An estimation algorithm is developed by using the alternating direction method of multipliers. We conduct numerical studies to show the effectiveness of the proposed method.

Original languageEnglish
Pages (from-to)795-823
Number of pages29
JournalAdvances in Data Analysis and Classification
Volume15
Issue number3
DOIs
Publication statusPublished - Sept 2021
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Sparse principal component regression via singular value decomposition approach'. Together they form a unique fingerprint.

Cite this