Dimension reduction and prediction in large p regressions

Adragni, Kofi Placid
2009-05
Thumbnail Image

View/Download File

Adragni_umn_0130E_10288.pdf (584.94 KB)

Persistent link to this item

https://hdl.handle.net/11299/51904
Statistics
View Statistics

Journal Title

Journal ISSN

Volume Title

Title

Dimension reduction and prediction in large p regressions

Authors

Published Date

2009-05

Publisher

Type

Thesis or Dissertation

Abstract

A high dimensional regression setting is considered with p predictors X=(X1,...,Xp)T and a response Y. The interest is with large p, possibly much larger than n the number of observations. Three novel methodologies based on Principal Fitted Components models (PFC; Cook, 2007) are presented: (1) Screening by PFC (SPFC) for variable screening when p is excessively large, (2) Prediction by PFC (PPFC), and (3) Sparse PFC (SpPFC) for variable selection. SPFC uses a test statistic to detect all predictors marginally related to the outcome. We show that SPFC subsumes the Sure Independence Screening of Fan and Lv (2008). PPFC is a novel methodology for prediction in regression where p can be large or larger than n. PPFC assumes that X|Y has a normal distribution and applies to continuous response variables regardless of their distribution. It yields accuracy in prediction better than current leading methods. We adapt the Sparse Principal Components Analysis (Zou et al., 2006) to the PFC model to develop SpPFC. SpPFC performs variable selection as good as forward linear model methods like the lasso (Tibshirani, 1996), but moreover, it encompasses cases where the distribution of Y|X is non-normal or the predictors and the response are not linearly related.

Keywords

Description

University of Minnesota Ph.D. dissertation. May 2009. Major: Statistics. Advisor: Ralph Dennis Cook. 1 computer file (PDF); xi, 144 pages. Ill. (some col.)

Related to

Replaces

License

Collections

Dissertations

Series/Report Number

Funding information

Isbn identifier

Doi identifier

Previously Published Citation

Suggested citation

Adragni, Kofi Placid. (2009). Dimension reduction and prediction in large p regressions. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/51904.

Content distributed via the University Digital Conservancy may be subject to additional license and use restrictions applied by the depositor. By using these files, users agree to the Terms of Use. Materials in the UDC may contain content that is disturbing and/or harmful. For more information, please see our statement on harmful content in digital repositories.