A Generic Sure Independence Screening Procedure

Wenliang Pan, Xueqin Wang, Weinan Xiao, Hongtu Zhu

Research output: Contribution to journalArticlepeer-review

48 Scopus citations

Abstract

Extracting important features from ultra-high dimensional data is one of the primary tasks in statistical learning, information theory, precision medicine, and biological discovery. Many of the sure independent screening methods developed to meet these needs are suitable for special models under some assumptions. With the availability of more data types and possible models, a model-free generic screening procedure with fewer and less restrictive assumptions is desirable. In this article, we propose a generic nonparametric sure independence screening procedure, called BCor-SIS, on the basis of a recently developed universal dependence measure: Ball correlation. We show that the proposed procedure has strong screening consistency even when the dimensionality is an exponential order of the sample size without imposing sub-exponential moment assumptions on the data. We investigate the flexibility of this procedure by considering three commonly encountered challenging settings in biological discovery or precision medicine: iterative BCor-SIS, interaction pursuit, and survival outcomes. We use simulation studies and real data analyses to illustrate the versatility and practicability of our BCor-SIS method. Supplementary materials for this article are available online.

Original languageEnglish (US)
Pages (from-to)928-937
Number of pages10
JournalJournal of the American Statistical Association
Volume114
Issue number526
DOIs
StatePublished - Apr 3 2019

Keywords

  • Ball correlation
  • Rank
  • Sure independence
  • Variable screening

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint

Dive into the research topics of 'A Generic Sure Independence Screening Procedure'. Together they form a unique fingerprint.

Cite this