CVPR__UCSD_UCF_2020(7).pdf (4.12 MB)
Download file

Select to better learn: Fast and accurate deep learning using data selection from nonlinear manifolds

Download (4.12 MB)
posted on 2020-04-10, 17:00 authored by Mohsen JoneidiMohsen Joneidi, Saeed Vahidian, Ashkan Esmaeili, Weijia Wang, Nazanin Rahnavard, Bill Lin, Mubarak Shah
Finding a small subset of data whose linear combination spans other data points, also called column subset selection problem (CSSP), is an important open problem in computer science with many applications in computer vision and deep learning. There are some studies that solve CSSP in a polynomial time complexity w.r.t. the size of the original dataset. A simple and efficient selection algorithm with a linear complexity order, referred to as spectrum pursuit (SP), is proposed that pursuits spectral components of the dataset using available sample points. The proposed non-greedy algorithm aims to iteratively find K data samples whose span is close to that of the first K spectral components of entire data. SP has no parameter to be fine tuned and this desirable property makes it problem-independent. The simplicity of SP enables us to extend the underlying linear model to more complex models such as nonlinear manifolds and graph-based models. The nonlinear extension of SP is introduced as kernel-SP (KSP). The superiority of the proposed algorithms is demonstrated in a wide range of applications.


National Science Foundation under Grants No. 1741431

National Science Foundation under Grants No. CCF-1718195

IARPA R&D Contract No. D17PC00345


Email Address of Submitting Author

ORCID of Submitting Author


Submitting Author's Institution

University of Central Florida

Submitting Author's Country

  • United States of America