Text

Learning Deep Sparse Regularizers With Applications to Multi-View Clustering and Semi-Supervised Classification

Sparsity-constrained optimization problems are common in machine learning, such as sparse coding, low-rank minimization and compressive sensing. However, most of previous studies focused on constructing various hand-crafted sparse regularizers, while little work was devoted to learning adaptive sparse regularizers from given input data for specific tasks. In this paper, we propose a deep sparse regularizer learning model that learns data-driven sparse regularizers adaptively. Via the proximal gradient algorithm, we find that the sparse regularizer learning is equivalent to learning a parameterized activation function. This encourages us to learn sparse regularizers in the deep learning framework. Therefore, we build a neural network composed of multiple blocks, each being differentiable and reusable. All blocks contain learnable piecewise linear activation functions which correspond to the sparse regularizer to be learned. Furthermore, the proposed model is trained with back propagation, and all parameters in this model are learned end-to-end. We apply our framework to multi-view clustering and semi-supervised classification tasks to learn a latent compact representation. Experimental results demonstrate the superiority of the proposed framework over state-of-the-art multi-view learning models.

Ketersediaan

Informasi Detail

Judul Seri

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE; Vol.44 No.9 Part 1 September 2022

No. Panggil

-

Penerbit

: .,

Deskripsi Fisik

p. 5042-5055

Bahasa

English

ISBN/ISSN

-

Klasifikasi

NONE

Tipe Isi

-

Tipe Media

-

Tipe Pembawa

-

Edisi

-

Subjek

BENTUK GALAKSI
MULTI-VIEW LEARNING
PROXIMAL OPERATOR
SPARSE RELULARIZER
PARAMETERIZED ACTIVATION FUNCTION

Info Detail Spesifik

10.1109/TPAMI.2021.3082632

Pernyataan Tanggungjawab

Shiping Wang, Zhaoliang Chen, Shide Du, Zhouchen Lin

Versi lain/terkait

Lampiran Berkas

Komentar