Text

Tensor Canonical Correlation Analysis With Convergence and Statistical Guarantees

In many applications, such as classification of images or videos, it is of interest to develop a framework for tensor data instead of an ad-hoc way of transforming data to vectors due to the computational and under-sampling issues. In this article, we study convergence and statistical properties of two-dimensional canonical correlation analysis under an assumption that data come from a probabilistic model. We show that carefully initialized the power method converges to the optimum and provide a finite sample bound. Then we extend this framework to tensor-valued data and propose the higher-order power method, which is commonly used in tensor decomposition, to extract the canonical directions. Our method can be used effectively in a large-scale data setting by solving the inner least squares problem with a stochastic gradient descent, and we justify convergence via the theory of Lojasiewicz’s inequalities without any assumption on data generating process and initialization. For practical applications, we further develop (a) an inexact updating scheme which allows us to use the state-of-the-art stochastic gradient descent algorithm, (b) an effective initialization scheme which alleviates the problem of local optimum in nonconvex optimization, and (c) a deflation procedure for extracting several canonical components. Empirical analyses on challenging data including gene expression and air pollution indexes in Taiwan, show the effectiveness and efficiency of the proposed methodology. Our results fill a missing, but crucial, part in the literature on tensor data. Supplementary materials for this article are available online.

Ketersediaan

Informasi Detail

Judul Seri

JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS; Vol.30 No.3 September 2021

No. Panggil

-

Penerbit

: .,

Deskripsi Fisik

p. 728 - 744

Bahasa

English

ISBN/ISSN

-

Klasifikasi

NONE

Tipe Isi

-

Tipe Media

-

Tipe Pembawa

-

Edisi

-

Subjek

TENSOR DECOMPOSITION
CANONICAL CORRELATION ANALYSIS
NONCONVEX OPTIMIZATION
DEFLATION
HIGHER-ORDER POWER METHOD
LOJASIEWICZ’S INEQUALITIES

Info Detail Spesifik

https://doi.org/10.1080/10618600.2020.1856118

Pernyataan Tanggungjawab

You-Lin Chen, Mladen Kolar, Ruey S. Tsay

Versi lain/terkait

Lampiran Berkas

Komentar