Text

What is a Tabby? Interpretable Model Decisions by Learning Attribute-Based Classification Criteria

State-of-the-art classification models are usually considered as black boxes since their decision processes are implicit to humans. On the contrary, human experts classify objects according to a set of explicit hierarchical criteria. For example, “tabby is a domestic cat with stripes, dots, or lines”, where tabby is defined by combining its superordinate category (domestic cat) and some certain attributes (e.g., has stripes). Inspired by this mechanism, we propose an interpretable Hierarchical Criteria Network (HCN) by additionally learning such criteria. To achieve this goal, images and semantic entities (e.g., taxonomies and attributes) are embedded into a common space, where each category can be represented by the linear combination of its superordinate category and a set of learned discriminative attributes. Specifically, a two-stream convolutional neural network (CNN) is elaborately devised, which embeds images and taxonomies with the two streams respectively. The model is trained by minimizing the prediction error of hierarchy labels on both streams. Extensive experiments on two widely studied datasets (CIFAR-100 and ILSVRC) demonstrate that HCN can learn meaningful attributes as well as reasonable and interpretable classification criteria. Therefore, the proposed method enables further human feedback for model correction as an additional benefit.

Ketersediaan

Informasi Detail

Judul Seri

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE; Vol.43 No.5 May 2021

No. Panggil

-

Penerbit

: .,

Deskripsi Fisik

p. 1791 - 1807

Bahasa

English

ISBN/ISSN

-

Klasifikasi

-

Tipe Isi

-

Tipe Media

-

Tipe Pembawa

-

Edisi

-

Subjek

CONVOLUTIONAL NEURAL NETWORK
INTERPRETABLE MODEL
VISUAL ATTRIBUTES
CLASSIFICATION CRITERIA

Info Detail Spesifik

DOI: 10.1109/TPAMI.2019.2954501

Pernyataan Tanggungjawab

Haomiao Liu, Ruiping Wang, Shiguang Shan, Xilin Chen

Versi lain/terkait

Lampiran Berkas

Komentar