Text

A Generalized Earley Parser for Human Activity Parsing and Prediction

Detection, parsing, and future predictions on sequence data (e.g., videos) require the algorithms to capture non-Markovian and compositional properties of high-level semantics. Context-free grammars are natural choices to capture such properties, but traditional grammar parsers (e.g., Earley parser) only take symbolic sentences as inputs. In this paper, we generalize the Earley parser to parse sequence data which is neither segmented nor labeled. Given the output of an arbitrary probabilistic classifier, this generalized Earley parser finds the optimal segmentation and labels in the language defined by the input grammar. Based on the parsing results, it makes top-down future predictions. The proposed method is generic, principled, and widely applicable. Experiment results clearly show the benefit of our method for both human activity parsing and prediction on three video datasets.

Ketersediaan

Informasi Detail

Judul Seri

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE; Vol.43 No.8 August 2021

No. Panggil

-

Penerbit

: .,

Deskripsi Fisik

p. 2538 - 2554

Bahasa

English

ISBN/ISSN

-

Klasifikasi

-

Tipe Isi

-

Tipe Media

-

Tipe Pembawa

-

Edisi

-

Subjek

ACTIVITY RECOGNITION
VIDEO UNDERSTANDING
ACTIVITY PREDICTION
HIGH-LEVEL VISION
GRAMMAR MODELS
GRAMMAR PARSER

Info Detail Spesifik

DOI: 10.1109/TPAMI.2020.2976971

Pernyataan Tanggungjawab

Siyuan Qi, Baoxiong Jia, Siyuan Huang, Ping Wei, Song-Chun Zhu

Versi lain/terkait

Lampiran Berkas

Komentar