Text

E2SRI: Learning to Super-Resolve Intensity Images From Events

An event camera reports per-pixel intensity differences as an asynchronous stream of events with low latency, high dynamic range (HDR), and low power consumption. This stream of sparse/dense events limits the direct use of well-known computer vision applications for event cameras. Further applications of event streams to vision tasks that are sensitive to image quality issues, such as spatial resolution and blur, e.g., object detection, would benefit from a higher resolution of image reconstruction. Moreover, despite the recent advances in spatial resolution in event camera hardware, the majority of commercially available event cameras still have relatively low spatial resolutions when compared to conventional cameras. We propose an end-to-end recurrent network to reconstruct high-resolution, HDR, and temporally consistent grayscale or color frames directly from the event stream, and extend it to generate temporally consistent videos. We evaluate our algorithm on real-world and simulated sequences and verify that it reconstructs fine details of the scene, outperforming previous methods in quantitative quality measures. We further investigate how to (1) incorporate active pixel sensor frames (produced by an event camera) and events together in a complementary setting and (2) reconstruct images iteratively to create an even higher quality and resolution in the images.

Ketersediaan

Informasi Detail

Judul Seri

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE; Vol.44 No.10 Part 2 October 2022

No. Panggil

-

Penerbit

: .,

Deskripsi Fisik

p. 6890-6909

Bahasa

English

ISBN/ISSN

-

Klasifikasi

NONE

Tipe Isi

-

Tipe Media

-

Tipe Pembawa

-

Edisi

-

Subjek

SUPER-RESOLUTION
IMAGE RECONSTRUCTION
EVENT-BASED VISION
NEUROMORPHIC CAMERA
HIGH DYNAMIC RANGE
COLOR EVENTS

Info Detail Spesifik

DOI: 10.1109/TPAMI.2021.3096985

Pernyataan Tanggungjawab

Mohammad Mostafavi, Yeongwoo Nam, Jonghyun Choi, Kuk-Jin Yoon

Versi lain/terkait

Lampiran Berkas

Komentar