DEEP REINFORCEMENT LEARNING FOR VIDEO PREDICTION

檔案

本條目沒有附加檔案。

日期

2019-01-01

期刊名稱

2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP)

卷期與頁次

頁 604–608

ISSN

1522-4880

ISBN

978-1-5386-6249-6

語言

英文

摘要

This paper introduces a hybrid video prediction scheme that combines the classic parametric overlapped block motion compensation (POBMC) technique with neural networks. Most learning-based video prediction methods rely on a black-box-like model for either direct generation of future video frames or estimation of a dense motion field. The model complexity often increases drastically with frame resolution. Departing from pure black-box approaches, this paper leverages the theoretically-grounded POBMC in a reinforcement learning framework to estimate a sparse motion field for future frame warping. Two neural networks are trained to identify critical points in the motion field for motion estimation. We train our model on 10k unlabeled frames in KITTI dataset and achieve the state-of-the-art SSIM score of 0.923 on CaltechPed and an average SSIM scroe of 0.856 on Common Intermediate Format (CIF) standard sequences.

所屬典藏

會議論文
顯示完整詮釋資料 統計資料

引用此條目

Ho, Y.-H., Cho, C.-Y., & Peng, W.-H. (2019). DEEP REINFORCEMENT LEARNING FOR VIDEO PREDICTION. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 604–608. https://ir.lib.nycu.edu.tw/handle/11536/154040

BibTeX RIS

引用文字依 APA 第 7 版格式自動產生,使用前請再核對。

分享

永久網址:https://ir.lib.nycu.edu.tw/handle/11536/154040