ワタナベタイチ   Watanabe Taichi   渡辺大地    所属   メディア学部 メディア学科    職種   教授
言語種別	英語
発行・発表の年月	2019/08
形態種別	国際会議論文
査読	査読あり
標題	A Data-Driven Method for Reproducing Artificial Light Sources in Night View Style Transfer Based on Luminance Map
執筆形態	共著
掲載誌名	IEVC2019
掲載区分	国外
出版社・発行元	画像電子学会
著者・共著者	Xu Wang, Taichi Watanabe and Masanori Kakimoto
概要	In this paper, we introduce a data-driven method for reproducing the artificial light sources in night view transfer. Our idea is to blend the daytime image with artificial light sources. The idea is similar to the method of image matting, which separates a given image into a foreground and a background image. Our method regards the daytime scene as background image and the artificial light sources as foreground. Since the estimate of daytime scene luminance map against nighttime one is also needed, we create a day-to-night dataset to train a pix2pix framework. After computing the artificial light sources based on the luminance map and the luminance-color mapping model, we blend them with a daytime scene and optimize the result according to the predicted nighttime luminance map. The result is restrained to the pix2pix framework but in one respect succesfully restores the artificial light sources in night view image. Our primary contribution is to reproduce a set of artificial light sources in the process of nighttime image synthesis. The new method would not only present an easier approach to transform various daytime images but make the processing more controllable through user interaction.