Contents Science Lab

Project: Automatic Authoring of a Video Biography

We propose an automatic authoring method of video biography using Web contents. A video biography is composed of three parts: childhood, profession, and personal life. The proposed research extracts keyphrases on important events for each of these parts from the online encyclopedia Wikipedia, and then retrieve images from an image search engine that correspond with the important events of the person. Focusing on the objects and scenes of the obtained images, by selecting images that share the same features that represent the keyphrases in general, The proposed method selects images that visually represent the important events of the famous person, well. We used ORB and Visual Concepts for representing image contents, and they were switched by the types of the keyphrase and matched. Finally, we produce a video biography as a slide-show of the selected images with captions.

Main project members

Kyoka Kunishiro

Finished Master in AY2016

Recent publications

Automatic selection of Web contents towards automatic authoring of a video biography

Ichiro Ide, Yasutomo Kawanishi, Kyoka Kunishiro, Frank Nack, Daisuke Deguchi, Hiroshi Murase
Proc. 19th IEEE Int. Symposium on Multimedia (ISM2017), pp.304-307, The Splendor Hotel Taichung (Taichung, Taiwan), December 2017.

Automatic Selection of Web Contents Towards Automatic Authoring of a Video Biography (in Japanese)

Kyoka Kunishiro, Frank Nack, Ichiro Ide, Yasutomo Kawanishi, Daisuke Deguchi, Hiroshi Murase
IEICE Tech. Rep. Multimedia and Virtual Environment, MVE2016-59, Kyushu Univ. Ohashi Campus, March 2017.

Towards automatic authoring of a video biography using Web contents (in Japanese)

Kyoka Kunishiro, Frank Nack, Ichiro Ide, Yasutomo Kawanishi, Daisuke Deguchi, Hiroshi Murase
Proc. HCG Symposium 2016, no.D-8-2; pp.493-497, Kochi City Culture-Plaza Cul-Port, December 2016.

TBA (in Japanese)

Kyoka Kunishiro, Frank Nack, Ichiro Ide, Yasutomo Kawanishi, Daisuke Deguchi, Hiroshi Murase
Meeting on Image Recognition and Understanding (MIRU) 2016, DS-06, Act City Hamamatsu, August 2016.

Study on an image selection method towards automatic authoring of video obituary using Web contents (in Japanese)

Kyoka Kunishiro, Frank Nack, Ichiro Ide, Yasutomo Kawanishi, Daisuke Deguchi, Hiroshi Murase
IEICE Tech. Rep. Multimedia and Virtual Environment, MVE2015-63, Meio Univ, March 2016.