Contents Science Lab

Affective Computing

In these projects, we look into the semantic gap in terms of human perception of concepts, and apply related ideas to multimedia applications.

In this research, we colorize pages of books according to human perception in order to summarize and compare book contents.

In this research, we incorporate psycholinguistics into image captioning in order to tailor captions to different applications.

In this research, we model the human perception of the semantic gap for use in affective computing.

In these projects, we analyze the relationships between visual data and phonetics.

In this research, we analyze the phonetic characteristics and human perception of mimetic words used in Japanese to describe human gait.

Project members: Hirotaka Kato (+ Faculty)

In these projects, we do research on food images, videos and recipes.

In this research, we analyze the attractiveness of food images using image analysis, including gaze information to improve the results.

In this research, we analyze the typicality of food images within a food category.

In these projects, we analyze use geographic and location data of Social Media contents for multimedia applications.

In this research, we analyze methods for the detection of similar geo-regions based on Visual Concepts in social photos.

Project members: Hiroki Takimoto, Chen Lu (+ Faculty)

In these projects, we target video or document summization using additional knowledge from multimedia corpora.

In this research, we develop an automatic authoring method of video biography using Web contents.

Project members: Kyoka Kunishiro (+ Faculty)