Contents Science Lab

News

November 10, 2020: Our work on Imageability estimation using visual and language features by C. Matsuhira et al. got presented at ICMR2020.

October 16, 2020: Our work on sentence imageability-aware image captioning by K. Umemura et al. got accepted by MMM2021.

April 1, 2020: Contents Science Lab was established.

Recent projects

Book page colorization based on perception

In this research, we colorize pages of books according to human perception in order to summarize and compare book contents.



Image captioning considering imageability

In this research, we incorporate psycholinguistics into image captioning in order to tailor captions to different applications.



Imageability estimation

In this research, we model the human perception of the semantic gap for use in affective computing.



Mimetic words

In this research, we analyze the phonetic characteristics and human perception of mimetic words used in Japanese to describe human gait.

Recent publications

MultiSensor-Home: Benchmark for Multi-modal Multi-view Action Recognition in Home Environments. Trung Thanh Nguyen. ACM International Conference on Multimedia in Asia, pp.1-5To be published in , December 2025.

Q-Adapter: Visual Query Adapter for Extracting Textually-related Features in Video Captioning. Junan Chen, Trung Thanh Nguyen, Takahiro Komamizu, Ichiro Ide. ACM International Conference on Multimedia in Asia, pp.1-10To be published in , December 2025.

Hierarchical Global-Local Fusion for One-stage Open-vocabulary Temporal Action Detection. Trung Thanh Nguyen, Yasutomo Kawanishi, Takahiro Komamizu, Ichiro Ide. ACM Transactions on Multimedia Computing, Communications, and Applications, October 2025.

IntentVC 2025: The ACM Multimedia Grand Challenge on Intention-Oriented Controllable Video Captioning. Takahiro Komamizu, Marc A. Kastner, Yasutomo Kawanishi, Trung Thanh Nguyen, Junan Chen. ACM International Conference on Multimedia (ACMMM), pp.1-2, October 2025.

Guest Editorial Preface -Special issue on "The 13th International Symposium on Information and Communication Technology -SoICT 2024-"-. Ichiro Ide, Huynh Thi Thanh Binh, Tran Minh Triet. Informatica, 49(3), p.461, October 2025.

東海ブロックだより. 井手 一郎. 数理・データサイエンス・AI教育強化拠点コンソーシアムNEWSLETTER, Vol.25, pp.4-5, September 2025.

放送映像アーカイブから見える社会変化の予兆. 井手 一郎. 予兆学シンポジウム2025, September 2025.

疑似対訳を用いた歌詞らしい歌詞翻訳. 池田 昂太郎. 東海関西データベースワークショップ2025, September 2025.

調理動画に基づく調理の‘上手さ’評価実験. 益田菜々望. 東海関西データベースワークショップ2025, September 2025.

［解説］野外鳥類の行動解析のための視聴覚生態環境理解・解析技術. 中臺一博, 森本\u3000元, 井手 一郎, 鈴木麗璽, 松林志保, 小島諒介. 電子情報通信学会誌, 108(9), pp.888-894, September 2025.