Contents Science Lab

News

November 10, 2020: Our work on Imageability estimation using visual and language features by C. Matsuhira et al. got presented at ICMR2020.

October 16, 2020: Our work on sentence imageability-aware image captioning by K. Umemura et al. got accepted by MMM2021.

April 1, 2020: Contents Science Lab was established.

Recent projects

Book page colorization based on perception

In this research, we colorize pages of books according to human perception in order to summarize and compare book contents.



Image captioning considering imageability

In this research, we incorporate psycholinguistics into image captioning in order to tailor captions to different applications.



Imageability estimation

In this research, we model the human perception of the semantic gap for use in affective computing.



Mimetic words

In this research, we analyze the phonetic characteristics and human perception of mimetic words used in Japanese to describe human gait.

Recent publications

調理動画に基づく調理の `上手さ' 評価実験. 益田菜々望. 東海関西データベースワークショップ2025, September 2025.

［解説］野外鳥類の行動解析のための視聴覚生態環境理解・解析技術. 中臺一博, 森本\u3000元, 井手 一郎, 鈴木麗璽, 松林志保, 小島諒介. 電子情報通信学会誌, 108(9), pp.888-894, September 2025.

Stable Diffusionを用いた絵伝のアニメーション化に関する検討. 荒田涼太, 道満 恵介, 井手 一郎, 目加田 慶人. 電子情報通信学会技術研究報告(MVE), MVE2025-11, August 2025.

Leveraging Gradient-Based Pruning for Efficient Neural Networks in Crop Disease Detection. PADEIRO Carlos Victorino, 陳 則瑋, KOMAMIZU Takahiro, IDE Ichiro. 第28回画像の認識・理解シンポジウム(MIRU2025) 論文集, August 2025.

Exploring Unknown Image Generation for Zero Shot Learning via Diffusion Models. Lei Xiang, Yasutomo Kawanishi, Takahiro Komamizu, Ichiro Ide. Unknown Journal, IS3-079, August 2025.

Investigating conceptual blending of a diffusion model for improving nonword-to-image generation (ACMMM2024). 松平 茅隼, カストナー マークアウレル, Takahiro Komamizu, 平山 高嗣, 井手 一郎. 第28回画像の認識・理解シンポジウム(MIRU2025) 論文集, IT3-06, August 2025.

Multi-proposal collaboration and multi-task training for weakly-supervised video moment retrieval. Bolin Zhang, Chao Yang, Bin Jiang, Takahiro Komamizu, Ichiro Ide. International Journal of Machine Learning and Cybernetics, Vol.16, 7-8, pp.4509-4524, August 2025.

MultiSensor-Home: Benchmark for Multi-modal Multi-view Action Recognition in Home Environments. Trung Thanh Nguyen, Yasutomo Kawanishi, Vijay John, Takahiro Komamizu, Ichiro Ide. Unknown Journal, IS3-038, August 2025.

Visual Adapter for Extracting Textually-related Features for Video Captioning. Junan Chen, Trung Thanh Nguyen, Takahiro Komamizu, Ichiro Ide. Unknown Journal, IS3-148, August 2025.

MLLM-based Dataset Construction for Hazard-aware Guidance for the Visually Impaired. Peiyuan ZHU, Marc A. Kastner, Hirotaka Kato, Takatsugu Hirayama, Takahiro Komamizu, Ichiro Ide. Unknown Journal, IS2-140, July 2025.