Contents Science Lab

News

November 10, 2020: Our work on Imageability estimation using visual and language features by C. Matsuhira et al. got presented at ICMR2020.

October 16, 2020: Our work on sentence imageability-aware image captioning by K. Umemura et al. got accepted by MMM2021.

April 1, 2020: Contents Science Lab was established.

Recent projects

Book page colorization based on perception

In this research, we colorize pages of books according to human perception in order to summarize and compare book contents.



Image captioning considering imageability

In this research, we incorporate psycholinguistics into image captioning in order to tailor captions to different applications.



Imageability estimation

In this research, we model the human perception of the semantic gap for use in affective computing.



Mimetic words

In this research, we analyze the phonetic characteristics and human perception of mimetic words used in Japanese to describe human gait.

Recent publications

Towards the understanding of human perception through generative AI technology. Ichiro Ide. International Symposium on Advanced and Sustainable Science and Technology (ISASST) 2024, September 2024.

大規模言語モデルは未知語に対する人間の感情想起を再現できるか？. 宮川由衣, 松平 茅隼, 加藤 大貴, 平山 高嗣, 駒水孝裕, 井手 一郎. テキストアナリティクス・シンポジウム, September 2024.

R-DiP: Re-ranking Based Diffusion Pre-computation for Image Retrieval. Tatsuya Kato, Takahiro Komamizu, Ichiro Ide. The 35th International Conference on Database and Expert Systems Applications (DEXA 2024), pp.233-247, August 2024.

Do LLMs Agree with Humans on Emotional Associations to Nonsense Words?. Yui Miyakawa, Chihaya Matsuhira, Hirotaka Kato, Takatsugu Hirayama, Takahiro Komamizu, Ichiro Ide. Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, p.81–85, August 2024.

Leveraging Similarity-Preserving Post-Training Quantization for Lightweight Crop Disease Detection. PADEIRO Carlos Victorino, 陳 則瑋, KOMAMIZU Takahiro, IDE Ichiro. 第27回画像の認識・理解シンポジウム(MIRU2024) 論文集, August 2024.

動画像とテキスト特徴のマルチスケール統合によるオープン語彙時系列行動検出. Trung Thanh Nguyen. 修士論文, August 2024.

Toward Visual Storytelling using Scene-Graph. PHUEAKSRI Itthisak, Marc A. Kastner, Yasutomo Kawanishi, Takahiro Komamizu, Ichiro Ide. Unknown Journal, IS2-99, August 2024.

歌唱時の口唇形状の類似性を考慮した歌詞の自動翻訳の検討. 池田 昂太郎, 松平 茅隼, 加藤 大貴, カストナー マークアウレル, 駒水孝裕, 平山 高嗣, 井手 一郎. 第27回画像の認識・理解シンポジウム(MIRU2024) 論文集, IS2-138, August 2024.

語感の定量化に向けた画像に写る概念に対する視覚的印象の推定. 松平 茅隼, カストナー マークアウレル, 駒水孝裕, 平山 高嗣, 井手 一郎. 第27回画像の認識・理解シンポジウム(MIRU2024) 論文集, IS-2-134, August 2024.

Image Collection Summarization by Analyzing Scene-Graph. PHUEAKSRI Itthisak. Doctor thesis, July 2024.