Contents Science Lab

Dr. Takatsugu Hirayama

Visiting Professor （University of Human Environments）

E-Mail: takatsugu.hirayama ( a t ) nagoya-u.jp

Personal website: http://www.murase.m.is.nagoya-u.ac.jp/~hirayamat/index_e.html

Dr. Takatsugu Hirayama received the M.E. and D.E. degrees in Engineering Science from Osaka University in 2002 and 2005, respectively. From 2005 to 2011, he had been a Research Assistant Professor at the Graduate School of Informatics, Kyoto University. In 2011, he moved to the Graduate School of Information Science, Nagoya University. He had been an Assistant Professor from 2012 to 2014, a Designated Associate Professor from 2014 to 2017. He is currently a Designated Associate Professor at the Institutes of Innovation for Future Society, Nagoya University. His research interests include computer vision (face recognition, visual attention modeling, action recognition) and human-computer interaction (multi-modal interaction design, internal state estimation, interaction dynamics analysis). He is a member of IEICE, the Information Processing Society of Japan (IPSJ), ACM, and IEEE.

Recent publications

Do LLMs Agree with Humans on Emotional Associations to Nonsense Words?

Yui Miyakawa, Chihaya Matsuhira, Hirotaka Kato, Takatsugu Hirayama, Takahiro Komamizu, Ichiro Ide
Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, p.81–85, August 2024.

Interpolating the Text-to-Image Correspondence Based on Phonetic and Phonological Similarities for Nonword-to-Image Generation

Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Keisuke Doman, Yasutomo Kawanishi, Ichiro Ide
IEEE Access, Vol.12, pp.41299-41316, March 2024.

Computational measurement of perceived pointiness from pronunciation

Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Ichiro Ide, Takatsugu Hirayama, Yasutomo Kawanishi, Keisuke Doman, Daisuke Deguchi
Multimedia Tools and Applications, 83(9), pp.26183-26210, March 2024.

Correction to: Computational measurement of perceived pointiness from pronunciation

Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Ichiro Ide, Takatsugu Hirayama, Yasutomo Kawanishi, Keisuke Doman, Daisuke Deguchi
Multimedia Tools and Applications, 83(9), pp.26211-26212, March 2024.

Discovering Phonesthemic Clusters in Readings of Kanji Characters toward Exploring Phonestheme in Japanese

Akira Yoshida, Chihaya Matsuhira, Hirotaka Kato, Takatsugu Hirayama, Takahiro Komamizu, Ichiro Ide
Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation, Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation, p.322–337, December 2023.

Nonword-to-Image Generation Considering Perceptual Association of Phonetically Similar Words

Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Keisuke Doman, Ichiro Ide
Proceedings of the 1st International Workshop on Multimedia Content Generation and Evaluation: New Methods and Practice, pp.115-125, October 2023.

Small Object Detection for Birds with Swin Transformer

Da Huo, Marc A. Kastner, Tingwei Liu, Yasutomo Kawanishi, Takatsugu Hirayama, Takahiro Komamizu, Ichiro Ide
International Conference on Machine Vision Applications (MVA), TE-3, July 2023.

Evoked Emotion Distribution Learning through Analysis of Temporal User Comments in Social Media Videos

Yiming Wang, Marc A. Kanster, Da Huo, Takahiro Komamizu, Takatsugu Hirayama, Ichiro Ide
IEICE Technical Report (MVE), March 2023.

IPA-CLIP: Integrating Phonetic Priors into Vision and Language Pretraining

Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Keisuke Doman, Yasutomo Kawanishi, Ichiro Ide
arXiv, cs.MM, arXiv:2303.03144, March 2023.

A Study on Intra-modal Constraint Loss toward Cross-modal Recipe Retrieval

Jiahang LU, Haruya Kyutoku, Keisuke Doman, Takahiro Komamizu, Yasutomo Kawanishi, Takatsugu Hirayama, Ichiro Ide
Unknown Journal, A-3-1, December 2022.

Intuitive Gait Modeling using Mimetic-Words for Gait Description and Generation

Hirotaka Kato, Takatsugu Hirayama, Keisuke Doman, Ichiro Ide, Yasutomo Kawanishi, Takahiro Komamizu, Daisuke Deguchi, Hiroshi Murase
2022 IEEE 5th International Conference on Multimedia Information Processing and Retrieval (MIPR), pp.240-245, August 2022.

On Estimating Evoked Emotions of Social Media Videos through User Comments Analysis

Yiming Wang, Marc A. Kastner, Takahiro Komamizu, Yasutomo Kawanishi, Takatsugu Hirayama, Ichiro Ide
Unknown Journal, IS3-72, July 2022.

Safety margin prediction for pedestrians using risk potential function considering pedestrian attributes and driver skill (in Japanese)

Yamato Maekawa, Takatsugu Hirayama, Yasutomo Kawanishi, Daisuke Deguchi, Hailong Liu, Ichiro Ide, Hiroshi Murase
IEICE Trans. on Fundamentals, March 2022.

TBA (in Japanese)

Kazuma Takeda, Yasutomo Kawanishi, Takatsugu Hirayama, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Kunio Kashino
IEICE Tech. Rep. Pattern Recognition and Media Understanding, December 2021.

Imageability- and Length-Controllable Image Captioning

Marc A. Kastner, Kazuki Umemura, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase, Shin’Ichi Satoh
IEEE Access, Vol.9, pp.162951-162961, November 2021.

Imageability- and Length-Controllable Image Captioning

Marc A. Kastner, Kazuki Umemura, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase, Shin’Ichi Satoh
IEEE Access, Vol.9, pp.162951-162961, November 2021.

Imageability- and length-controllable image captioning

Marc A. Kastner, Kazuki Umemura, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase, Shin'ichi Satoh
IEEE Access, November 2021.

Gaits generation from a mimetic word based on sound symbolism (in Japanese)

Hirotaka Kato, Takatsugu Hirayama, Keisuke Doman, Ichiro Ide, Yasutomo Kawanishi, Daisuke Deguchi, Hiroshi Murase
Trans. JSAI, September 2021.

Pointedness of an Image: Measuring How Pointy an Image is Perceived

Chihaya Matsuhira, Marc A. Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase
Proceedings of HCII 2021, Vol.37, pp.137-144, July 2021.

Pointedness of an image: Measuring how pointy an image is perceived

Chihaya Matsuhira, Marc Aurel Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase
HCI International 2021 -Posters, 23rd HCI Int. Conf., HCII2021, Virtual Event, July 24-29, Procs., Part I, Constantine Stephanidis, Margherita Antona, Stavroula Ntoa eds., Communications in Computer and Information Science, July 2021.

Tell as you imagine: Sentence imageability-aware image captioning

Kazuki Umemura, Marc A. Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase
27th Int. Conf. on Multimedia Modeling (MMM2021), Vol.2, pp.62-73, June 2021.

Tell as you imagine: Sentence imageability-aware image captioning

Kazuki Umemura, Marc A. Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase
MultiMedia Modeling -27th Int. Conf., MMM2021, Prague, Czech Republic, June 22-24, 2021, Procs., Part II, Jakub Lokoč, Tomáš Skopal, Klaus Schoeffmann, Vasileios Mezaris, Xirong Li, Stefanos Vrochidis, Ioannis Patraseds., Lecture Notes in Computer Science, June 2021.

TBA (in Japanese)

Mitsuaki Miyazaki, Tatsumi Hattori, Keisuke Doman, Takatsugu Hirayama, Yasutomo Kawanishi, Ichiro Ide, Yoshito Mekada
Dynamic Image Processing for Real Application Workshop (DIA) 2021, March 2021.

ColAtt-Net: In Reducing the Ambiguity of Pedestrian Orientations on Attribute-Aware Semantic Segmentation Task

Mahmud Dwi Sulistiyo, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Takatsugu Hirayama, Hiroshi Murase
IEEJ Transactions on Electrical and Electronic Engineering, 16(2), pp.295-306, February 2021.

ColAtt-Net: In reducing the ambiguity of pedestrian orientations on attribute-aware semantic segmentation task

Mahmud Dwi Sulistiyo, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Takatsugu Hirayama, Hiroshi Murase
IEEJ Trans. Electrical and Electronic Engineering, February 2021.

Tell as You Imagine: Sentence Imageability-aware Image Captioning

Kazuki Umemura, Marc A. Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase
Lecture Notes in Computer Science, Vol.12573, p.62–73, January 2021.

Automatic Interaction Detection between Vehicles and Vulnerable Road Users During Turning at an Intersection

Hao Cheng, Hailong Liu, Takatsugu Hirayama, Fumito Shinmura, Naoki Akai, Hiroshi Murase
Proceedings of 2020 IEEE Intelligent Vehicles Symposium (IV2020), pp.641-647, November 2020.

3D Monte Carlo Localization with Efficient Distance Field Representation for Automated Driving in Dynamic Environments

Naoki Akai, Takatsugu Hirayama, Hiroshi Murase
Proceedings of 2020 IEEE Intelligent Vehicles Symposium (IV2020), pp.1588-1595, November 2020.

Imageability Estimation using Visual and Language Features

Chihaya Matsuhira, Marc A. Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase
Proceedings of the 2020 International Conference on Multimedia Retrieval, p.306–310, October 2020.

Semantic Localization Considering Uncertainty of Object Recognition

Naoki Akai, Takatsugu Hirayama, Hiroshi Murase
Proceedings of 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2020), October 2020.