In this research, we incorporate psycholinguistics into image captioning in order to tailor captions to different applications.
Recent publications
Imageability- and Length-Controllable Image Captioning
Marc A. Kastner,
Kazuki Umemura,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase,
Shin’Ichi Satoh IEEE Access, Vol.9, pp.162951-162961, November 2021.
Imageability- and Length-Controllable Image Captioning
Marc A. Kastner,
Kazuki Umemura,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase,
Shin’Ichi Satoh IEEE Access, Vol.9, pp.162951-162961, November 2021.
Imageability- and length-controllable image captioning
Marc A. Kastner,
Kazuki Umemura,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase,
Shin'ichi Satoh IEEE Access, November 2021.
Tell as you imagine: Sentence imageability-aware image captioning
Kazuki Umemura,
Marc A. Kastner,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase 27th Int. Conf. on Multimedia Modeling (MMM2021), Vol.2, pp.62-73, June 2021.
Tell as you imagine: Sentence imageability-aware image captioning
Kazuki Umemura,
Marc A. Kastner,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase MultiMedia Modeling -27th Int. Conf., MMM2021, Prague, Czech Republic, June 22-24, 2021, Procs., Part II, Jakub Lokoč, Tomáš Skopal, Klaus Schoeffmann, Vasileios Mezaris, Xirong Li, Stefanos Vrochidis, Ioannis Patraseds., Lecture Notes in Computer Science, June 2021.
Tell as You Imagine: Sentence Imageability-aware Image Captioning
Kazuki Umemura,
Marc A. Kastner,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase Lecture Notes in Computer Science, Vol.12573, p.62–73, January 2021.
TBA (in Japanese)
Kazuki Umemura,
Marc Aurel Kastner,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase Meeting on Image Recognition and Understanding (MIRU) 2020, August 2020.
A study on image captioning considering its imageability (in Japanese)
Kazuki Umemura,
Marc Aurel Kastner,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase IEICE Tech. Rep. Media Experience and Virtual Environment, March 2020.
Estimating the Imageability of a sentence for image caption evaluation
Kazuki Umemura,
Marc Aurel Kastner,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase Japan-Taiwan Joint Workshop on Multimedia and HCI, April 2019.
Estimating the imageability of a sentence for image caption evaluation
Kazuki Umemura,
Marc Aurel Kastner,
Ichiro Ide,
Yasutomo Kawanishi,
Daisuke Deguchi,
Hiroshi Murase Japan-Taiwan Joint Workshop on Multimedia and HCI, April 2019.
TBA (in Japanese)
Kazuki Umemura,
Marc Aurel Kastner,
Ichiro Ide,
Yasutomo Kawanishi,
Takatsugu Hirayama,
Keisuke Doman,
Daisuke Deguchi,
Hiroshi Murase Proc. 25th ANLP Annual Meeting, March 2019.
Last updated: 2024-10-10 00:31:46.681002727 +0000 UTC m=+1.047222386.