Contents Science Lab

Nagoya University Graduate School of Informatics

News

    November 10, 2020: Our work on Imageability estimation using visual and language features by C. Matsuhira et al. got presented at ICMR2020.

    October 16, 2020: Our work on sentence imageability-aware image captioning by K. Umemura et al. got accepted by MMM2021.

    April 1, 2020: Contents Science Lab was established.

Recent projects

    Avatar image
    Book page colorization based on perception

    In this research, we colorize pages of books according to human perception in order to summarize and compare book contents.

    Avatar image
    Image captioning considering imageability

    In this research, we incorporate psycholinguistics into image captioning in order to tailor captions to different applications.

    Avatar image
    Imageability estimation

    In this research, we model the human perception of the semantic gap for use in affective computing.

    Avatar image
    Mimetic words

    In this research, we analyze the phonetic characteristics and human perception of mimetic words used in Japanese to describe human gait.

Go to all projects >

Recent publications

    Tell as you imagine: Sentence imageability-aware image captioning. Kazuki Umemura, Marc A. Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase. MultiMedia Modeling -27th Int. Conf., MMM2021, Prague, Czech Republic, June 22-24, 2021, Procs., Part II, Jakub Lokoč, Tomáš Skopal, Klaus Schoeffmann, Vasileios Mezaris, Xirong Li, Stefanos Vrochidis, Ioannis Patraseds., Lecture Notes in Computer Science, vol. 12573, pp.62-73, Prague, Czech Republic, To be published in June 2021.

    Best next-viewpoint recommendation by selecting minimum pose ambiguity for category-level object pose estimation. Nik Mohd Zarifie Hashim, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase. Journal of Japan Society for Precision Engineering, vol.87, no.5?, pp.xxxx-xxxx, May 2021.

    Odometry estimation from sparse LiDAR point cloud constrained by image feature correspondence -Depth estimation by Gaussian process regression and odometry estimation considering its reliability- (in Japanese). Masayuki Shimizu, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase. Journal of Japan Society for Precision Engineering, vol.87, no.5, pp.xxxx-xxxx, May 2021.

    A study on product image impression estimation considering the customer's attributes (in Japanese). Mayu Nakamoto, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Mitsuru Nakazawa, Yeongnam Chae, Bjorn Stenger. IEICE 2021 Annual Convention, no.D-12-5, March 2021.

    TBA (in Japanese). Mitsuaki Miyazaki, Tatsumi Hattori, Keisuke Doman, Takatsugu Hirayama, Yasutomo Kawanishi, Ichiro Ide, Yoshito Mekada. Dynamic Image Processing for Real Application Workshop (DIA) 2021, no.OS5-1, March 2021.

    ColAtt-Net: In reducing the ambiguity of pedestrian orientations on attribute-aware semantic segmentation task. Mahmud Dwi Sulistiyo, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Takatsugu Hirayama, Hiroshi Murase. IEEJ Trans. Electrical and Electronic Engineering, vol.141, no.2, pp.295-306, February 2021.

    Proposal of a light-field descriptor considering light-ray direction -Image matching robust to object shape and camera pose- (in Japanese). Masayuki Shimizu, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase. Journal of Japan Society for Precision Engineering, vol.87, no.2, pp.197-205, February 2021.

    LFIR2Pose: Pose estimation from an extremely low-resolution FIR image sequence. Saki Iwata, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Tomoyoshi Aizawa. Proc. 27th IAPR Int. Conf. on Pattern Recognition (ICPR2020), no.PS-T2.2, pp.2597-2603, Online, January 2021.

    Median-shape representation learning for category-level object pose estimation in cluttered environments. Hiroki Tatemichi, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Ayako Amma. Proc. 27th IAPR Int. Conf. on Pattern Recognition (ICPR2020), no.PS-T3.10, pp.4473-4480, Online, January 2021.

    Ω-GAN: Object manifold embedding GAN for image generation by disentangling parameters into pose and shape manifolds. Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase. Proc.27th IAPR Int. Conf. on Pattern Recognition (ICPR2020), no.PS-T1.3, pp.7945-7952, Online, January 2021.

Go to all publications >

Last updated: 2021-05-13 11:06:07.931965788 +0900 JST m=+1.158618967.