Dr. Marc A. Kastner

About me

On visualizing psycholinguistic groundings for sentiment image datasets

Back to publications list »

Marc A. Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Daisuke Deguchi, Hiroshi Murase

Abstract:
Recent multimedia applications commonly use text and imagery from Social Media for tasks related to sentiment research. As such, there are various image datasets for sentiment research for popular classification tasks. However, there has been little research regarding the relationship between the sentiment of images and its annotations from a multi-modal standpoint. In this research, we built a tool to visualize psycholinguistic groundings for a sentiment dataset. For each image, individual psycholinguistic ratings are computed from the image's metadata. A sentiment-psycholinguistic spatial embedding is computed to show a clustering of images across different classes close to human perception. Our interactive browsing tool can visualize the data in various ways, highlighting different psycholinguistic groundings with heatmaps.
Type: Demo at MIRU Symposium
Date: July 2019

If you have questions or ideas about this research, feel free to leave a comment below or send me an email. I will reply quickly.
Powered by Hugo. © 2013-2021 Marc A. Kastner. Some rights reserved. Privacy policy.