Explore the relationship between textual sentiments and pictures' emotions based on unit quantification

Yuer Yang; Yongjia Lei; Zeguang Chen; Qinmin Li; Lifeng Zhou; Yujuan Quan

doi:10.1117/12.2640934

2 December 2022 Explore the relationship between textual sentiments and pictures' emotions based on unit quantification

Yuer Yang, Yongjia Lei, Zeguang Chen, Qinmin Li, Lifeng Zhou, Yujuan Quan

Proceedings Volume 12288, International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2022); 1228809 (2022) https://doi.org/10.1117/12.2640934
Event: International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2022), 2022, Zhuhai, China

Abstract

In the interdisciplinary field of finance and computing, scholars have proposed a method to calculate investor sentiment and thus predict stock trends from investor comment section data, which has also been transferred to perform analysis of the emotion of the news texts that would affect the investors’ decisions on investment. After the great success of textual sentiment analysis, some scholars found that the pictures’ emotions in the news have similar influences on investor sentiment. However, the problem is that, unlike the texts which can reflect the editor’s attitude directly and effectively, since some editors usually do not deliberately pay attention to the emotions of news pictures, most of them are published as how they look when taken. Few editors intentionally change pictures’ emotions according to their attitudes in post-processing moments. Thus, to apply a more precise stock forecasting model to automatic buying and selling software, it seems significant to figure out whether the news pictures and the texts express similar attitudes and in what kinds of news pictures can accurately convey the attitude of the news editor. We collected articles about finance from four sources and conducted a correlation analysis between textual sentiments and pictures’ emotions to solve these two problems. A modified NLP model provides textual sentiments, and a two-category deep learning model gives pictures’ emotions. On the whole, this work not only helps improve the accuracy of the automatic buying and selling software but also makes automatic control more intelligent.

Citation Download Citation

Yuer Yang, Yongjia Lei, Zeguang Chen, Qinmin Li, Lifeng Zhou, and Yujuan Quan "Explore the relationship between textual sentiments and pictures' emotions based on unit quantification", Proc. SPIE 12288, International Conference on Computer, Artificial Intelligence, and Control Engineering (CAICE 2022), 1228809 (2 December 2022); https://doi.org/10.1117/12.2640934

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Statistical modeling

Image classification

Neural networks

Image analysis

Machine learning

Performance modeling

Statistical analysis

Show All Keywords

Keywords/Phrases

Search In:

Publication Years