Principle research of word vector representation in natural language processing

Shijia Kang; Linggang Kong; Bin Luo; Cuifang Zheng; Jiaju Wu

doi:10.1117/12.2668487

20 April 2023 Principle research of word vector representation in natural language processing

Shijia Kang, Linggang Kong, Bin Luo, Cuifang Zheng, Jiaju Wu

Proceedings Volume 12602, International Conference on Electronic Information Engineering and Computer Science (EIECS 2022); 1260209 (2023) https://doi.org/10.1117/12.2668487
Event: International Conference on Electronic Information Engineering and Computer Science (EIECS 2022), 2022, Changchun, China

Abstract

Natural language processing is a research direction in many fields such as linguistics, computer science, and data fusion of study. The representation of word vector is a method to map words into the real vector space, which is the core technology of many current natural language processing tasks. This paper summarizes and studies some typical expression methods of word vector as well as research the word vectors of linguistics and mathematical principle. We first elaborate the process of mapping the words to the vector, namely, encoding natural language information to word vector according to semantics. Secondly, we analyze several typical methods such as co-occurrence matrix, Word2Vec, GloVe, ELMo on information carrying capacity. Thirdly, on the basis of analyzing the principles of these methods, this paper also uses SVD decomposition, neural network, and other methods respectively to reproduce the specific process of generating word vectors. Finally, combining word similarity calculation and text sentiment classification task, we compare the performance of word vectors trained by various methods in different tasks. Experiments verify the conclusion that different word vector generation methods have different emphases in carrying linguistic ability and perform differently in different tasks.

Citation Download Citation

Shijia Kang, Linggang Kong, Bin Luo, Cuifang Zheng, and Jiaju Wu "Principle research of word vector representation in natural language processing", Proc. SPIE 12602, International Conference on Electronic Information Engineering and Computer Science (EIECS 2022), 1260209 (20 April 2023); https://doi.org/10.1117/12.2668487

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available