Research on Chinese named entity recognition based on multi-feature fusion using transformer

Tianyi Liu; Runjie Liu

doi:10.1117/12.3051301

18 November 2024 Research on Chinese named entity recognition based on multi-feature fusion using transformer

Tianyi Liu, Runjie Liu

Author Affiliations +

Proceedings Volume 13403, International Conference on Algorithms, High Performance Computing, and Artificial Intelligence (AHPCAI 2024) ; 134031A (2024) https://doi.org/10.1117/12.3051301
Event: International Conference on Algorithms, High Performance Computing, and Artificial Intelligence, 2024, Zhengzhou, China

Abstract

Named Entity Recognition (NER) is a critical task in Natural Language Processing (NLP). Compared to English NER, Chinese NER faces several issues due to differences in grammar between Chinese and English, which affect the performance of Chinese NER models. The current mainstream solution is to innovate lexical information into character-level models to achieve lexical enhancement. However, this process can introduce incorrect or irrelevant lexical information, leading to conflicts between words and affecting entity boundary segmentation and category annotation. To address this issue, this paper proposes a multi-feature fusion model based on Transformer. Building on the original model, which uses character vectors and word vectors as feature inputs, we add a new type of feature input: vectors obtained by re-weighting different words through adjusting lexical weights. This approach reduces the impact of incorrect lexical information, thereby enhancing model performance. Experiments on multiple datasets demonstrate the effectiveness of this method.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Tianyi Liu and Runjie Liu "Research on Chinese named entity recognition based on multi-feature fusion using transformer", Proc. SPIE 13403, International Conference on Algorithms, High Performance Computing, and Artificial Intelligence (AHPCAI 2024) , 134031A (18 November 2024); https://doi.org/10.1117/12.3051301

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE