Computer Science ›› 2026, Vol. 53 ›› Issue (8): 266-275.doi: 10.11896/jsjkx.260300033

• Artificial Intelligence • Previous Articles     Next Articles

From Bytes to Semantics:New Paradigm for Tibetan Named Entity Recognition

LI Qingkai1,2, QUN Nuo1,2,3, NI Shengqiao1,4, YANG Jin1,5   

  1. 1 School of Information Science and Technology, Xizang University, Lhasa 850000, China
    2 Collaborative Innovation Center for Tibet informatization by MOE and Tibet Autonomous Region, Lhasa 850000, China
    3 State Key Laboratory of Tibetan Intelligence, Xizang University, Lhasa 850000, China
    4 School of Mechanical Engineering, Sichuan University, Chengdu 610207, China
    5 School of Cyber Science and Engineering, Sichuan University, Chengdu 610207, China
  • Received:2026-03-09 Revised:2029-06-06 Online:2026-08-15 Published:2026-08-17
  • About author:LI Qingkai,born in 2000,postgraduate.His main research interests include na-tural language processing and machine learning.
    NI Shengqiao,born in 1982,associate professor,Ph.D.His main research interests include machine learning and computer science professional education.
  • Supported by:
    National Natural Science Foundation of China(62162057) and Key Project of Natural Science Foundation of Tibet Autonomous Region(XZ202401ZR0040).

Abstract: Tibetan named entity recognition faces several practical challenges,including scarce annotated data,unreliable tokenization,and degraded performance on long entities.To address these issues,this paper proposes a NER framework based on byte-level global modeling and a gated feature fusion mechanism.Specifically,the framework employs the Byte Latent Transformer to directly model raw UTF-8 byte sequences,and leverages its entropy-based dynamic patching mechanism to obtain global contextual representations without relying on a fixed vocabulary.This effectively avoids entity boundary corruption introduced by conventional tokenizers and improves robustness to out-of-vocabulary patterns.Meanwhile,a gated linear conditional fusion module is designed to inject aligned global contextual features into local boundary-preserving representations with controllable strength in an adaptive,position-wise manner,thereby forming complementary features and enhancing span modeling capability.On this basis,the model combines BiLSTM and CRF to perform sequence modeling and label decoding,jointly preserving global semantic modeling and local boundary discrimination.Experimental results on the TibetanAI_NER and TibNER datasets show that the proposed model improves the F1 score by 11.5 and 4.53 percentage points,respectively,over the corresponding state-of-the-art baselines.Ablation studies further verify the synergistic contributions of the global features and the gated fusion mechanism.Overall,the proposed framework consistently strengthens entity boundary discrimination under segmentation-constrained and low-resource scenarios,with particularly clear gains on long entity recognition,providing a feasible modeling approach for NER in low-resource languages.

Key words: Tibetan named entity recognition, Byte-level modeling, Gated feature fusion, Hybrid granularity strategy, Boundary-aware

CLC Number: 

  • TP391
[1] MAYHEW S,BLEVINS T,LIU S,et al.Universal NER:Agold-standard multilingual named entity recognition benchmark[C]//Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2024:4322-4337.
[2] GAO F,HUANG C,LIU Y,et al.Tlue:A tibetan language understanding evaluation benchmark[C]//Proceedings of the 2025 Conference on Empirical Methods in Natural Language Proces-sing.2025:35059-35085.
[3] PATTNAYAK P,PATEL H,AGARWAL A.Tokenizationmatters:Improving zero-shotner for indic languages[C]//2025 IEEE International Conference on Electro Information Technology(eIT).IEEE,2025:456-462.
[4] LI D,DU S,LI P,et al.LE-NER:A Chinese NER Model Based on Lexical Enhancement[M]//Advanced Data Mining and Applications.Singapore:Springer,2025:344-359.
[5] PAGNONI A,PASUNURU R,RODRIGUEZ P,et al.Byte latent transformer:Patches scale better than tokens[C]//Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics.2025:9238-9258.
[6] JIAYANG J,LI Y C,ZONG C Q,et al.Tibetan Person Name Recognition Based on Fusion of Maximum Entropy and Conditional Random Field Models[J].Journal of Chinese Information Processing,2014,28(1):107-112.
[7] YUE J.Part-of-speech tagging of corpus based onBiLSTM-CRF model[C]//Proceedings of the 2025 4th International Confe-rence on Distributed Computing and Electrical Circuits and Electronics(ICDCECE).IEEE,2025:1-5.
[8] ZHANG J,ZHANG Z,YESHI L,et al.Tibetan medical named entity recognition based on syllable-word-sentence embedding transformer[J].CAAI Transactions on Intelligence Technology,2025,10(4):1148-1158.
[9] HU S,GUAN J,LI W.Chinese named entity recognition basedon multi-level information extraction[C]//Proceedings of the 2022 3rd International Conference on Electronic Communication and Artificial Intelligence(IWECAI).IEEE,2022:554-557.
[10] DEVLIN J,CHANG M W,LEE K,et al.Bert:Pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2019:4171-4186.
[11] CONNEAU A,KHANDELWAL K,GOYAL N,et al.Unsupervised cross-lingual representation learning at scale[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:8440-8451.
[12] POLITOV A,SHKALIKOV O,JÄKEL R,et al.Revisiting Projection-based Data Transfer for Cross-Lingual Named Entity Recognition in Low-Resource Languages[C]//Proceedings of the Joint 25th Nordic Conference on Computational Linguistics and 11th Baltic Conference on HumanLanguage Technologies(NoDaLiDa/Baltic-HLT 2025).2025:499-507.
[13] ZHU G,XIAO R,WANG H,et al.Large margin representation learning for robust cross-lingual named entity recognition[C]//Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics.2025:4270-4291.
[14] AFRICA D D,SALHAN S,WEISS Y,et al.Meta-Pretrainingfor Zero-Shot Cross-Lingual Named Entity Recognition in Low-Resource Philippine Languages[C]//Proceedings of the 5th Workshop on Multilingual Representation Learning(MRL 2025).2025:106-127.
[15] RADCHENKO V,DRUSHCHAK N.Improving Named Entity Recognition for Low-Resource Languages Using Large Language Models:A Ukrainian Case Study[C]//Proceedings of the Fourth Ukrainian Natural Language Processing Workshop(UNLP 2025).2025:27-35.
[16] ZHANG Z,LEE S Y M,ZHANG D,et al.Zero-shot Cross-lingual NER via Mitigating Language Difference:An Entity-aligned Translation Perspective[C]//Findings of the Association for Computational Linguistics:EMNLP 2025.2025:4541-4557.
[17] CLARK J H,GARRETTE D,TURC I,et al.Canine:Pre-training an efficient tokenization-free encoder for language representation[J].Transactions of the Association for Computational Linguistics,2022,10:73-91.
[18] XUE L,BARUA A,CONSTANT N,et al.ByT5:Towards a token-free future with pre-trained byte-to-byte models[J].Trans-actions of the Association for Computational Linguistics,2022,10:291-306.
[19] LI S,XU J,ZHANG M.EMBYTE:Decomposition and Com-pression Learning for Small yet Private NLP[C]//Findings of the Association for Computational Linguistics:EMNLP 2025.2025:7182-7201.
[20] ERONEN J,PTASZYNSKI M,MASUI F.Zero-shot cross-lingual transfer language selection using linguistic similarity[J].Information Processing & Management,2023,60(3):103250.
[21] WANG P,CHEN Y,LIU C,et al.An attention-enhanced LSTM model for Chinese educational named entity recognition[C]//Proceedings of the 2024 5th International Conference on Information Science and Education(ICISE-IE).IEEE,2024:272-277.
[22] RATCHATORN T,TANAKA M.Adaptive Adversarial Cross-Entropy Loss for Sharpness-Aware Minimization[C]//2024 IEEE International Conference on Image Processing(ICIP).IEEE,2024:479-485.
[23] LIU J,SUN M,ZHANG W,et al.DAE-NER:dual-channel attention enhancement for Chinese named entity recognition[J].Computer Speech & Language,2024,85:101581.
[24] VARSHNEY N,CHATTERJEE A,PARMAR M,et al.Investigating acceleration ofLLaMA inference by enabling interme-diate layer decoding via instruction tuning with ‘LITE’[C]//Findings of the Association for Computational Linguistics:NAACL 2024.2024:3656-3677.
[25] LI J,FANG A,SMYRNIS G,et al.Datacomp-lm:In search ofthe next generation of training sets for language models[J].Advances in Neural Information Processing Systems,2024,37:14200-14282.
[26] YU T,ZHANG Y,YONG C.Tibetan named entity recognition based on few-shot learning[J].Computer and Modernization,2023,39(5):13-19.
[27] ZHOUM K,OUJIAN C R,DAOJI C D,et al.TibNER:a Tibetan named entity recognition dataset[J].China Scientific Data(Chinese & English Online Edition),2024,9(4):17-27.
[28] LAMAOJIE,WANMAC D,YONGCUO,et al.Tibetan medical named entity recognition via adversarial training and iterative dilated convolution[J].Plateau Science Research,2025,9(1):105-118.
[1] SHEN Fengyin, FAN Hongjie. Research on Design of Multi-level SQL Optimization Framework Based on Big Data Business Workflows [J]. Computer Science, 2026, 53(8): 1-8.
[2] LAI Yingxu, ZHANG Yuwei, ZHUANG Junxi. Construction and Generation of SOR Label System for Learner Personalized Portrait [J]. Computer Science, 2026, 53(8): 9-19.
[3] LIU Yanze, HAN Bo, YUAN Jidong, SU Dongliang, REN Jia, CAI Zhiming, WANG Zhihai. Anomaly Detection in Time Series Based on Time-Frequency Contrastive Learning [J]. Computer Science, 2026, 53(8): 20-28.
[4] GUO Peilin, ZOU Zhiyi, WANG Bo, LUO Jiawei. STMVF:Novel Multi-view Graph Convolutional Network for Spatial Transcriptomics Cell Deconvolution with Dual Cross-attention Mechanism [J]. Computer Science, 2026, 53(8): 40-49.
[5] PAN Yuquan, YUAN Deyu, WANG Anran, JIA Yuan. Enhanced GNNs Across Social Networks User Identity Linkage Algorithm Based on HiddenFeatures [J]. Computer Science, 2026, 53(8): 50-60.
[6] LIAO Xuechao, ZOU Hang, LYU Peidong, ZENG Zhiqiang. Lithium-ion Battery Capacity Data Augmentation and Prediction Based on Diffusion,Denoise and Coding-Decoding Attention [J]. Computer Science, 2026, 53(8): 103-116.
[7] DENG Jiayan, TIAN Shirui, LIU Hou, ZHU Ningbo, DUAN Mingxing. Zero-shot Pedestrian Trajectory Prediction Method Based on Compositional Motion [J]. Computer Science, 2026, 53(8): 117-126.
[8] GUO Chenhui, CHEN Zebin, TAN Guang. Sparse-view Gaussian Splatting Consistent Reconstruction with Mask-guided Generative Prior [J]. Computer Science, 2026, 53(8): 127-138.
[9] ZHANG Zhe, LIU Junjie, ZHANG Baili. Improved DETR-based Method for CAD Graphic Element Recognition [J]. Computer Science, 2026, 53(8): 139-147.
[10] CAI Yi, WANG Xiaobin, CHEN Ruili, XU Jinfeng. Handwriting Gender Recognition Method Based on Multi-scale Directional Attention Transformer [J]. Computer Science, 2026, 53(8): 156-164.
[11] WANG Jiahui, WANG Hongyu, HAO Yingguang. Feature Aggregation with Joint Tracking:Video Object Detection in Occlusion Scenarios [J]. Computer Science, 2026, 53(8): 165-173.
[12] HU Changyu, FAN Xinyu, ZHANG Zhi, DING Zixu, ZHANG Zhengyue, PENG Juhong. Hierarchical Lightweight Micro-expression Recognition Based on Optical Flow Partitioned FeatureFusion [J]. Computer Science, 2026, 53(8): 174-181.
[13] LING Yun, LI Haodong. Localization of Diffusion-based Image Editing via Inversion-Reconstruction [J]. Computer Science, 2026, 53(8): 182-190.
[14] WANG Yifan, YANG Peixuan, LU Yuansuo, LIU Mengjun. Teacher Trajectory Recognition and Reconstruction in Smart Classrooms via Multi-source Fusion [J]. Computer Science, 2026, 53(8): 191-200.
[15] WANG Jingyang, XUE Weimin, HUANG Min, WU Shaoguang. Improved YOLOv11n Model for Small Target Detection in UAV Aerial Images [J]. Computer Science, 2026, 53(8): 201-208.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!