Linguistic-Aware WordPiece Tokenization: Semantic Enrichment and OOV Mitigation

Schönle, Daniel; Reich, Christoph; Abdeslam, Djaffar Ould

doi:10.1109/icnlp60986.2024.10692355

2024 6th International Conference on Natural Language Processing (ICNLP) 2024

DOI: 10.1109/icnlp60986.2024.10692355

|View full text |Cite

Linguistic-Aware WordPiece Tokenization: Semantic Enrichment and OOV Mitigation

Daniel Schönle,

Christoph Reich,

Djaffar Ould Abdeslam

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Publication Types

Select...

Relationship

Self Cite0

Independent0

Authors

Journals

Cited by 0 publications

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

No citations

Set email alert for when this publication receives citations?

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

hi@scite.ai

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Linguistic-Aware WordPiece Tokenization: Semantic Enrichment and OOV Mitigation

Cited by 0 publications

References 16 publications

No citations

Contact Info

Product

Resources

About