loading page

Lexicon-enhanced Pre-trained Language Models for Chinese Ethics-related Tasks
  • +2
  • Tianlong Gu ,
  • Tong Bao ,
  • Long Li ,
  • Liang Chang ,
  • Xuan Feng
Tianlong Gu
Author Profile
Liang Chang
Author Profile
Xuan Feng
Author Profile


The proposal and rapid development of pre-trained language models have led to unprecedented breakthroughs in natural language processing techniques. Although pre-trained language models have strong text-understanding capabilities, their performance in handling ethical issues is unsatisfactory due to the complexity of ethical connotations. To improve the ethical understanding and generation capabilities of pre-trained language models, a novel knowledge enhancement solution based on the ethics lexicon is proposed.