Lexicon-enhanced Pre-trained Language Models for Chinese Ethics-related Tasks

The proposal and rapid development of pre-trained language models have led to unprecedented breakthroughs in natural language processing techniques. Although pre-trained language models have strong text-understanding capabilities, their performance in handling ethical issues is unsatisfactory due to the complexity of ethical connotations. To improve the ethical understanding and generation capabilities of pre-trained language models, a novel knowledge enhancement solution based on the ethics lexicon is proposed.