Inhibition Adaption on Pre-Trained Language Models

Information Science, Artificial Intelligence, Humanities and Others,
Pre-trained Language Models   Inhibition Adaption   Low Rank   Activation Functions   Text Classification   Question Answering Tasks  

InA: Inhibition Adaptation Method on Pre-trained Language Models Pre-trained Language Models (LMs) have achieved significant results in Natural Language Processing (NLP) tasks. However, traditional fine-tuning methods suffer from the problem of redundant parameters, which affects efficiency and effectiveness. To address this challenge, this paper p...