BERT for Legal Document Classification: A Study on Adaptation and Pretraining

1. Introduction

The field of natural language processing (NLP) has seen remarkable progress in recent years, particularly in the area of deep learning. This progress has contributed to the effective performance of NLP tasks on legal text documents, including violation prediction, overruling prediction, legal judgment prediction, legal information extraction, and court opinion generation. One of the most promising models in NLP is Bidirectional Encoder Representations from Transformers (BERT), wh...