BERTje for Dutch
Learn about BERTje and how to use it for the next sentence prediction task.
We'll cover the following...
BERTje is the pre-trained monolingual BERT model for the Dutch language from the University of Groningen. The BERTje model is pre-trained using MLM and sentence order prediction (SOP) tasks with whole word masking (WWM).
The BERTje model is trained using several Dutch corpora, including TwNC (a Dutch news corpus), ...
Ask