Pre-trained Language Models Lecture 4 01 PLM Families & Transfer Learning 02 BERT 03 NSP · SOP · XLNet 04 ELECTRA 05 RoBERTa 06 Modern Encoders 07 GPT-1 08 GPT-2 09 T5 10 BART 11 Korean PLMs 12 Architecture & Objective 13 Exam Preparation 14 Encoder-Decoder Today 15 Cross-Lingual Transfer 16 Encoder Fine-Tuning 17 Hugging Face Hub 18 GPT-3 19 Open-Weight Models 20 From PLM to LLM