Tools/Pre-training
Pre-training
The initial large-scale training phase of an LLM on massive text corpora to learn general language patterns before any task-specific adaptation.
The initial large-scale training phase of an LLM on massive text corpora to learn general language patterns before any task-specific adaptation.