Large Language Model
Definition
A deep learning language model trained on large-scale corpora, capable of text understanding, generation, and reasoning, with parameter scales typically ranging from billions to hundreds of billions.
Usage Example
GPT-4 is a large language model developed by OpenAI that performs well across multiple benchmarks.
Related Terms
Contribution Details
Related terminology
Fine-tune
A technique that fine-tunes a pre-trained model using domain-specific data to adapt it for downstream tasks.
GPT
GPT (Generative Pre-trained Transformer) is a series of generative pre-trained language models developed by OpenAI. Trained via unsupervised learning on large-scale text corpora, GPT can generate coherent, high-quality text for applications such as conversation, writing, and coding.
Transformer
The Transformer is a deep learning architecture based on self-attention, introduced by Google in 2017. It revolutionized natural language processing and serves as the foundation for large models like GPT and BERT. Its core advantage lies in its ability to process sequence data in parallel and capture long-range dependencies.