RAG: Retrieval-Augmented Generation—AI systems that answer questions by first searching for relevant documents
PEFT: Parameter-Efficient Fine-Tuning—techniques like LoRA to adapt models with minimal parameter updates
LoRA: Low-Rank Adaptation—a PEFT method that injects trainable low-rank matrices into frozen model weights
RLHF: Reinforcement Learning from Human Feedback—training models to align with human preferences using rewards
dense retrieval: Finding relevant documents by comparing learned vector representations (embeddings) rather than keyword matching
sparse retrieval: Keyword-based retrieval methods like BM25 that match exact terms
query rewriting: Reformulating a query to improve clarity or intent matching (e.g., fixing ambiguity)
query expansion: Adding related terms or synonyms to a query to broaden search coverage
AGI: Artificial General Intelligence—hypothetical AI with human-like understanding across diverse tasks
CoT: Chain-of-Thought—prompting technique encouraging models to generate intermediate reasoning steps
knowledge graph: A structured representation of knowledge using entities (nodes) and relationships (edges)