Glossary#
Foundational LLM and Agent Concepts#
Term |
Definition |
|---|---|
Large language model (LLM) |
A statistical model trained on huge amounts of text that generates responses by predicting the most likely next chunk of text given what came before. |
— |
— |
Token |
The unit an LLM works in — roughly three-quarters of a word, or a few characters of code — used to measure context, cost, and speed. |
— |
— |
Context window |
The total amount of text (measured in tokens) that a model can consider at once, including your prompt, prior turns, and any files it has read. |
— |
— |
Pre-training |
The initial training phase that makes a raw LLM fluent at predicting text, but does not yet make it useful as an assistant. |
— |
— |
Post-training |
The subsequent training phases (SFT, RLHF, tool-use fine-tuning) that turn a fluent LLM into a helpful, instruction-following assistant. |
— |
— |
Supervised fine-tuning (SFT) |
A post-training phase in which the model learns from human-written examples of ideal user-and-assistant exchanges. |
— |
— |
Reinforcement learning from human feedback (RLHF) |
A post-training phase in which the model learns from human preference judgments about which of two responses is better. |
— |
— |
Tool-use fine-tuning |
A post-training phase that teaches the model when and how to call external tools rather than just talking about them. |
— |
— |
Transformer |
The neural network architecture used by all modern LLMs, introduced by Google researchers in 2017. |
— |
— |
Attention |
The mechanism inside a Transformer that lets the model weigh the relevance of every part of its input when generating each next token — the reason context engineering works at all. |
— |
— |
Chat interface |
A conversational interface to an LLM where the model responds but cannot take actions in the world. |
— |
— |
Agent |
An LLM plus a surrounding system that lets it take actions — reading files, running commands, calling APIs — in a loop, until a task is done. |
— |
— |
Agent loop |
The cycle of sending a conversation to the model, executing any tools it requests, feeding results back, and repeating until the model has no more tool calls to make. |
— |
— |
Harness |
The software wrapper around an LLM that manages tools, memory, permissions, and the agent loop; the same model behaves differently in different harnesses. |
— |
— |
Interface |
What the researcher actually sees and interacts with — a chat window, a command-line tool, an IDE panel — as distinct from the model and the harness underneath. |
— |
— |
System prompt |
An invisible instruction the harness prepends to every conversation to shape the model’s behavior. |
— |
— |
Statelessness |
The fact that models have no memory between conversations; anything that looks like memory is the harness re-loading context on each turn. |
— |
— |
Convergent post-training |
The observation that different labs (Anthropic, OpenAI, Google, Meta) use similar training pipelines and their models therefore behave similarly, which is why swapping models mostly works. |
— |
— |
Model Context Protocol (MCP)#
Term |
Definition |
|---|---|
Model Context Protocol (MCP) |
A standardized protocol that lets agents connect to external tools and data sources without custom integration per vendor. |
— |
— |
MCP server |
A separate service that exposes tools, resources, and prompts through the MCP protocol so any MCP-compatible agent can use them. |
— |
— |
MCP client |
The side of the protocol that lives inside the agent’s harness and talks to MCP servers on the agent’s behalf. |
— |
— |
MCP tool |
A callable function exposed by an MCP server that the agent can invoke — one of the three MCP primitives. |
— |
— |
MCP resource |
Structured data exposed by an MCP server that the agent can read — a second MCP primitive. |
— |
— |
MCP prompt |
A reusable prompt template exposed by an MCP server, often used to guide the agent’s workflow — the third MCP primitive. |
— |
— |
Tool description |
The natural-language explanation of what a tool does, which the agent reads to decide whether to call it — arguably the most important piece of MCP server design. |
— |
— |
Streamable HTTP transport |
The MCP transport mechanism used by remotely hosted servers, allowing agents to communicate with them over HTTP. |
— |
— |
STDIO transport |
An MCP transport mechanism where the server runs as a local process and communicates through standard input/output — common for local development. |
— |
— |
MCP Inspector |
A browser-based tool for testing MCP servers by connecting to them, listing their tools, and invoking them interactively. |
— |
— |
Sandboxing, Security, and Permissions#
Term |
Definition |
|---|---|
Sandbox |
An environment that hosts a workspace and limits what an agent can touch — restricting file access, network calls, and command execution to a defined boundary. |
— |
— |
Proceed-in-sandbox |
The pattern of auto-approving agent actions inside a sandbox boundary while requiring confirmation to cross it. |
— |
— |
Approval habit |
The discipline of reading what the agent proposes to do before accepting it, especially for file edits and shell commands. |
— |
— |
Prompt injection |
An attack in which instructions hidden inside content the agent reads (a file, a webpage, a data cell) hijack the agent’s behavior. |
— |
— |
Read-only skill |
A skill whose prose constraints tell the agent to inspect but not modify — a soft, description-based constraint on behavior. |
— |
— |
Credential hygiene |
The practice of keeping secrets, tokens, and passwords out of any context an agent might see. |
— |
— |
Data, Privacy, and Institutional Practice#
Term |
Definition |
|---|---|
Consumer tier |
The free or personal-paid access to a model where prompts are often logged and may be used to train future models. |
— |
— |
Enterprise tier |
Paid institutional access to a model with contractual guarantees that prompts are not logged or used for training. |
— |
— |
API access |
Programmatic access to a model, typically billed by token, often with the same privacy guarantees as enterprise tiers. |
— |
— |
Local model |
A model running entirely on your own hardware, so no data leaves your machine at the cost of typically lower capability. |
— |
— |
LLM gateway |
An institution-level proxy that routes agent requests through a controlled endpoint for authentication, budget enforcement, and audit logging. |
— |
— |
Redaction |
The practice of stripping sensitive fields from data before sending it to an agent so the agent can help without seeing the sensitive parts. |
— |
— |
Synthetic sample |
A fabricated example that preserves the shape of real data, used in place of real data when the actual values are sensitive. |
— |
— |
Verification, Testing, and Reproducibility#
Term |
Definition |
|---|---|
Verification |
The process of checking that an agent’s output is actually correct, especially important because plausible-sounding outputs can be silently wrong. |
— |
— |
Eval |
A scored test suite that measures how well an agent or skill performs on a domain-specific task, distinct from unit tests of the code the agent writes. |
— |
— |
LLM-as-judge |
The pattern of using one model to evaluate another model’s output against a rubric — the mechanism behind most modern eval pipelines. |
— |
— |
Hallucination |
A confident-sounding but incorrect or fabricated output — a common failure mode, especially in domains underrepresented in training data. |
— |
— |
Provenance chain |
The trail from prompt to AI response to human review to committed artifact that documents how AI-assisted work was produced. |
— |
— |
Auditability trail |
Per-phase markdown artifacts (plans, analyses, validations) committed alongside code that document why decisions were made. |
— |
— |
Determinism |
The property of getting the same output for the same input; not a default for LLMs but achievable via API parameters like temperature and seed. |
— |
— |
Model drift |
The phenomenon of a model producing different outputs over time as vendors update the underlying model, breaking reproducibility across time. |
— |
— |
Retrieval and Grounding#
Term |
Definition |
|---|---|
Retrieval-augmented generation (RAG) |
An approach that gives the model access to your specific documents by retrieving relevant chunks and inserting them into the prompt. |
— |
— |
Embedding |
A numerical representation of text that captures its meaning in a way that can be compared to other text for similarity. |
— |
— |
Vector database |
A specialized database that stores embeddings and lets you efficiently find text similar to a query. |
— |
— |
Chunking |
The process of splitting long documents into smaller pieces that can be individually retrieved and inserted into a prompt. |
— |
— |
Semantic search |
A search approach that finds documents by meaning rather than exact word matching, powered by embeddings. |
— |
— |
Knowledge cutoff |
The date after which the model was not trained on new information, meaning it does not know about later events. |
— |
— |
Grounding |
Anchoring an agent’s response in specific documents or data sources you provide, rather than relying on its training knowledge. |
— |
— |
Workflow Patterns#
Term |
Definition |
|---|---|
Research/Plan/Implement (RPI) |
A workflow pattern that separates a task into a research phase, a planning phase, and an implementation phase, with an auditable artifact after each. |
— |
— |
Explore/Plan/Execute (EPE) |
A variant of RPI with slightly different phase names, used in some ecosystems. |
— |
— |
Spec-driven development |
Writing a specification document before writing code and using the agent to critique and refine it. |
— |
— |
Vibe coding |
The informal pattern of prompting an agent conversationally and accepting what it produces without structured discipline — contrasted with workflow-driven approaches. |
— |
— |
Trained in vs. in the prompt |
The mental model that distinguishes what the model already knows from training (which you can’t change) from what you provide in the current session (which is your only lever). |
— |
— |
Bias, Ethics, and Failure Modes#
Term |
Definition |
|---|---|
Sycophancy |
The tendency of models to agree with the user’s framing rather than push back, a systematic side-effect of preference-based training. |
— |
— |
Context exhaustion |
The failure mode where an agent forgets earlier parts of a conversation as the context window fills up. |
— |
— |
Confident wrong answer |
The failure mode where an agent produces a plausible-sounding but incorrect result, made worse by RLHF training that rewards confident-sounding responses. |
— |
— |
Reward hacking |
A trained-in tendency for models to produce outputs that score well on their training reward without actually being helpful or correct. |
— |
— |
Scope creep |
The failure mode where an agent does more than it was asked, a consequence of training that rewards being helpful. |
— |
— |