ModelRefs / Embedding — AI Glossary

Embedding — AI Glossary

A dense vector representation of text, image, or audio that captures semantic meaning in a high-dimensional space.

Overview

Embedding models (text-embedding-3, BGE-M3, Voyage, Cohere Embed) map similar content to nearby points (typically 768–3072 dimensions). They power semantic search, clustering, classification, and RAG retrieval. Embedding quality is the ceiling of RAG retrieval quality.

Reference details

Topicrag
Last reviewed2026-06-24

Example: Why cosine similarity, not keyword overlap

“How do I reset my password?” and “I forgot my login credentials” share almost no words — keyword search scores them near zero. Their embeddings sit close together, so cosine similarity is high and retrieval finds the right document. The same property is the failure mode: “cancel my subscription” and “renew my subscription” are also close, because they are about the same topic while meaning opposite things.

Commonly confused with

An embedding is not a summary and cannot be read back. It is a fixed-length vector, and nothing in it is human-inspectable. Similarity in embedding space means topical relatedness, which is not the same as relevance and definitely not the same as agreement.

When to use it

Reach for it when:

  • Users phrase the same intent in many different ways
  • You need clustering, deduplication or classification over free text
  • Recall matters more than exact term matching

Reach for something else when:

  • The query is an identifier — a SKU, error code or name — where lexical search wins outright
  • Negation or opposites must be distinguished; embeddings are weak at this
  • You need to explain to a user or auditor why a document was returned

Referenced by

This term is used by the following ModelRefs references:

Where this appears on ModelRefs

Continue your research

Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Embedding — AI Glossary.

Frequently asked questions

What is Embedding?

A dense vector representation of text, image, or audio that captures semantic meaning in a high-dimensional space.

What concepts are related to Embedding?

Closely related concepts include vector database, semantic search, rag, reranker.