Manifold Atlas

Tier: comparative tool. Object: output embeddings across models.

github.com/vector-lab-tools/manifold-atlas · All tools

Manifold Atlas compares multiple embedding models’ output geometries on the same inputs. It is the comparative cartographic instrument of the Vector Lab: the tool that operationalises vector theory empirically, turning what a model has learned about democracy, care work, negation, or intelligence into a testable geometry rather than a metaphor.

Why Manifold Atlas

Without vector theory, a cosine similarity of 0.95 between “fair” and “not fair” is a curiosity. With it, the same number is evidence for the negation deficit, for geometric ideology, for the proprietary encoding of human language that a particular training regime has produced. Atlas lets claims of that kind be tested against the geometry directly, across multiple models on the same inputs, with outputs that are comparable and exportable.

Operations

The tool packages seventeen operations for the critical testing of vector-theoretic claims, with Calibration establishing the scale against which the others are read:

Each operation makes a theoretical claim empirically testable against the geometry a given model has learned.

Test library and standardisation

Each operation ships with a curated library of pre-built tests. These form a stable instrument against which any model can be measured, and against which models can be compared to each other. Because the tests are fixed, the same battery can be fired at different models at the same moment, at the same model across versions of its embedding API, or at the same model across dates. The result is a standardised testing regime that lets findings be reproduced across research groups and held durable across model generations.

The library

Representative items in the library:

Tests

Tests bundle operations into named sequences, runnable in one click and exportable as a single composite dataset. Eight tests ship with the current version:

Users can also author their own tests as markdown files with YAML front matter, persisted in localStorage and round-trippable through a text editor.

Testing across models and versions

Atlas runs any test against any combination of enabled embedding models. Supported providers cover OpenAI, Anthropic, Google, Hugging Face, Cohere, and local Ollama. The Distance Matrix operation, running across multiple enabled models at once, flags the pairs where models most disagree, surfacing contested geometry for critical analysis.

Export and archive

Operations export to CSV, JSON, PDF, or PNG depending on the visualisation. Exports carry enough metadata (model identifier, date, test preset, parameter values) to reconstruct the run. These exports form the raw material for a longitudinal, comparative archive, a historical resource documenting how large language models have encoded contested concepts over time. Rather than a single ephemeral run against a single version of a single model, findings can be accumulated into a durable record.

Theoretical background

Manifold Atlas operationalises Berry’s Vector Theory (Philosophy & Technology, 2026), together with the Stunlaw essays The Vector Medium and What Is the Manifold?. The tool names operations after vector-theoretic concepts (negation gauge, hegemony compass, real abstraction test) rather than statistical generics, so the connection between theory and instrument is explicit.

Verdict vocabulary. Since v1.17.0, every operation reports its finding on a single five-phrase scale, “Almost the same, Barely different, Somewhat different, Clearly different, Far apart”, read against the register’s calibrated floor and ceiling. Earlier per-operation vocabularies had drifted toward interpretive verdicts (“Fully abstracted: the manifold has completed the real abstraction”) that handed down the theoretical conclusion as though it were the measurement. The tool now reports distance; the theoretical reading belongs in the interpretation.

Stack

Next.js 16, React 19, TypeScript 5, Tailwind, Three.js. Talks to the major embedding APIs: OpenAI, Anthropic, Google, Hugging Face, Cohere, and local Ollama.

Status

The most mature instrument in the Vector Lab. Currently at v1.17.2, with seventeen operations live and a deep-dive panel on every visualisation-heavy operation. Two lines of work have dominated since v1.8:

Calibration (v1.9.0–v1.14.2). Every operation is now read against a measured scale rather than against the raw cosine axis. Calibration reports the floor per register (bare terms, short declaratives, prose), the topical ceiling, the cone half-angle, dispersion and percentiles, dimension statistics against a sample ceiling, and norm behaviour. Live calibration reporting, a model radius, a foldable scale, cache provenance and verification, and the bridge rendered as a dimension line arrived across this series. The full calibration record sits in each operation’s Deep Dive.

One verdict vocabulary (v1.15.0–v1.17.2). Every operation now reports its finding on a single five-phrase scale, “Almost the same, Barely different, Somewhat different, Clearly different, Far apart”, read against the register’s calibrated floor and ceiling. Earlier per-operation vocabularies had drifted toward interpretive verdicts that handed down the theoretical conclusion as though it were the measurement. Negation verdicts now describe distance, not recognition; Real Abstraction no longer declares that abstraction has been completed. v1.17.2 also drops the pre-print Stunlaw citation for Vector Theory in favour of the published version in Philosophy & Technology.

Other recent additions include Persistent Homology as an operation on the manifold’s topology above cosine geometry; the Grammar of Vectors expansion from two grammars to five (with the synthetic dialectic concept now named in the tool); the canonical Vector Lab branding (navy V mark, v1.8.1); and a Runner Library of seven built-in protocols spanning Demo, Critique, and Research categories. In active use for research and teaching.

Siblings

Manifoldscope is anatomical on a single manifold; Atlas is cartographic across many. The two are complementary. Vectorscope opens the model internals that Atlas compares at the output. Theoryscope applies comparable methods to corpora of theory rather than models. LLMbench handles the prose surface.