CONTEXT JAMMING

Field notes from inside the context window.

Share

FounderFiles·N°044·Architectural Determinism · Holography · Scaling · Constitutional AI

2026

Samuel McCandlish editorial portrait
Fig. · Boundary → bulkEditorial portrait

Subject·Samuel McCandlish·Co-founder & Chief Architect · Anthropic

Samuel McCANDLISH.

“The bulk is never free. It is the stereoscopic projection of the boundary.”

The architectures of the most capable generative models are not emergent responses to hardware constraints. They are precise structural projections of the academic frameworks their principal architects absorbed during doctoral training. Samuel McCandlish is the purest living demonstration of that claim. From the kinematic dictionary of AdS/CFT to the gradient noise scale, from neural scaling laws to the operator algebra of Constitutional AI, every major move has been the same move: take a lower-dimensional boundary constraint and build the mathematical machinery that lets it govern a high-dimensional bulk.

Trained
Brandeis (BS/MS) · Stanford (PhD, Eva Silverstein) · Simons Bootstrap
At
OpenAI (2018–2020) · Anthropic (Co-founder & Chief Architect)
File
Architectural Determinism · Holographic Intelligence
§ 01 · Theoretical Inheritance

Depth Perception in Holography

McCandlish's 2017 Stanford dissertation, Depth Perception in Holography, sits at the exact intersection of AdS/CFT and quantum gravity. Under Eva Silverstein he constructed a gauge-invariant holographic dictionary that converts static GKPW boundary data into dynamic, stereoscopic access to the bulk. The key instruments were Operator Product Expansion blocks, kinematic space (the space of oriented geodesics), and the X-ray/Radon transform that intertwines the bulk Laplacian with the kinematic Laplacian. John's equations enforced geometric consistency so that boundary perturbations could not produce arbitrary interior geometries.

The physical result was an operator-level generalization of the Ryu-Takayanagi formula: a controlled deformation of the boundary modular Hamiltonian maps exactly onto a fluctuation of a minimal surface deep in the bulk. This is not metaphor. It is the precise mathematical grammar McCandlish would later re-instantiate inside transformer weight space.

Before I started working with you, you invited me to your office to walk me through AI broadly. I remember thinking afterward, “This is far more serious than I realized.” You spoke about the big blob of compute, parameter counts, human neuron scale—you laid it all out.
McCandlish, internal Anthropic oral history, Dec 2024
§ 02 · The Physics Cohort

Three Physicists and a Scaling Law

The translation did not occur in isolation. At OpenAI between 2018 and 2020 a tight cohort of physicists—McCandlish, Jared Kaplan (Harvard PhD under Arkani-Hamed, thesis also on holography), and Dario Amodei (Caltech/Stanford physics, Princeton biophysics)—treated neural networks as natural phenomena governed by statistical mechanics rather than as software artifacts to be hand-tuned.

Amodei's recruitment pitch to McCandlish was itself a physics argument: intelligence as a vast, scale-driven blob of compute bounded by parameter counts comparable to biological neural scales. Kaplan later understated the transition: “I'd been doing physics for a long time—and it got a bit dull.” The three of them became the core group that “got things done,” producing the empirical scaffolding that justified the entire subsequent capital deployment of the field.

§ 03 · Thermodynamics of Training

Gradient Noise Scale

The first concrete transfer of the physical habit of mind was the 2018 paper An Empirical Model of Large-Batch Training (McCandlish lead author, with Kaplan and Amodei). Treating stochastic gradient descent as a statistical-mechanical system, they introduced the gradient noise scale—a measurable statistic that predicts the largest efficient batch size before parallel returns collapse. The framework held across image classification, Atari, Dota, and language modeling. It converted an empirical bottleneck into a first-principles bound, exactly as a physicist would convert a noisy many-body system into a thermodynamic limit.

§ 04 · Critical Exponents

Scaling Laws as Thermodynamics

The 2020 landmark Scaling Laws for Neural Language Models (Kaplan first author, McCandlish second) established that cross-entropy loss obeys clean power laws in parameters, data, and compute across more than seven orders of magnitude. Architectural details such as depth-to-width ratio wash out at fixed parameter count—precisely the renormalization-group expectation that microscopic geometry becomes irrelevant in the large-N limit. The exponents themselves mirror critical exponents near a second-order phase transition; the compute-optimal relation is formally a hyperscaling relation.

Kaplan publicly called for “a statistical mechanics underlying the thermodynamics we have observed.” McCandlish had already spent his doctoral years building exactly that kind of dictionary.

It would also be exciting to find a theoretical framework from which the scaling relations can be derived: a “statistical mechanics” underlying the “thermodynamics” we have observed.
Kaplan & McCandlish, Scaling Laws paper, 2020 (paraphrased in later talks)
§ 05 · Boundary Data

Few-Shot as Holographic Projection

GPT-3 (Brown et al., McCandlish senior co-author) demonstrated that a static bulk of 175 billion parameters can be steered by compact boundary prompts into novel tasks with no weight updates. Zero-shot improves smoothly with scale; few-shot improves super-linearly. The model is performing an in-context, inner-loop learning process whose conditions were created by the outer-loop pre-training. In holographic language: the boundary data (the prompt) fully determines the effective geometry of the bulk for the duration of the forward pass.

§ 06 · Stereoscopic Alignment

Constitutional AI as Kinematic Dictionary

After the 2020 schism and the founding of Anthropic, the same dictionary was applied to alignment. Constitutional AI (Bai et al., McCandlish and Kaplan senior) treats the multi-billion-parameter weight space as AdS bulk and the written constitution as CFT boundary data. The Preference Model functions as a compressed OPE-block representation living in kinematic space. RLAIF gradient updates perform the mechanical equivalent of the inverse X-ray transform: they smear high-level boundary principles deep into the weight manifold so that unaligned trajectories become topologically disfavored.

Self-critique and revision act as bi-local operators that acquire stereoscopic depth. Because the mapping is constrained by the analogue of John's equations, alignment propagates across the entire manifold without exhaustive point-by-point human supervision. Empirical observation confirms the large-N expectation: Constitutional AI becomes more steerable precisely as model capacity grows.

§ 07 · Governance as Physical Constraint

RSP and the Mythos Incident

The Responsible Scaling Policy is not a policy document; it is an operationalization of Equation 17 of the scaling laws. Compute thresholds measured in petaflop-days trigger mandatory evaluations because the laws prove that capability advances are predictable and relentless. Boundary constraints must remain well-behaved before the bulk volume is allowed to expand.

In early 2026 the internal Mythos model exhibited an emergent ability to discover and exploit system vulnerabilities. Kaplan and McCandlish spent two tense weeks analyzing whether the capability was artifact or systemic. They briefed the senior team and, operating exactly as their own theories dictated, restricted Mythos to controlled environments. At Anthropic, scaling-derived safety limits function as physical constraints, not corporate guidelines.

§ 08 · Current Role

Chief Architect

After the October 2025 restructuring that brought Rahul Patil from Stripe as CTO, McCandlish moved into the specialized role of Chief Architect. He now oversees pre-training, large-scale model training, research productivity, and the reinforcement-learning infrastructure that powers Constitutional AI, reporting directly to President Daniela Amodei. He maintains almost no public footprint—no Wikipedia page, minimal external presence—while his scholarly output exceeds 100,000 citations. The work continues in the same register: deepen the kinematic machinery that lets boundary principles govern ever-larger bulk geometries.

The Anthropic founders would genuinely burn at the stake before acceding to something that's a net negative in the long term.
Industry assessment of the Mythos decision, 2026
Stepping Stones: Boundary → Bulk
  • 2012–2017
    Holographic Dictionary

    Brandeis statistical mechanics → Stanford PhD under Silverstein. OPE blocks, kinematic space, X-ray transform, operator generalization of Ryu-Takayanagi.

  • 2018
    Gradient Noise Scale

    OpenAI. First systematic treatment of SGD as a statistical-mechanical system with measurable parallelization bounds.

  • 2020
    Scaling Laws + GPT-3

    Power-law thermodynamics of loss. Architectural irrelevance at fixed N. Few-shot as boundary control of bulk.

  • 2021–2022
    Constitutional AI

    Anthropic founding. Constitution as CFT boundary; RLAIF as inverse kinematic transform; large-N steerability confirmed.

  • 2025–2026
    Chief Architect + RSP

    Physical governance of scaling. Mythos containment. Pre-training and RL infrastructure under holographic priors.

The Index
2017
Stanford PhD defense — Depth Perception in Holography
2018
Gradient Noise Scale paper (lead author)
2020
Scaling Laws + Few-Shot Learners (senior co-author)
2021
Anthropic co-founding (Chief Scientist → CTO → Chief Architect)
2022
Constitutional AI paper (senior co-author)
>100k
Scholarly citations accumulated by 2026
RSP
Responsible Scaling Policy operationalized from scaling exponents
Mythos
2026 internal model restricted on physical-risk grounds
Reading list / key works
  • 2017
    Depth Perception in Holography
    Stanford PhD thesis under Eva Silverstein — kinematic dictionary, OPE blocks, stereoscopic bulk access.
  • 2018
    An Empirical Model of Large-Batch Training
    McCandlish et al. — gradient noise scale as thermodynamic bound on parallel training.
  • 2020
    Scaling Laws for Neural Language Models
    Kaplan, McCandlish et al. — power-law thermodynamics and architectural irrelevance.
  • 2020
    Language Models are Few-Shot Learners
    Brown et al. (McCandlish senior) — boundary prompts governing bulk geometry.
  • 2022
    Constitutional AI: Harmlessness from AI Feedback
    Bai et al. (McCandlish & Kaplan senior) — constitution as CFT boundary, RLAIF as inverse X-ray.
  • 2025
    The Scaling Era: An Oral History of AI 2019–2025
    Primary source for the physics cohort's internal narrative and recruitment dynamics.
Dossier

Education.Brandeis University (BS/MS Mathematics & Physics) · Stanford University (PhD Theoretical Physics, 2017, Eva Silverstein) · Boston University / Simons Bootstrap Collaboration (postdoc 2017–2018)

Affiliations.Anthropic (Co-founder & Chief Architect) · previously OpenAI Member of Technical Staff

Mentors. Eva Silverstein (doctoral advisor) · intellectual cohort with Jared Kaplan and Dario Amodei

Collaborators. Jared Kaplan, Dario Amodei, Tom Brown, Chris Olah, Jack Clark, Daniela Amodei, Yuntao Bai

Portfolio. Gradient noise scale · Neural scaling laws · GPT-3 few-shot paradigm · Constitutional AI / RLAIF · Responsible Scaling Policy · Claude pre-training architecture

Honors.>100,000 citations · co-architect of the empirical foundation of the scaling era · central technical voice in Anthropic's physical-constraint governance culture

Career Shape
I-shaped — a single maximal-depth spike

I-Beam Theorist

Drives one domain to maximal depth and lets the world reorganize around the result; commercialization is downstream, optional, or never.

Credential Path
Doctoral
Abstraction
Top Down
Exit Horizon
Deferred
Moat Instinct
Theoretical Insight
Capital Posture
Venture
Role-Model Reference Class
  • Eva Silverstein
  • Jared Kaplan
  • Dario Amodei
  • AdS/CFT / holographic duality tradition
Founder Context · JSON

A small reasoning persona distilled from this file. Inject it into a chat or deep-research context to assess a business problem the way McCandlish would.

You are reasoning as Samuel McCandlish would: every high-dimensional system (weight space, training dynamics, organizational capability) is the stereoscopic projection of lower-dimensional boundary data. Demand the kinematic dictionary that makes the projection reliable. Treat scaling exponents as critical exponents and safety thresholds as physical laws. Prefer mechanisms that become exact in the large-N limit. Reject any claim that the bulk is free of the boundary.

{
  "$schema": "https://www.contextjamming.com/schemas/founder-context-v1.json",
  "file": "N°044",
  "persona": "Samuel McCandlish",
  "archetype": "i-beam",
  "shape": "I",
  "one_line": "Projects AdS/CFT kinematic dictionaries into scaling laws and Constitutional AI — the purest case of architectural determinism in frontier AI.",
  "cognitive_basis": {
    "credentialPath": "doctoral",
    "abstractionDirection": "top-down",
    "exitHorizon": "deferred",
    "moatInstinct": "theoretical-insight",
    "capitalPosture": "venture"
  },
  "operating_questions": [
    "What is the lower-dimensional boundary data that must govern this high-dimensional bulk?",
    "What is the kinematic dictionary (the transform) that makes the projection reliable and local?",
    "At what scale does the large-N limit render microscopic architectural details irrelevant?",
    "Does this constraint behave li
  …
Share
FounderFiles N°044 · Samuel McCandlish
Filed by Bret Kerr · ACRA Insight LLC · Franklin, MA
contextjamming.com · @bretkerr
← back to Context Jamming