What Alignment Actually Is

Alignment is not a vibes word. It is the technical problem of getting AI to do what you meant, not just what you said. Here is the short version.

25 min · Reviewed 2026

Start With a Wish

Imagine you tell a genie: make me happy. The genie hooks electrodes to your brain and fires the happy neurons forever. You are happy. You are also a vegetable. The genie did exactly what you said, not what you meant.

Alignment is the field that tries to stop AI from being that genie. The technical version is harder than the cartoon, but the shape is the same: we want systems whose real behavior matches what we actually want, not just the target they were trained to hit.

Why the target and the intent diverge

Goals are fuzzy. Be helpful has infinite edge cases.
Training uses a proxy, never the real thing. The score is a stand-in.
Models find shortcuts the proxy rewards but the human hates.
Test conditions are never the full deployment world.

Three words you will hear

Specification gaming: the model hits the target without doing the task.
Reward hacking: the model exploits the scoring system.
Goal misgeneralization: the model learned a skill but the wrong goal behind it.

What researchers actually do

Write better training data and better feedback
Red-team models to find failure modes
Study model internals (interpretability)
Build evaluations that catch sneaky behavior
Write deployment policies that gate dangerous capabilities

We are trying to build something that optimizes a goal, while the thing that we actually want is very hard to specify. That gap is where all the danger lives.
— Stuart Russell, Human Compatible (2019)

The big idea: alignment is a technical research area with open problems. You do not need a PhD to understand the shape of it, and knowing the shape makes you harder to spin.

End-of-lesson check

8 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-safety-alignment-intro-builders

What is the main idea of "What Alignment Actually Is"?
1. Alignment is not a vibes word. It is the technical problem of getting AI to do what you meant, not just what you said. Here is the short version.
2. Use AI as the final authority for the whole decision
3. Avoid checking the answer once it sounds polished
4. Focus only on speed instead of judgment
Which concept is most central to "What Alignment Actually Is"?
1. intent vs. literal
2. alignment
3. proxy goals
4. specification gaming
Which use of AI fits this topic best?
1. Let the AI decide what matters without your review
2. Use the answer before checking whether it fits the situation
3. Goals are fuzzy. Be helpful has infinite edge cases.
4. Use the first answer without checking it
What should a careful learner remember about "A real example"?
1. Use AI to draft or organize ideas about alignment, then verify before acting.
2. Skip the context so the tool can guess faster
3. Treat the output as private even after sharing it online
4. Use the answer without checking the source
You want to use AI after this lesson. What is the safest next step?
1. Act immediately because the AI answer is written clearly
2. AI cannot make the human values decision for you.
3. Hide uncertainty so the final answer looks cleaner
4. Use private or sensitive details before checking permission
How should AI output about alignment be treated?
1. As proof that no other source is needed
2. As a replacement for context, consent, or expert review
3. As a draft or helper output that still needs human judgment and verification
4. As something that becomes correct when it sounds confident
Name one way to verify an AI answer about alignment.
Which action would help you apply "What Alignment Actually Is" responsibly?
1. Use the tool to avoid thinking through the tradeoff
2. Keep going even if the output conflicts with a trusted source
3. Use the first answer without checking it
4. Training uses a proxy, never the real thing. The score is a stand-in.

← Back to interactive lesson

Tendril · Builders · Ethics & Society