Lesson · 14 min
Steerability and failure modes
Hallucination, sycophancy, bias, and jailbreak theater.
Steerability is the good news: the same weights will play editor, tutor, or critic on command. The bad news is the failure modes that come with fluent generation.
- Hallucination — a confident continuation that does not correspond to the world. Worse when you ask for sources it must invent, or details it was never given.
- Sycophancy — agreeing with you because the prompt makes disagreement unlikely.
- Bias — training data is human. The model will reproduce patterns, including ugly ones. Probe, do not assume neutrality.
- Over-refusal or under-refusal — safety layers are blunt. They will sometimes block a fair ask and sometimes miss a bad one. You still have policy.