4 / 5

Lesson · 14 min

Steerability and failure modes

Hallucination, sycophancy, bias, and jailbreak theater.

Steerability is the good news: the same weights will play editor, tutor, or critic on command. The bad news is the failure modes that come with fluent generation.

  • Hallucination — a confident continuation that does not correspond to the world. Worse when you ask for sources it must invent, or details it was never given.
  • Sycophancy — agreeing with you because the prompt makes disagreement unlikely.
  • Bias — training data is human. The model will reproduce patterns, including ugly ones. Probe, do not assume neutrality.
  • Over-refusal or under-refusal — safety layers are blunt. They will sometimes block a fair ask and sometimes miss a bad one. You still have policy.