Constitutional AI: alignment from a set of principles
Instead of labeling every harmful answer by hand, the model critiques and revises itself against a written set of principles.
Why it matters
Cut the reliance on human labeling, and became the signature alignment method of the Claude family.
Led to
Source: arxiv.org ↗