Attention Heads

A first-party attention-head analysis and visualization tool for GPT-2 that classifies heads into copying, induction, previous-token, and retrieval behaviors and produces interactive HTML reports.