Hessian-Enhanced Token Attribution (HETA): Interpreting Autoregressive LLMs

The research question

Which input tokens shape an autoregressive model’s prediction?

Research summary

HETA uses Hessian-enhanced attribution to examine token-level influence. The work connects model-internal analysis with explanations of autoregressive language-model predictions.