『Understanding Transformers via N-Gram Statistics』を生成AIと学ぶ
Excited that my new paper on understanding LLMs is out, pushing how far we can describe LLM predictions via simple statistic rules. Bonus: I also discover a novel way of detecting overfitting *without* using a holdout set. So are LLMs just stochastic parrots? You be the judge. 1/ pic.twitter.com/gO…
