Barion Pixel

Hírek

Nvidia Researchers Argue Massive AI Context Windows Are a Dead End

Nvidia researchers argue that massive AI context windows are costly and often unnecessary, showing in tests that periodic summaries and targeted lookups match full-context performance at a fraction of the cost. While context windows have expanded dramatically—from 8,192 tokens in GPT-4 in March 2023