HN – Ask HN: Why don't we talk about context window size anymore?

Context length used to be one of the headline metrics for new models. I hardly hear about it anymore, but I can't imagine it doesn't still play a huge role in practical performance.

Is this truly no longer a bottleneck, or does it just get rolled up in the headline benchmark numbers now?

Ask HN: Why don't we talk about context window size anymore?

4 comments