first, this is amazing! second, how does one increase the context window without... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		buyucu 11 months ago \| parent \| context \| favorite \| on: Qwen2.5-1M: Deploy your own Qwen with context leng... first, this is amazing! second, how does one increase the context window without requiring obscene amounts of RAM? we're really hitting the limitations of the transformer architecture's quadratic scaling...

35mm 11 months ago [–]

Chain of agents seems to be a promising approach for splitting up tasks into smaller parts and then synthesising the results[1]

[1] https://research.google/blog/chain-of-agents-large-language-...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact