The Superintelligence Observer
The New Stack

‘Take work away from frontier LLMs’: Subquadratic’s decision model claims 12x Jev’s context window

Subquadratic has a decision model it says offers a context window twelve times larger than Jev's. Jev, the decision model TypeSafe unveiled in mid-September, has prompted a wave of rivals aiming to take work away from frontier language models.

Related stories

The Decoder

OpenAI will reportedly ship at least one model this year but its flagship still needs alignment work

OpenAI is racing to finish its next flagship model, which uses the same looped transformer technique as Astra to boost math and coding, though looping makes safety monitoring harder. Employees say one or two new models will likely ship by year's end whether or not the flagship is ready, and Microsoft accidentally revealed details of the technique on a public page.

Apple Machine Learning

The Design Space of Tri-Modal Masked Diffusion Models

Apple researchers present what they describe as the first masked diffusion models pretrained from scratch on text, image-text and audio-text data. The paper studies multimodal scaling laws, data mixing ratios, noise schedules and batch-size effects, and proposes default settings for inference.