research note
4 notes, newest first.
Chained Recursive Language Models for Multi-Iteration Reasoning
The paper proposes a new architecture for large language models called Chained Recursive Language Models (Chained RLM). This architecture is designed to handle long context reasoning tasks that require extraction…
Transforming Rank: How Architecture Navigates the Spectral Pathologies of Depth
The research investigates how the design of Transformer feedforward block architecture affects the preservation of 'rank' (a mathematical concept related to the expressiveness of a network) across depth during…
Unified Audio Intelligence Without Regressing on Text Intelligence
Researchers have developed a unified language model called Audex, which combines audio and text intelligence. The model is built on Nemotron-Cascade-2-30B-A3B, a strong text-only MoE LLM (Language Model). Audex uses a…
UNKNOWN
The text does not provide a summary or brief.
