18 August 2026
NVIDIA releases efficient model, sparks architecture debate
- NVIDIA released Nemotron 3.5 Lightning, a model using mixture of experts (a technique that activates only part of its parameters at once) to reduce computational demands during inference, the process of running a trained model on new inputs.
- Research shows reinforcement learning, a training method where models learn through reward signals, can optimize large mixture-of-experts models without creating mismatches between how they're trained and how they're used.
