Plan een gesprek
VentureBeatLarge Language Models

Researchers say they trained a foundation model from scratch for about $1,500

Researchers say they trained a foundation model from scratch for about $1,500

Training a foundation LLM from scratch costs millions and requires internet-scale data — which is why most enterprises don't bother. Sapient thinks it has a cheaper path.To overcome this brute-force scaling dogma, researchers at Sapient developed HRM-Text, which replaces standard Transformers with a highly sample-efficient Hierarchical Recurrent Model (HRM), an architecture they first introduced last year.HRM decouples computation into slow-evolving strategic and fast-evolving execution lay

AI implementeren in jouw bedrijf?

Stekz helpt bedrijven met het implementeren van AI en automatisering. Van strategie tot werkende code.

Plan een gesprek