Akeratos by Cogvera Labs
A 6.0-billion-parameter table, trained in one Mac’s memory.
We started Akeratos to do our own research on a Mac, not on rented data-centre GPUs. Akeratos Billet pairs a core of 162 million active parameters with a learned table of 6.0 billion. The table was trained resident in the unified memory of one MacBook Pro (M4 Max, 48 GB), with no offloading code. Billet’s twin trained on the same tokens with the table switched off, so the gap between the two measures the table’s effect.
Held-out bits per byte, lower is better: 0.8866 with the table, 0.9030 without it. One seed per arm, on one MacBook Pro with an M4 Max (40 GPU cores, 48 GB) and MLX 0.32.3.