Small Models. Whole Recipe.
OpenCerebral is a non-profit research project training language models from scratch and publishing everything about them — weights, quants, token counts, wall-clock times, benchmark tables, and the passes that did not work. Every model is trained on a single consumer GPU, an NVIDIA RTX 3060, and released under the Apache License 2.0.
OpenCerebral is the successor to New Millennium Artificial Intelligence
(NMAI), a division of the
Klondike Software Project. The organization,
the models, and the maintainers are unchanged — only the name is new.
Older references to NMAI, including the previous KSP-NMAI
repository paths, refer to OpenCerebral.
Latest News
2026.08.07: littlerock-1M released, and a negative result
littlerock-1M is a 1,002,720-parameter
Llama-architecture model trained from scratch on 5B tokens in 1h 49m. It
ships alongside littlerock-1M-arithmax, a finetune that scored
40.4% on the public ArithMark-3 set, passed an independent private
memorization test at 35.5% — and then scored 21.5% on a
private set that merely rephrased the same problems. Below the 25% chance
floor. We published it because the three-way split is an unusually clean
example of a generalization failure that a careful anti-contamination
protocol did not catch.
2026.08.01: Boris-1.3-125M-Instruct and GGUF builds
The instruction-tuned Boris-1.3-125M, finetuned on smol-smoltalk and OASST1 conversational data over 5.6 hours, plus quantized GGUF builds for llama.cpp.
2026.07.31: Boris-1.3-125M — Mean-6 39.38
Seven continued-pretraining passes on top of the Boris-125M base checkpoint, adding ~2.66B tokens (roughly 106% more than the original 2.50B-token run) and lifting the six-benchmark mean from 37.88 to 39.38. Unlike the 75M run, this recipe leads with FineWeb-Edu before DCLM to test whether that ordering avoids the ARC regression. It did. Full pass-by-pass tables on the benchmarks page.
2026.07.26: Boris-1.3-75M
The same continued-pretraining treatment at 75M: three passes, ~3.95B tokens total, Mean-6 of 36.79.
2026.07.15: NMAI becomes OpenCerebral
New Millennium Artificial Intelligence is renamed OpenCerebral, and the first Boris models — Boris-125M and Boris-125M-Instruct — are published on Hugging Face.
Models at a Glance
| Family | What it is | Sizes | License |
|---|---|---|---|
| Boris | GPT-2 architecture text models, base + instruct + GGUF | 75M, 125M, 250M | Apache 2.0 |
| littlerock | Llama architecture; how much fits in a 1M-parameter budget | 1M | Apache 2.0 |
Seventeen models are published in total. See the full model index, or browse the OpenCerebral organization on Hugging Face.