Roadmap
OpenCerebral publishes what it has finished rather than what it intends, so this page is short and the dates are soft. Nothing here is a commitment.
In progress
- Boris-1.3-250M. Extending the continued-pretraining recipe to the 250M checkpoint. The open question is whether the FineWeb-Edu-first ordering that avoided the ARC regression at 125M holds at the larger size.
- littlerock scaling series. More points between 1M and 75M, trained identically, to get a clean picture of where each benchmark leaves the chance floor.
Wanted
- Independent evaluation. Private variety sets written by someone other than us. See Get Involved.
- Reproductions. Someone else running a published recipe on their own RTX 3060 and reporting whether the numbers match.
Under consideration
- A held-out evaluation suite that is not authored by the person training the models — the direct lesson of the arithmax result.
- Longer context for the Boris family. 1024 tokens is the current limit.
- Publishing the training and evaluation code alongside the weights.
Not planned
- A hosted API or demo endpoint. The models run on a CPU; run them locally.
- Models above the range a single consumer GPU can train. That constraint is the project.
- Non-permissive licensing of any kind.