Inference systems
Making models run faster on the machines people already own, from an eight-year-old GPU to a laptop, by measuring before we tune.
Flux-GPU · runtime v2An independent AI research lab building more capable, useful, and reliable systems.
Our research
Every result we publish was measured, repeated and checked against a baseline. When something does not work, we say so.
Making models run faster on the machines people already own, from an eight-year-old GPU to a laptop, by measuring before we tune.
Flux-GPU · runtime v2Assistants that plan, research, write code and use a browser, with every step visible and every send left to the person.
Astron · AstrixInterleaved A/B runs, confidence intervals and hardware fingerprints, so a number means the same thing tomorrow as it does today.
ABBA protocol · Welch's t-testGames and experiences on Roblox, where players show us, every day, what people actually enjoy doing with technology.
NotFox gamesA runtime that tries execution configurations on your machine, keeps only the ones that are statistically faster, and remembers them per hardware fingerprint. On an AMD RX 580 it made generation 68% faster.
Latest
Screening, interleaved confirmation and per-machine profiles; results on an AMD RX 580 from 4B to 12B parameters.
The winning change was not a kernel or a quantization. It was which Vulkan queue the work was submitted to.
Baselines first, interleaved runs, a confidence interval that has to clear 1%, and the word "inconclusive" when it does not.
The company