Microsoft just changed the game! :fire: They've open-sourced bitnet.cpp: a… |…knowledge-baseApr 19, 2025By Team M37Labshttps://www.linkedin.com/posts/sumanth077_microsoft-just-changed-the-game-theyve-ugcPost-7318891713194872835-uIcr?utm_source=share&utm_medium=member_android&rcm=ACoAAD8jdEABbvYuIJCnZbQK08RVMB64fLl8Ssglinkedin.comMicrosoft just changed the game! :fire: They've open-sourced bitnet.cpp: a… | Sumanth P | 63 commentsMicrosoft just changed the game! :fire: They've open-sourced bitnet.cpp: a blazing-fast 1-bit LLM inference framework that runs directly on CPUs. You can now run 100B parameter models on local x86 CPU devices with up to 6x speed improvements and 82% less energy consumption. They also released BitNet b1.58 2B4T, the first functional open-source model that uses just 1.58 bits for weights instead of the usual 16 or 32 bits. BitNet b1.58 uses ternary weights (-1, 0, +1) and 8-bit activations, reducing memory needs by ~6x compared to similar-sized models while matching their performance on benchmarks Link to the paper and the repo in the comments! If you're interested in ML, LLMs, RAG, and AI Agents and want to receive Apps and tutorials every week, subscribe to AI Engineering (for free): <https://lnkd.in/d9REmcqK> | 63 comments on LinkedInwww.linkedin.com
