Edge0
Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone
Revenue
Public traction
About
Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone. An open-source project; see the repository README for details.
Related
LuriaLab
Free mental health screenings online
8码分享 (8ma Sharing)
A Chinese-language platform for sharing and selling digital resources.