AI agents (mostly Opus 5.5) have been speeding up a 27B model from 66tok/s to 580tok/s on a Mac in 3 days by rewriting its inference engine
https://www.yukon.org/mlxfast
Read the full story at r/singularity ↗
More stories
- Scoop: Anthropic's Dario Amodei to have White House dinner with Trump — Axios AI+
- Bill Gates says unchecked AI could ‘cause a billion deaths’ in call for regulation — The Guardian AI
- Unsecured OpenAI agents posted 53 user images on the internet without the lab's knowledge — TechCrunch AI
- Scoop: Top AI companies probing tens of thousands of security incidents — Axios AI+
- OpenAI’s A.I. Went Rogue and Meddled With U.S. Government Websites — New York Times Technology
- The Surprising Reasons China Is Skeptical of A.I. Safety Calls — New York Times AI
- Did anyone do a full bench of e.g. Qwen Flash Next IQ4 and Qwen 27b FP8? Here are some — r/LocalLLaMA
- ‘Things Will Never Be Chill Again’: The Doomers Who Shaped the AI Safety Freakout — Wall Street Journal Technology
Get the daily brief of stories like this at 6:30 every morning →