AINewsnow

I ran Qwen3.5-0.8B in pure Assembly

On an AMD EPYC 7B12, it generated 6.51 tokens/sec on one CPU thread. The Transformers reference reached 4.34. All 32 generated tokens matched in both runs. Code: https://github.com/suayptalha/qwen3\_5-assembly X Post: https://x.com/suayptalha/status/2119254536283906205 Tokenization, model inference…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-08 15:39 · r/LocalLLaMA
    I ran Qwen3.5-0.8B in pure Assembly

More stories

  1. Nvidia opens investigation into CEO Jensen Huang's relationship with Chinese spy — Axios AI+
  2. US AI Safety Center CAISSI Asked to Report to White House, Raising Independence Concerns — AP News
  3. Hydra-PSIE expands 'Coeziune OM–IA' DOI registry to 39 published works — DEV Community — AI
  4. Earnings Calls Highlight AI Momentum at BCE, Doximity and N-able — The Globe and Mail
  5. Anthropic agrees $3.4 billion deal for gas-fired generators to power AI data centres — Financial Times AI
  6. Latest Hiring Data Shows No White-Collar Job Losses From AI Yet — Wall Street Journal Technology
  7. Midterm results hit AI stocks as voters reject data center measures — CNN Business
  8. Investor Comparisons Pit Nvidia Against Micron and AMD in AI Chip Stock Analysis — The Globe and Mail

Get the daily brief of stories like this at 6:30 every morning →