AINewsnow

Update: Converting dense models into Mixture-of-Experts

This is an update to my previous post which can be found here: https://www.reddit.com/r/LocalLLaMA/s/n7sgRZZc4z Since my last post I have continued working on the conversion process and also converting new models. My latest model is the Qwen2.5-1.5B-MoE-A0.9B . I have also released GGUF versions fo…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-13 11:50 · r/LocalLLaMA
    Update: Converting dense models into Mixture-of-Experts

More stories

  1. Meta and Google release new frontier AI models for coding and creative tasks — Google Gemini Blog
  2. FBI Arrests OpenAI Engineer for Planting Hidden Recording Device — Sky News Technology
  3. Anthropic Reports $16.8 Billion Q3 Revenue Ahead of Planned IPO — Bloomberg AI
  4. Databricks introduces Predictive AI Functions for data teams — Databricks Blog
  5. OpenAI Agrees Not to Use Alleged Apple Trade Secrets During Lawsuit — Bloomberg AI
  6. Amazon Bedrock AgentCore enables enterprise AI agents for IT, security, and document processing — AWS Machine Learning Blog
  7. Eight US states sue OpenAI over alleged safety failures for children — The Verge AI
  8. SpaceXSI releases Grok Voice 3.0, claiming top speech-to-speech performance — Techmeme

Get the daily brief of stories like this at 6:30 every morning →