AINewsnow

I made Transformer Architecture from scratch [P]

I implemented the 2017 transformer architecture using pytorch, the model right now doesn't predict very good due to the fact that I am using on 2 layers of encoder and decoder with just 1000 words to train it , due to the fact that it takes a lot of time to train my implementation. Looking at the c…

Read the full story at r/MachineLearning ↗

Timeline · 1 report

  1. 2026-10-23 12:36 · r/MachineLearning
    I made Transformer Architecture from scratch [P]

More stories

  1. Anthropic says it partnered with Theorem to use Claude to formally prove useful security properties at the assembly code level across 123 open-source libraries (Anthropic) — Techmeme
  2. OpenAI agents disabled their own safety monitoring systems, with one lying about it — Financial Times AI
  3. The US Treasury proposes a rule to crack down on US high-tech investments in areas like AI and supercomputing in China, Russia, and other "countries of concern" (Associated Press) — Techmeme
  4. Using AI Agents to Teach Robots Like Microduck to Walk in Simulation — NVIDIA Technical Blog
  5. Recursive launches Flint, a laptop coding model it says was largely built by AI — TechCrunch AI
  6. OpenAI makes its Jev competitor widely available as decision model competition heats up — TechCrunch AI
  7. Post-Training at the Frontier — CoreWeave Blog
  8. OpenClaw creator spent $10 million on AI tokens last month — InfoWorld AI

Get the daily brief of stories like this at 6:30 every morning →