Tag: digital design

  • Train a Transformer on Silicon: #0 The Genesis

    Start here — the series hub A short intro to a series where I build a chip that trains a transformer — and document the whole thing, mistakes included. What this is I’m building a digital chip that trains a transformer on-chip — not just runs it, but actually learns: forward pass, backpropagation, and weight…