Vikas Gorur

Past work: Airbase, Twitter, Gluster.

Machine Learning

This is my attempt to build the “tech tree” of ML, starting from the absolute basics and ending up somewhere around GPT-2.

2025-01-26 The Simplest Autoencoder
2024-10-18 Path to LLMs
2024-09-01 Breaking Caesar Ciphers Using Relative Entropy
2024-08-31 Learning by Gradient Descent

Makemore

2025-05-26 Makemore 1: bigram model

Programs for Humans

These are programs I write solely to understand something.

2025-02-21 Project Euler - first 100 problems
2024-12-22 Cryptopals: Set 1
2024-12-09 Advent of Code 2024 (Clojure)

Annotations

My notes on papers and articles I’ve read.

2025-04-25 On the Biology of a Large Language Model (Anthropic)
2025-04-01 Deep Dive into LLMs like ChatGPT (Karpathy)
2025-01-18 Programming as Theory Building
2024-11-27 Why Machines Learn (book)
2024-10-07 History of Language Modeling

Applied Math

2025-01-03 Chessrank: Who Should Win a Chess Tournament?
2024-07-24 Counting is hard
2024-11-02 Stats 110: Practice 1

Essays

2024-12-14 Mysore Food Guide
2022-04-25 The Varieties of Silence
2021-03-16 For A Kannada Movie
2020-04-30 How to do Feature Flag-Driven Development