Logo Parvesh Rawal blog
About
  • Feb 12, 2026 Microtok

    Implementation of tiktoken and BPE from the ground up. Small enough to understand in one sitting, but powerful enough to train on real datasets in 3 lines.

Parvesh Rawal blog
  • Parvesh
  • Parvesh
"I love deep-neural-nets."