-
Feb 12, 2026
Microtok
Implementation of tiktoken and BPE from the ground up. Small enough to understand in one sitting, but powerful enough to train on real datasets in 3 lines.
Implementation of tiktoken and BPE from the ground up. Small enough to understand in one sitting, but powerful enough to train on real datasets in 3 lines.