Article URL: https://github.com/marcelroed/gigatoken/
Comments URL: https://news.ycombinator.com/item?id=49010167
Points: 408
# Comments: 81
GigaToken: ~1000x faster Language model tokenization
Notes
No notes yet.
Highlights
No highlights yet.
No notes yet.
No highlights yet.
Article URL: https://github.com/marcelroed/gigatoken/
Comments URL: https://news.ycombinator.com/item?id=49010167
Points: 408
# Comments: 81