x.comSimon EskildsenMon, Jun 1, 2026, 5:14 PM PDT
score 15.3
152likes7RT6reply
Turbopuffer open-sources ultra-fast text search tokenizer
Original: so @morgallant has optimized FTS tokenization throughput to 423 MiB/s and open-sourced it (https://github.com/turbopuffer/alyze)
Source: github.com ↗
Writing ELI5 summary…