i froked pg_tiktoken (rust) and added cache with once_cell to speed up my bulk calls by over 650x. pretty cool i was struggling to use token counts in my db because they took so long.

i froked pg_tiktoken (rust) and added cache with once_cell to speed up my bulk calls by over 650x. pretty cool i was struggling to use token counts in my db because they took so long.

https://github.com/alexpaden/pg_tiktoken/blob/main/README_CACHE.md

i dabble with ai using open identity data from crypto https://alexpaden.tech