Content
@
0 reply
0 recast
0 reaction
shoni.eth
@alexpaden
i forked pg_tiktoken (rust) and added cache with once_cell to speed up my bulk calls by over 650x. This is for counting llm tokens via postgres query https://github.com/alexpaden/pg_tiktoken/blob/main/README_CACHE.md
1 reply
0 recast
1 reaction
Shaw
@shawmakesmagic
That’s cool as fuck
0 reply
0 recast
1 reaction
