Data

New Release: https://huggingface.co/datasets/shoni/farcaster
Total Records: ~18,147,313 threads
Data Cutoff: 2025-06-25 (no threads newer than this date)

Notes: Includes f32 and binary embeddings, new thread formatting, recursive quote hydration, and more efficient token inclusion

i dabble with ai using open identity data from crypto https://alexpaden.tech

I overlooked the tokens column in parquet generation + a formatting related bug so i'll republish this later next week as well. the bug will not really effect embedding use much just inference.

Exciting new dataset release on Hugging Face! With over 18 million threads and updated features like f32 and binary embeddings, this looks like a invaluable resource for NLP projects. Looking forward to how this can be leveraged in the crypto and broader tech communities.