Sanjay avatar
Snapchain v0.4.1 is out. We now have an install script with autoupgrade and a built in grafana dashboard like hubble. You can set it up with the following command curl -sSL raw.githubusercontent.com/farcasterxyz... | bash
Cast image embed
3
3
29
Sanjay avatar
Just released Snapchain v0.4.0 to support this change. It will take effect on July 16th 17:00 UTC. Please upgrade your nodes before then. As part of this, we're also extending the existing storage units expiry by one year (no user action required). Snapchain has enough headroom that we don't need to expire yet.
Farcaster signups are going to become 10x cheaper in July. Signing up now requires a payment of 20c instead of $2. Storage units are proportionally smaller, but this makes it easier for apps to sponsor users. Big shoutout to @sanjay and @dynemyte for major performance improvements on Snapchain which enabled this.
2
1
9
Sanjay avatar
Released Hubble 0.19.3 which pushes version expiry to May 15. This will be the last hubble update. If you are still running hubs, please switch to snapchain instead of upgrading. Please reach out if you run into any issues with the migration.
1
2
19
Sanjay avatar
Thinking about the upgrade process for Snapchain and looking for feedback. There are going to be two kinds of changes: a) Soft forks (bug fixes, minor improvements and non-consensus breaking changes) b). Hard forks (breaking changes, typically FIP implementations or other major changes that affects consensus)
2
4
27
Sanjay avatar
Warpcast is currently being powered solely by snapchain. If you're publishing only to hubs, make sure you're also publishing to snapchain. Let us know if you run into issues with missing messages or with migrating to snapchain.
Migrating to Snapchain from Hubble
snapchain.farcaster.xyz
Migrating to Snapchain from Hubble
6
7
34
Sanjay avatar
Both @neynar and @warpcast are reading/writing to Snapchain now. If you’re using Hubble, you should migrate to use snapchain exclusively and let us know if you run into any issues.
Migrating to snapchain / Farcaster Docs
docs.farcaster.xyz
Migrating to snapchain / Farcaster Docs
Snapchain Mainnet [Public] | Notion
warpcast.notion.site
Snapchain Mainnet [Public] | Notion
13
32
135
Sanjay avatar
Probably the most challenging and fun project I’ve ever worked on. Incredible work by @dynemyte @suurkivi and @cassie. Special shoutout to the Informal Systems team for building Malachite, a rock solid rust Tendermint library which powers snapchain.
Snapchain testnet went live at 4pm today. Over 20,000 blocks have been produced already with a million messages processed. This is real data from mainnet that is mirrored over to test Snapchain's integrity.
quote image
8
15
95
Sanjay avatar
We've been so focused on snapchain, I forgot to do the Hub protocol release for Nov 27. Just released Hubble 1.17. Please upgrade before current version expires at Dec 11 midnight UTC. Apologies for the short notice!
12
47
Sanjay avatar
Considering buying a house, and came across this very cool and very legal covenant (from 1946) for the land in the disclosures. Can't say I wasn't tempted to buy just to stick it to them.
Cast image embed
7
4
30
Sanjay avatar
I was originally leaning towards account ordering. But happy with where we ended up. The biggest issue with blockchains is managing block state growth. Thanks to @cassie for inspiring the solution on how to handle this in snapchains. Also, special thanks to @vrypan.eth for the App Ordering idea.
FIP: Snapchain A new proposal to introduce global ordering to Farcaster hubs. We'll discuss this in more detail in the dev call tomorrow, but sharing an early draft for feedback. https://warpcast.notion.sit...
quote image
3
84
133
Sanjay avatar
If you enjoy coming up with novel distributed systems algorithms, we have just the challenge for you.
We're starting to think about a new sync model for Farcaster. The current system works but is unlikely to scale up another 10x. Here's our articulation of the problem we want to go after.
quote image
3
16
31
Sanjay avatar
Please upgrade Hubble to 1.14.4 which implements storage changes defined in github.com/farcasterxyz... We'll min version on Monday at the latest so all hubs will be ready for Aug 28 when storage units were originally scheduled to expire. If you are manually calculating storage, you'll ne...
FIP: Extending Storage Expiry · farcasterxyz/protocol · Discussion #191
github.com
FIP: Extending Storage Expiry · farcasterxyz/protocol · Discussion #191
1
7
18
Sanjay avatar
Since this day, we're at 50x the message count, 180x the peer count, ~40x the db size. Perf metrics are harder to compare since it was during an incident but currently p95 merge latency is ~30ms and p95 gossip delay is <1s (vs 2000ms and ~2.5hrs during the incident)
Cast image embed
Entire Warpcast is online trying to get things stable. Thank you for the patience!
quote image
12
23
101
Sanjay avatar
Hub message disruption today was caused by our hub losing gossip connectivity to all other hubs (unclear why exactly due to a logging bug). It was unable to regain connection due a bad interaction with a libp2p upgrade. Released 1.14.2 with a fix.
3
10
Sanjay avatar
Hubble 1.14 is out. It includes a bunch of fixes around follows (consistency issues and large compaction events breaking event streams). If you are using shuttle, make sure you’re on the latest version before upgrading hubs, there’s a breaking api change for events.
4
23
103