Sanjay on Farcaster

vrypan |--o--| pfp

I built this little tool to monitor my snapchain node. (Will it actually take 3.5 weeks to sync?) https://github.com/vrypan/sc-mon

3 replies

0 recast

14 reactions

Stephan pfp

What about snapshot sync?

1 reply

0 recast

0 reaction

vrypan |--o--| pfp

I started with a fresh install, `docker compose up -d` It downloaded the snapshots and unpacked them as far as I can tell.

1 reply

0 recast

1 reaction

Stephan pfp

Looks like it only contained shard 1 lol

1 reply

0 recast

0 reaction

vrypan |--o--| pfp

Hmmm... Looking at the logs, 2 chunks failed to download, so I guess it failed to restore the snapshot... 😢

2 replies

0 recast

1 reaction

Stephan pfp

Probably worth trying again

1 reply

0 recast

0 reaction

vrypan |--o--| pfp

Downloading the snapshot takes a few hours. I don't want to wait hours just to fail because one of the 1000 chunks failed to download.

1 reply

0 recast

0 reaction

Stephan pfp

Better than waiting 3.5 weeks 😆

1 reply

0 recast

0 reaction

vrypan |--o--| pfp

I see that the snapshot started by downloading `https://pub-d352dd8819104a778e20d08888c5a661.r2.dev/FARCASTER_NETWORK_MAINNET/1/latest.json` How do I interpret the contents of this json? What's the base URL for each chunk? Maybe @sanjay can help.

2 replies

0 recast

1 reaction

Sanjay pfp

I believe they are all relative urls to where latest.json is. FYI, we have a bunch of performance fixes to sync coming up soon https://github.com/farcasterxyz/snapchain/pull/550

1 reply

0 recast

0 reaction

vrypan |--o--| pfp

> I believe they are all relative urls to where latest.json is. I tried this, but it's not working (or I'm doing something wrong). Waiting a few hours to download 1000 chunks and then fail because one didn't, is a downer. I could write a downloader if I had some details on the flow, that someone could run before firing up their node if they like (and would offer more flexibility to recover such cases). > FYI, we have a bunch of performance fixes to sync coming up soon Nice

1 reply

0 recast

0 reaction

vrypan |--o--| pfp

@sanjay it crashed again, while unpacking the snapshot. The problem is the snapshot is removed, so now, in order to try again, I have to wait 5-6 hours.

1 reply

0 recast

0 reaction

Sanjay pfp

Ugh, that sucks. Will fix.

1 reply

0 recast

0 reaction

vrypan |--o--| pfp

Downloading chunks. https://snippets.so/snip/S6JW3spkhA

0 reply

0 recast

2 reactions