Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize Bootstrap #2497

Closed
adamkrellenstein opened this issue Oct 20, 2024 · 3 comments
Closed

Optimize Bootstrap #2497

adamkrellenstein opened this issue Oct 20, 2024 · 3 comments

Comments

@adamkrellenstein
Copy link
Member

adamkrellenstein commented Oct 20, 2024

  1. Make sure we're using RSA since it's faster than ECC.
  2. Use Zstd for compression (Cf. archlinux/devtools@bcda211)
  3. Stream download for decompression

https://pyzstd.readthedocs.io/en/latest/

@ouziel-slama
Copy link
Contributor

done here #2862
6mn instead 10mn on my Lenovo

@adamkrellenstein
Copy link
Member Author

Nice!

Downloading https://storage.googleapis.com/counterparty-bootstrap/counterparty.db.latest.zst...
Downloaded https://storage.googleapis.com/counterparty-bootstrap/counterparty.db.latest.zst in 103.19s
Downloading https://storage.googleapis.com/counterparty-bootstrap/state.db.latest.zst...
Verifying signature for /Users/adam/Library/Application Support/counterparty/counterparty.db.latest.zst...
Verified signature in 10.13s
Decompressing /Users/adam/Library/Application Support/counterparty/counterparty.db.latest.zst...
Decompressed /Users/adam/Library/Application Support/counterparty/counterparty.db.latest.zst in 20.32s
Downloaded https://storage.googleapis.com/counterparty-bootstrap/state.db.latest.zst in 34.28s
Verifying signature for /Users/adam/Library/Application Support/counterparty/state.db.latest.zst...
Verified signature in 3.19s
Decompressing /Users/adam/Library/Application Support/counterparty/state.db.latest.zst...
Decompressed /Users/adam/Library/Application Support/counterparty/state.db.latest.zst in 6.24s
Databases have been successfully bootstrapped to /Users/adam/Library/Application Support/counterparty in 149.53s.

It doesn't look like the two downloads are being done in parallel? That said I'm not sure it's necessary.

@ouziel-slama
Copy link
Contributor

It doesn't look like the two downloads are being done in parallel? That said I'm not sure it's necessary.

yeah right! I don't know why but downloads in parallel are slower with Google buckets..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants