Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[venus] use too much memory when export snapshot #4922

Closed
7 of 20 tasks
cloudxin opened this issue Jun 13, 2022 · 2 comments
Closed
7 of 20 tasks

[venus] use too much memory when export snapshot #4922

cloudxin opened this issue Jun 13, 2022 · 2 comments
Labels
C-bug Category: This is a bug CU-chain-service Venus chain service related issues CU-force-community Category: from force community P2 Medium - we should get to this soon V-venus venus component

Comments

@cloudxin
Copy link

Checklist

  • This is not a security-related bug/issue. If it is, please follow please follow the security policy.
  • This is not a question or a support request. If you have any lotus related questions, please ask in the venus forum.
  • This is not a new feature request. If it is, please file a feature request instead.
  • This is not an enhancement request. If it is, please file a improvement suggestion instead.
  • I have searched on the issue tracker and the venus forum, and there is no existing related issue or discussion.
  • I am running the latest release, or the most recent RC(release canadiate) for the upcoming release or the dev branch(master), or have an issue updating to any of these.
  • I did not make any code changes to venus.

Venus component

  • venus daemon - chain sync
  • venus auth - authentication
  • venus gateway - chain service gateway
  • venus miner - mining and block production
  • venus sealer/worker - sealing
  • venus sealer - proving(WindowPoSt)
  • venus market - storage deal
  • venus market - retrieval deal
  • venus market - data transfer
  • venus light-weight client
  • venus JSON-RPC API
  • venus messager - message management (mpool)
  • Other

Venus Version

venus version
{
	"Version": "1.2.4+git.135232873.dirty"
}

Describe the Bug

./venus chain export --recent-stateroots=920 --skip-old-msgs snapshot.car

Logging Information

Exporting snapshot files takes too long and takes up a lot of memory. 128G systems have memory overflow problems.

Repo Steps

  1. Run '...'
  2. Do '...'
  3. See error '...'
    ...
@Fatman13 Fatman13 added C-bug Category: This is a bug V-venus venus component CU-chain-service Venus chain service related issues labels Jun 13, 2022
@Fatman13 Fatman13 added the C-triage Category: Need triage label Aug 22, 2022
@Fatman13 Fatman13 added the CU-force-community Category: from force community label Sep 2, 2022
@zl03jsj zl03jsj added P2 Medium - we should get to this soon and removed C-triage Category: Need triage labels Sep 5, 2022
@zl03jsj zl03jsj removed their assignment Sep 5, 2022
@zl03jsj zl03jsj removed their assignment Oct 25, 2022
@hunjixin
Copy link
Contributor

hunjixin commented Nov 2, 2022

@cloudxin 导出内存还是比lotus多?

@hunjixin hunjixin changed the title [venus] Failed to export snapshot file [venus] use too much memory when export snapshot Nov 2, 2022
@hunjixin
Copy link
Contributor

目前方案lotus和venus都很多。继续追踪这个issue意义不大。先重启解决吧,或者以后看看能不能通过https://github.com/filecoin-project/venus/issues/5182解决

@hunjixin hunjixin moved this to Done in Venus Project Nov 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-bug Category: This is a bug CU-chain-service Venus chain service related issues CU-force-community Category: from force community P2 Medium - we should get to this soon V-venus venus component
Projects
Archived in project
Development

No branches or pull requests

4 participants