TF Hub Sync Script

[mik-tf]

Situation

• The TF Hub procedure is mostly done but we need to:
  • make sure the sync script keeps syncing after it's initial sync (not the case currently)
• Tested so far: uploaded an flist to the master hub, and could not find it in the other two after a while

References

As explained by @coesensbert. @maxux can you have a look? Please write here if you have issues or things are blocking and we can solve this.

[mik-tf]

Update

• Maxime is currently investigating and testing the syncing process:
  • zdb sync is working fine
  • flist static files not being synced
• WIP and should be fixed soon

@maxux feel free to add info here if you deem it relevant!

[maxux]

Script https://github.com/threefoldtech/grid_deployment/blob/development/grid-hub/hub-clone.py updated to latest version which does a way better job on syncing. I updated production hub as well to support improved up-to-date checking.

[coesensbert]

see: https://github.com/threefoldtech/tf_operations/issues/2831

[coesensbert]

new sync script and cmd applied on the two extra hub's

[mik-tf]

@coesensbert does this mean this issue is fixed? Has the script been tested so we can close? Thanks.

[coesensbert]

Updated script was applied on the two extra hub's, but still need to test if sync is going well now

[mik-tf]

Hi @coesensbert! Please let us know, in the following days if possible, how the sync went. Thanks

[coesensbert]

so now the updated scripts have been applied to the two extra hub's, I tested the following: uploaded an archive to hub.grid.tf, this flist appeared on both extra hub's:
https://hub.grid.tf/linkmark.3bot/hub-sync-tst.flist.md
https://hub.de.grid.tf/linkmark.3bot/hub-sync-tst.flist.md
https://hub.us.grid.tf/linkmark.3bot/hub-sync-tst.flist.md

However, I could not confirm the metadata did the same sync between the servers since:

• metadata on DE and US hub point to zdb://hub.grid.tf:9900/default
  

• did not see a data increase on both the DE or US hub. I also can not test a deploy from these hubs since ZOS does not support it yet to use a different hub then hub.grid.tf.

root@Main-Grid-DE-hub-02 ~ # du -sh /srv/*
5.1G    /srv/0-bootstrap
760G    /srv/0-db_data
609M    /srv/0-db_index
3.8G    /srv/0-hub_public
20K     /srv/0-hub_workdir

[mik-tf]

@maxux @xmonader @sabrinasadik

Any idea?

• How to test from these hubs instead of the official hub.grid.tf
• How to confirm the metadata

Thanks

[mik-tf]

@maxux

Thabet proposes this: "the verification should be running another hub and execute that sync script"

If you can have a look next week, when you're back at work. Thanks!

[mik-tf]

@maxux please give status of the issue and it anything is blocking. Thanks!

[mik-tf]

@xmonader can you please give more info on what you mean here? "the verification should be running another hub and execute that sync script"

So Maxime can move forward with this. Thanks!

EDIT: Had a talk with Maxime. He might be OK. He should reply to this issue soon.

[maxux]

About metadata: on the main hub, metadata are written in the .flist including the backend (which is supposed to be used by zos at some point). Right now, flist are copied as-it from the main hub and metadata are not updated. I should add an extra step while syncing which update metadata as well to apply local hub backend. I'll see how properly implement that.