Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update computing documentation #457

Open
wants to merge 3 commits into
base: gh-pages
Choose a base branch
from
Open

update computing documentation #457

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
8bff66c
modifs
clementhelsens Nov 9, 2022
aadf41a
modifs
clementhelsens Nov 9, 2022
06fb1da
Merge branch 'gh-pages' into gh-pages
clementhelsens Nov 10, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
62 changes: 30 additions & 32 deletions computing/computing.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,19 +5,19 @@ id: computing

FCC Computing / Storage
================================================
CERN ressources are available to be used by people being employed by an institute that has signed the Memorandum of Understanding (MoU) and by laboratories having signed the Addendum. For more information on the procedure please have a look at <a href="https://fcc-ped.web.cern.ch/content/official-documents"> this page. </a>
CERN resources are available to be used by people being employed by an institute that has signed the Memorandum of Understanding (MoU) and by laboratories having signed the Addendum. For more information on the procedure please have a look at <a href="https://fcc-ped.web.cern.ch/content/official-documents"> this page. </a>

The computing and disk ressources are controlled by <a href="https://e-groups.cern.ch/e-groups/EgroupsSearchForm.do">e-groups</a> with admin approval.
The computing and disk resources are controlled by <a href="https://e-groups.cern.ch/e-groups/EgroupsSearchForm.do">e-groups</a> with admin approval.

**Those receiving approval engage in using these resorces ONLY for activities related to FCC**.
**Those receiving approval engage in using these resources ONLY for activities related to FCC**.

## Computing resources

A quota of resources, dedicated to FCC computing activities, are available in the HTCondor-based CERN batch farm.
Use of these resources is controlled by the <a href="https://e-groups.cern.ch/e-groups/EgroupsSearchForm.do">CERN e-group</a>
Usage of these resources is controlled by the <a href="https://e-groups.cern.ch/e-groups/EgroupsSearchForm.do">CERN e-group</a>
**fcc-experiments-comp** and subject to admin approval.
The associated accounting group is **group_u_FCC**; to use resources from this quota, the following needs to be
added to the job sumbmit file:
added to the HTCondor job submit file:
```
+AccountingGroup = "group_u_FCC.local_gen"
```
Expand All @@ -27,57 +27,54 @@ A quota of storage disk space, dedicated to FCC computing activities, is availab
```
/eos/experiment/fcc
```
Access to these resources is controlled by the <a href="https://e-groups.cern.ch/e-groups/EgroupsSearchForm.do">CERN e-groups</a>
**fcc-eos-read-ee**, **fcc-eos-read-hh** and **fcc-eos-read-eh** and subject to admin approval.
Access to these resources is controlled by the <a href="https://e-groups.cern.ch/e-groups/EgroupsSearchForm.do">CERN e-group</a>
**fcc-eos-read** for read only access and **fcc-eos-write** for read and write permissions. Both are subject to admin approval.

### Access to storage resources from outside CERN

Users enabled to access the FCC area on EOS can do so also from outside CERN using the Kerberos credentials associated with theirr
Users enabled to access the FCC area on EOS can do so also from outside CERN using the Kerberos credentials associated with their
CERN user account. To do so, they have to make sure to have the Kerberos credential initiator application, `kinit`, installed
and configured to enable the `CERN.CH` Kerberos realm. Typically is enough to copy the relevant sections from the /eos/krb5.conf
file accessible on lxplus (or copying the complete file, if there is none locally or if the local one is not customized).

Once this is done, the following should work:
```
$ kinit ganis@CERN.CH
ganis@CERN.CH's password:
$ kinit <CERNLOGIN>@CERN.CH
<CERNLOGIN>@CERN.CH's password:
(Enter CERN lxplus password)

$ klist
Credentials cache: API:68FEEF0D-F635-45C6-91B3-1A7A6F83E0C6
Principal: ganis@CERN.CH
Principal: <CERNLOGIN>@CERN.CH

Issued Expires Principal
Dec 2 16:20:16 2020 Dec 3 17:20:10 2020 krbtgt/[email protected]
```
The files can be copied locally
```
$ xrdcp root://eospublic.cern.ch//eos/experiment/fcc/ee/generation/DelphesEvents/fcc_v02/p8_ee_ZH_ecm240/events_199832436.root .
$ xrdcp root://eospublic.cern.ch//eos/experiment/fcc/ee/generation/DelphesEvents/spring2021/IDEA/p8_ee_ZH_ecm240/events_103943569.root .
[80.67MB/80.67MB][100%][==================================================][16.13MB/s]
```
or accessed directly via ROOT
```
$ root -l
root [0] auto f = TFile::Open("root://eospublic.cern.ch//eos/experiment/fcc/ee/generation/DelphesEvents/fcc_v02/p8_ee_ZH_ecm240/events_199832436.root")
Warning in <TClass::Init>: no dictionary for class fcc::MCParticleData is available
Warning in <TClass::Init>: no dictionary for class fcc::BareParticle is available
Warning in <TClass::Init>: no dictionary for class fcc::Point is available
Warning in <TClass::Init>: no dictionary for class fcc::LorentzVector is available
root [0] auto f = TFile::Open("root://eospublic.cern.ch//eos/experiment/fcc/ee/generation/DelphesEvents/spring2021/IDEA/p8_ee_ZH_ecm240/events_103943569.root")
Warning in <TClass::Init>: no dictionary for class podio::GenericParameters is available
Warning in <TClass::Init>: no dictionary for class podio::ObjectID is available
Warning in <TClass::Init>: no dictionary for class fcc::GenVertexData is available
Warning in <TClass::Init>: no dictionary for class fcc::FloatValueData is available
Warning in <TClass::Init>: no dictionary for class fcc::ParticleData is available
Warning in <TClass::Init>: no dictionary for class fcc::TrackStateData is available
Warning in <TClass::Init>: no dictionary for class fcc::TaggedParticleData is available
Warning in <TClass::Init>: no dictionary for class fcc::GenJetData is available
Warning in <TClass::Init>: no dictionary for class fcc::BareJet is available
Warning in <TClass::Init>: no dictionary for class fcc::TaggedGenJetData is available
Warning in <TClass::Init>: no dictionary for class fcc::JetData is available
Warning in <TClass::Init>: no dictionary for class fcc::TaggedJetData is available
Warning in <TClass::Init>: no dictionary for class fcc::METData is available
Warning in <TClass::Init>: no dictionary for class fcc::ParticleMCParticleAssociationData is available
Warning in <TClass::Init>: no dictionary for class edm4hep::ClusterData is available
Warning in <TClass::Init>: no dictionary for class edm4hep::Vector3f is available
Warning in <TClass::Init>: no dictionary for class edm4hep::MCParticleData is available
Warning in <TClass::Init>: no dictionary for class edm4hep::Vector3d is available
Warning in <TClass::Init>: no dictionary for class edm4hep::Vector2i is available
Warning in <TClass::Init>: no dictionary for class edm4hep::ReconstructedParticleData is available
Warning in <TClass::Init>: no dictionary for class edm4hep::MCRecoParticleAssociationData is available
Warning in <TClass::Init>: no dictionary for class edm4hep::ParticleIDData is available
Warning in <TClass::Init>: no dictionary for class edm4hep::TrackData is available
Warning in <TClass::Init>: no dictionary for class edm4hep::TrackState is available
Warning in <TClass::Init>: no dictionary for class edm4hep::RecoParticleRefData is available
Warning in <TClass::Init>: no dictionary for class podio::CollectionIDTable is available
(TFile *) @0x7ffee5b6b718
Warning in <TClass::Init>: no dictionary for class pair<int,podio::GenericParameters> is available
(TFile *) @0x7ffe9e4c9890
root [1]
```

Expand All @@ -87,10 +84,11 @@ A cache system, for example based on `XCache`, can make the whole setup more eff
Another possibility is to mount the remote directory locally using the `sshfs` utility, for example
```
$ mkdir ~/eosfcc
sshfs -o idmap=user -o follow_symlinks ganis@lxplus.cern.ch:/eos/experiment/fcc /home/ganis/eosfcc
sshfs -o idmap=user -o follow_symlinks <CERNLOGIN>@lxplus.cern.ch:/eos/experiment/fcc ~/eosfcc
(CERN lxplus password)
```
The local and remote user and group ID must be the same for this to work.

## Troubleshooting


In case of issues with computing resources, please contact the FCC software coordinators [email protected] and [email protected]