Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a tier2 site config for AWS AMIs #1393

Merged
merged 35 commits into from
Jan 2, 2025
Merged

Add a tier2 site config for AWS AMIs #1393

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
c007a91
Initial commit of Tier2 AWS support
stiggy87 Dec 4, 2024
fa28e55
Updated READMEs to match formatting and corrected bash code
stiggy87 Dec 5, 2024
5c73a21
Cleaned up formatting for ubuntu README
stiggy87 Dec 5, 2024
bac62d0
Fixed some wrong versioning and cleaned up formatting for rocky8 README
stiggy87 Dec 5, 2024
459c1bb
Fixed file hierarchy for unit tests
stiggy87 Dec 5, 2024
926f541
Updated READMEs based on comments.
stiggy87 Dec 6, 2024
3892755
Added extra line at the end of file
stiggy87 Dec 6, 2024
e15a417
Added extra line end of intel yaml file
stiggy87 Dec 6, 2024
f1a5264
Removed openmpi from the mpi providers
stiggy87 Dec 6, 2024
e51ae22
Updated Rocky8 compiler.yaml
stiggy87 Dec 9, 2024
9c24649
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 9, 2024
78007a2
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 9, 2024
a9c136a
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 10, 2024
9576ce8
Updated Ubuntu README
stiggy87 Dec 11, 2024
1ddb3ad
Update Rocky8 README and yaml files
stiggy87 Dec 11, 2024
193b1a5
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 11, 2024
e182c6f
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 11, 2024
3bc3e01
Addressed comments.
stiggy87 Dec 12, 2024
6e65ab1
Fixed misspelings for update-alternatives
stiggy87 Dec 12, 2024
21a7fc7
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 12, 2024
b4dae92
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 12, 2024
f7a28fc
Changed version of gcc to install to gcc-11
stiggy87 Dec 12, 2024
d9d381f
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 12, 2024
7b2657c
Change the gcc from 12.3.0 to 11.4.0 for both gcc and intel builds.
stiggy87 Dec 13, 2024
eddb0a2
Added lines to have spack-stack Core modulefile to profile
stiggy87 Dec 17, 2024
e895b3b
Added:
stiggy87 Dec 17, 2024
450d01a
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 17, 2024
c4edee1
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 17, 2024
3b72fd0
Fixed openmpi version for module load
stiggy87 Dec 19, 2024
5b0464d
Merge branch 'develop' into feature/tier2-aws-ami
stiggy87 Dec 19, 2024
fc0d0b5
Merge branch 'develop' into feature/tier2-aws-ami
stiggy87 Dec 24, 2024
30c9877
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 30, 2024
8dcfe6c
Updated script to find external grep
stiggy87 Dec 30, 2024
c911ddd
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Jan 2, 2025
56e250a
Synced with latest spack changes and whitespaces
stiggy87 Jan 2, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions configs/sites/tier2/aws-rocky8/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -230,6 +230,7 @@ spack external find --scope system \
--exclude openssh --exclude python
spack external find --scope system wget
spack external find --scope system mysql
spack external find --scope system grep
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you tested this? I had trouble getting find external to identify grep and I had to add it to the site config manually. That said, my problems might have been my own.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did I not fix the find external grep recently?

Copy link
Collaborator

@eap eap Dec 30, 2024 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe! my experience was from like 3 weeks ago and might have been from a branch slightly further out of date than that. Testing this would take more effort than its worth and I'll take it on faith that its working.

Steve feel free to resolve this.

Edit: oh, I remember that PR. Yes this is definitely fixed.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm double checking this on the instances I created to make sure, but I saw the PR merged.

spack compiler find --scope system
unset SPACK_SYSTEM_CONFIG_PATH

Expand Down Expand Up @@ -331,6 +332,7 @@ spack external find --scope system perl
spack external find --scope system wget
spack external find --scope system texlive
spack external find --scope system mysql
spack external find --scope system grep

# No external find for pre-installed intel-oneapi-mpi (from pcluster AMI),
# and no way to add object entry to list using "spack config add".
Expand Down
2 changes: 2 additions & 0 deletions configs/sites/tier2/aws-ubuntu2404/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -154,6 +154,7 @@ spack external find --scope system \
--exclude openssh --exclude python
spack external find --scope system wget
spack external find --scope system mysql
spack external find --scope system grep
spack compiler find --scope system
unset SPACK_SYSTEM_CONFIG_PATH
# ACTION: Edit the site/compilers.yaml with the following.
Expand Down Expand Up @@ -253,6 +254,7 @@ spack external find --scope system perl
spack external find --scope system wget
spack external find --scope system texlive
spack external find --scope system mysql
spack external find --scope system grep

# No external find for pre-installed intel-oneapi-mpi,
# and no way to add object entry to list using "spack config add".
Expand Down
2 changes: 1 addition & 1 deletion spack
Open in desktop
Submodule spack updated 3 files
+7 −7 .github/workflows/unit_tests.yaml
+9 −14 var/spack/repos/builtin/packages/esmf/package.py
+0 −18 var/spack/repos/builtin/packages/grep/package.py
Loading