Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[python/ci] Run SO copying workflow on macos-13 to avoid SIP #2435

Merged
merged 1 commit into from
Apr 11, 2024

Conversation

jdblischak
Copy link
Collaborator

Issue and/or context:

Closes #2237

We have a flaky macOS job that fails too often. Sometimes the macOS System Integrity Protection (SIP) unsets DYLD_LIBRARY_PATH, which prevents libtiledbsoma.dylib from finding libtiledb.dylib

Changes:

There is no way to disable SIP during a run. Fortunately the GitHub Actions runner macos-13 has it disabled by default, so I switched to it. If SIP is enabled in the future, then we'll have to revisit.

Notes for Reviewer:

I added a step to run csrutil status, which will help us troubleshoot in the future if SIP is enabled

So far this has passed twice on my fork

https://github.com/jdblischak/TileDB-SOMA/actions/runs/8652010719/job/23723973384
https://github.com/jdblischak/TileDB-SOMA/actions/runs/8652049846/job/23724080889

@jdblischak jdblischak self-assigned this Apr 11, 2024
@johnkerl
Copy link
Member

Fantastic work @jdblischak -- thank you!!!

@johnkerl johnkerl merged commit 7c76c4a into single-cell-data:main Apr 11, 2024
22 checks passed
@jdblischak jdblischak deleted the avoid-macos-sip branch April 11, 2024 22:31
johnkerl added a commit that referenced this pull request Apr 12, 2024
* AlreadyExistsError; use for DataFrame in tiledbsoma.io

* apply in `_create_or_open_collection`

* apply in _create_from_matrix

* apply in _ingest_uns_ndarray

* lint

* Run SO copying workflow on macos-13 to avoid SIP (#2435)

* AlreadyExistsError; use for DataFrame in tiledbsoma.io

* apply in `_create_or_open_collection`

* apply in _create_from_matrix

* apply in _ingest_uns_ndarray

* lint

* neaten

* neaten

* Update raises-notes

* code-review feedback

Co-authored-by: nguyenv <[email protected]>

---------

Co-authored-by: John Blischak <[email protected]>
Co-authored-by: nguyenv <[email protected]>
github-actions bot pushed a commit that referenced this pull request Apr 12, 2024
* AlreadyExistsError; use for DataFrame in tiledbsoma.io

* apply in `_create_or_open_collection`

* apply in _create_from_matrix

* apply in _ingest_uns_ndarray

* lint

* Run SO copying workflow on macos-13 to avoid SIP (#2435)

* AlreadyExistsError; use for DataFrame in tiledbsoma.io

* apply in `_create_or_open_collection`

* apply in _create_from_matrix

* apply in _ingest_uns_ndarray

* lint

* neaten

* neaten

* Update raises-notes

* code-review feedback

Co-authored-by: nguyenv <[email protected]>

---------

Co-authored-by: John Blischak <[email protected]>
Co-authored-by: nguyenv <[email protected]>
johnkerl added a commit that referenced this pull request Apr 12, 2024
* AlreadyExistsError; use for DataFrame in tiledbsoma.io

* apply in `_create_or_open_collection`

* apply in _create_from_matrix

* apply in _ingest_uns_ndarray

* lint

* Run SO copying workflow on macos-13 to avoid SIP (#2435)

* AlreadyExistsError; use for DataFrame in tiledbsoma.io

* apply in `_create_or_open_collection`

* apply in _create_from_matrix

* apply in _ingest_uns_ndarray

* lint

* neaten

* neaten

* Update raises-notes

* code-review feedback



---------

Co-authored-by: John Kerl <[email protected]>
Co-authored-by: John Blischak <[email protected]>
Co-authored-by: nguyenv <[email protected]>
@johnkerl johnkerl changed the title Run SO copying workflow on macos-13 to avoid SIP [python/ci] Run SO copying workflow on macos-13 to avoid SIP Apr 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug] Tracking flaky macOS CI: dlopen … No such file during import libtiledbsoma
3 participants