v3.24.12rc1

What's Changed

based on race condition work for HPC mirroring deployment:

• change exchangeSplit to base hash on path by @petersilva in #191 (for better suppression of non-final rm's.)
• fix #179 unset env vars evaluate to empty string by @petersilva in #180 (so ${JOBID} works without crashing any jobs.)

other fixes:

• Make generate_syscall_code work on Ubuntu by @reidsunderland in #181
• Add realpath_post_baseDir for #140 by @reidsunderland in #186 (improved mirror coverage.)
• Issue111 5 code cleanups that do not solve any problems, but perhaps prevent undiscoverred ones. by @petersilva in #184
• Issue140 2 misc documentation fixes by @petersilva in #182
• remove copy_file_range (eliminates seg fault on many systems.) by @petersilva in #183

Full Changelog: v3.24.11...v3.24.12rc1

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://code.launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release

(coming soon) Redhat 8 and 9 RPMS attached.

Metpx-sr3c v3.24.11 better coverage for HPC Mirroring

What's Changed

• symbolic link fixes for Sarracenia issue 1270 support by @petersilva in #168
• Syscall auto-generation by @reidsunderland in #170
• Always intercept syscall by @reidsunderland in #172
• Add libkeyutils-dev to vm_autoconfig by @reidsunderland in #173
• if it does not match, mask is nil... Boom! by @petersilva in #176

Full Changelog: v3.24.10...v3.24.11

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://code.launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

Redhat 8 and 9 RPMS attached.

v3.24.10 manageable in ops main pumps

Briefly

HPC Mirroring further improvements (shim library syscall coverage, also added "remove" libc entry point.)

In deploying to main data pumps, we saw that while the application code itself was fine, incompatibilities with the sr3 cli caused things like sr3 sanity and sr3 status to restart C instances every 10 minutes or so, and the log files were not being cleaned up. This version cleans up those issues. Should be fully usable now.

• Shim Library gets remove() and many syscall() entry points. More use cases for redhat 8 (HPC.)
• fixes so that sr3 management ui manages sr3_cpump/sr3_cpost better/properly.
• removal of old logs (post rotation, keeping the total number down.)

What's Changed

• the fix for >100 instances does not understand C component instances.… by @petersilva in #161
• Issue158 - adding layer to remove old logs. by @petersilva in #160
• fix #157... print an idle message when nothing happenning by @petersilva in #159
• Issue #153 and #143 - include host.inc not found, and blank datestamps by @petersilva in #162
• Add more syscalls by @reidsunderland in #165
• Fix #164 : add remove by @reidsunderland in #166

Full Changelog: v3.24.07...v3.24.10

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://code.launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

Redhat 8 and 9 RPMS attached.

v3.24.10rc2 manageable in ops main pumps

Briefly

HPC Mirroring further improvements.

in deploying to main data pumps, we saw that while the application code itself was fine, incompatibilities with the sr3 cli caused things like sr3 sanity and sr3 status to restart C instances every 10 minutes or so, and the log files were not being cleaned up. This version cleans up those issues. Should be fully usable now.

• Shim Library gets remove() and many syscall() entry points. More use cases for redhat 8 (HPC.)
• fixes so that sr3 management ui manages sr3_cpump/sr3_cpost better/properly.
• removal of old logs (post rotation, keeping the total number down.)

What's Changed

• the fix for >100 instances does not understand C component instances.… by @petersilva in #161
• Issue158 - adding layer to remove old logs. by @petersilva in #160
• fix #157... print an idle message when nothing happenning by @petersilva in #159
• Issue #153 and #143 - include host.inc not found, and blank datestamps by @petersilva in #162
• Add more syscalls by @reidsunderland in #165
• Fix #164 : add remove by @reidsunderland in #166

Full Changelog: v3.24.07...v3.24.10rc2

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://code.launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release

Redhat 8 and 9 RPMS attached.

v3.24.07 - Catches More Events on RedHat 8

What's Changed

• fix #154 rename ignored when one end is outside tree being watched with inotify.
• Handle renameat2 on RHEL 8 and systems with glibc < 2.28 by @reidsunderland in #147
• Issue148 - posting corrupt topic header in rare case (but common in tests.) by @petersilva in #149
• get Redhat tree copies working by @petersilva in #151
• More fixes for #145 by @reidsunderland in #152
• Issue154 by @petersilva in #155

New Contributors

• @reidsunderland made their first contribution in #147

Full Changelog: v3.24.02...v3.24.07

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

Redhat 8 RPMS attached.

v3.24.07rc1

What's Changed

• fix #154 rename ignored when one end is outside tree being watched with inotify.
• more syscalls() shims implemented because gnu utils calls them on redhat 8.
• Handle renameat2 on RHEL 8 and systems with glibc < 2.28 by @reidsunderland in #147
• Issue148 - posting corrupt topic header in rare case (but common in tests.) by @petersilva in #149
• get Redhat tree copies working by @petersilva in #151
• fix #141 sr3_cpost in a tree being mirrored (conflict with shim)
• tests: fix for link modification times cannot be preserved.
• test fixes for changes in python side.
• README revised to reflect that cpump is not resilient to failure.
• fix #133 read some non-utf8 fields (instead of erroring.)
• last tx/rx should be cumulative, reset less often.
• fix SR_DEBUG_LOGS being broken by addition of context to api signature
• tests working on RedHat 8 and 9

New Contributors

• @reidsunderland made their first contribution in #147

Full Changelog: v3.24.02rc1...v3.24.07rc1

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://code.launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release

Redhat 8 and 9 RPMS attached.

v3.24.02

What's Changed

• fix #109 non blocking message checks, with separate sleep, so houskee… by @petersilva in #123
• fixes #118 management of metrics dir and files by @petersilva in #119
• when config is not found, say where you looked by @petersilva in #124
• on #109 consumer connection recovery was broken. by @petersilva in #129
• fix for #127... status core dump by @petersilva in #128
• fix to match sarra issue #639 relative sftp links by @petersilva in #131
• when used as shovel/winnow, it constantly re-declares the queue. by @petersilva in #132
• fix #136 last sent stats by @petersilva in #137
• Issue133 - accepting non string headers. by @petersilva in #139
• Issue141 2nd try by @petersilva in #144

Full Changelog: v3.23.11...v3.24.02

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

Redhat 8 RPMS attached.

v3.24.02rc1

What's Changed

• fix #136 last sent stats by @petersilva in #137
• Issue133 - accepting non string headers. by @petersilva in #139
• Issue141 fix sr3_cpost runs inside jobs running with shim library mixing options up. @petersilva in #144

Full Changelog: 3.23.11p3...v3.24.02rc1

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx-pre-release
Fedora39 RPMS attached.

v3.23.11p3 fix bad connection behaviour in consumer.

the constant queue re-declaration (and re-connection to the broker) fixed in this release is almost
a DOS attack on the broker. Really better to not use 11p2.

What's Changed

• fix to match sarra issue #639 relative sftp links by @petersilva in #131
• when used as shovel/winnow, it constantly re-declares the queue. by @petersilva in #132

Full Changelog: v3.23.11p2...3.23.11p3

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx

v3.23.11p2

BUG

this release is fine for use for posting (sr3_cpost, and the shim library)

HOWEVER: DO NOT USE sr3_cpump IN THIS RELEASE (the consumer code.)

in sr3_cpump (which is used for consuming from a queue.) there is a small bug that makes it constantly re-connect to the broker when there are no messages ready, making it a badly behaved consumer. It's sort of a DOS attack on the broker, and it will print millions of messages in the log file as well.

Use an earlier or later release (3.23.11p3)

What's Changed

• on #109 consumer connection recovery was broken. by @petersilva in #129
• fix for #127... status core dump by @petersilva in #128

Full Changelog: v3.23.11p1...v3.23.11p2

Installation

from source, see https://github.com/MetPX/sarrac

packages available:

Ubuntu PPA: https://launchpad.net/~ssc-hpc-chp-spc/+archive/ubuntu/metpx