@gvwilson Until this happens, the Package Management devroom track at the upcoming #FOSDEM26 might be useful, as well as some of the talks at the #HPC, #BigData, and #DataScience one:
https://fosdem.org/2026/schedule/track/package-management/
https://fosdem.org/2026/schedule/track/hpc-big-data-data-science/

“With or without Guix: Deploying complex software stacks on major supercomputers” 👇
https://hpc.guix.info/blog/2025/12/with-or-without-guix-deploying-complex-software-stacks/

A Guix-based workflow that goes from continuous integration to supercomputers with ‘guix pack’.

#Guix #HPC #EuroHPC

RE: https://social.heise.de/@heiseonlineenglish/115725340534744039

In any kind of normal timeline this would have been stopped by regulators. Instead we let a single company become the sole gatekeeper for everything in #HPC .

SchedMD are the makers of #slurm , the (only) Open Source cluster scheduler, and used by a large majority of cluster computers. Nvidia bought Mellanox a few years ago, the maker of Infiniband, the main network technology for clusters.

Artist and former Thinking Machines Product Designer Tamiko Thiel visited https://icm.museum to see the new Large Systems gallery which features the Connection Machine. Tamiko demonstrates the CM-2's "friend height" a suggestion that Danny Hillis wanted to realize.
@brewsterkahle #supercomputing #hpc #vintagecomputing #retrocomputing

RE: https://social.heise.de/@heiseonlineenglish/115725340534744039

In any kind of normal timeline this would have been stopped by regulators. Instead we let a single company become the sole gatekeeper for everything in #HPC .

SchedMD are the makers of #slurm , the (only) Open Source cluster scheduler, and used by a large majority of cluster computers. Nvidia bought Mellanox a few years ago, the maker of Infiniband, the main network technology for clusters.

The last blog post I wrote was about Life Science Support on HPC clusters. Honestly? It was more of a rant. Not a good blog post.

So, someone suggested I delete it, which I did. It took me a long time to recover. Now, I have re-written this blog post. I think it is better. I weighted every phrase. It still has some rant flavour.

Here it is: https://blogs.fediscience.org/rupture-de-catenaire/2025/12/15/empowering-life-scientists-what-hpc-support-should-look-like/

The upcoming articles will have more of an example character. But I still will not be able to update on a regular basis.

#Bioinformatics #HPC #ReproducibleComputing #Snakemake #Nextflow

Artist and former Thinking Machines Product Designer Tamiko Thiel visited https://icm.museum to see the new Large Systems gallery which features the Connection Machine. Tamiko demonstrates the CM-2's "friend height" a suggestion that Danny Hillis wanted to realize.
@brewsterkahle #supercomputing #hpc #vintagecomputing #retrocomputing

“With or without Guix: Deploying complex software stacks on major supercomputers” 👇
https://hpc.guix.info/blog/2025/12/with-or-without-guix-deploying-complex-software-stacks/

A Guix-based workflow that goes from continuous integration to supercomputers with ‘guix pack’.

#Guix #HPC #EuroHPC

Beep, Beep - I am your friendly #Snakemake release announcement bot.

There is a new release of the Snakemake executor for #SLURM on #HPC systems. Its version now is 2.0.2!

Give us some time, and you will automatically find the plugin on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainers here on Mastodon!
@rupdecat and @johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake-executor-plugin-slurm/issues.

See https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v2.0.2 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* partition cluster selection: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/385

@Dutch_Reproducibility_Network

In fact, I am a #Snakemake co-maintainer and teacher. I was not aware of WorkflowHub - and that was an omission on my part. We actually support and favour this kind of registration: https://snakemake.readthedocs.io/en/stable/snakefiles/deployment.html#uploading-workflows-to-workflowhub

In my original post, I also neglected to mention the integration of WorkflowHub with #RO-Crate and in turn, the integration of RO-Crates with nanopubs. I am actively working on a better support for #nanopub and RO-Crates with @fbartusch. The question, how I teach that stands: The #HPC world (at least my bubble) is not really supportive for #ReproducibleComputing . All #OpenScience shenanigans are frowned upon. And PIs in my vicinity are still on this level: https://phdcomics.com/comics/archive.php?comicid=1531 - so, how do we educate the educators?

Beep, Beep - I am your friendly #Snakemake release announcement bot.

There is a new release of the Snakemake executor for #SLURM on #HPC systems. Its version now is 2.0.2!

Give us some time, and you will automatically find the plugin on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainers here on Mastodon!
@rupdecat and @johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake-executor-plugin-slurm/issues.

See https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v2.0.2 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* partition cluster selection: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/385

Beep, Beep - I am your friendly #Snakemake release announcement bot.

There is a new release of the Snakemake executor for #SLURM on #HPC systems. Its version now is 2.0.1!

Give us some time, and you will automatically find the plugin on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainers here on Mastodon!
@rupdecat and @johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake-executor-plugin-slurm/issues.

See https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v2.0.1 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* validator check for integers was broken.: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/381

Beep, Beep - I am your friendly #Snakemake release announcement bot.

There is a new release of the Snakemake executor for #SLURM on #HPC systems. Its version now is 2.0.1!

Give us some time, and you will automatically find the plugin on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainers here on Mastodon!
@rupdecat and @johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake-executor-plugin-slurm/issues.

See https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v2.0.1 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* validator check for integers was broken.: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/381

@rupdecat @jannem The #HPC community lost a lot when Slurm failed to implement the DRMAA standard. The API and the code that underpins it are messy as a result. But it was popular and free, so it gained a strong foothold. (Grid Engine was the definitive implementation, and for a while all schedulers supported DRMAA and were interoperable for codes that used it.)

There is support for multiple clusters within a given Slurm instance, but they have to be set up to use these features in advance.

Why? Why are so many admins tinkering with their SLURM setup?

I say tinkering because there are understandable amendments and breaking changes.

A breaking change is when you require developments made on "your" cluster really, really hard to port onto another. When admins do that, they were tinkering with the SLURM source code.

😱😱😱😱😱😱😱😱😱😱😱😱😱😱

#HPC #academicchatter #reproducibleComputing

RE: https://fediscience.org/@snakemake/115611862667755622

Now, this is huge!

Thanks to a contribution from Cade Mirchandani (Santa Cruz, CA), whom I met at this year's #SnakemakeHackathon users can now supply a partition profile. So, instead of wrangling #SLURM partition information into a workflow profile (indicated with --workflow-profile), we can now have a global file to contain this information.

I added a time conversion function, such that the SLURM time format is obeyed, too.

There are several other development needs, before we continue in this direction (e.g. parsing SLURM partition information directly). But a task to be done is summing this up for non-users, e.g. administrators, is due too.

In any case, I think this merits a new major version.

#Snakemake #HPC #ReproducibleComputing

Beep, Beep - I am your friendly #Snakemake release announcement bot.

There is a new release of the Snakemake executor for #SLURM on #HPC systems. Its version now is 2.0.0!

Give us some time, and you will automatically find the plugin on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainers here on Mastodon!
@rupdecat and @johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake-executor-plugin-slurm/issues.

See https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v2.0.0 for details. Here is the header of the changelog:

𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
⚠ 𝐁𝐑𝐄𝐀𝐊𝐈𝐍𝐆 𝐂𝐇𝐀𝐍𝐆𝐄𝐒

* proposal for dynamic partition selection: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/321

𝐅𝐞𝐚𝐭𝐮𝐫𝐞𝐬

* partition time handling: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/378
* proposal for dynamic partition selection: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/321

𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* naming SLURM logs, SLURM logs not just "log files": https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/372

𝐃𝐨𝐜𝐮𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧

* Replace incorrect Markdown with a blockquote: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/377

Virtual SLURM HPC cluster in a Docker Compose

https://github.com/exactlab/vhpc

#HackerNews #Virtual #SLURM #HPC #cluster #Docker #Compose #HPC #Cloud #Computing #OpenSource

Tik tok, the clock is ticking…
Only 10 more days left to submit your talk proposal for the #HPC, Big Data, and Data Science devroom at #FOSDEM’26 !

https://hpc-bigdata-fosdem26.github.io

Same goes for pretty much all of the other devrooms BTW…
See https://fosdem.org/2026/schedule/tracks/