Release 3.2.0 prep: PR #447 review fixes + textexporter migration#449
Release 3.2.0 prep: PR #447 review fixes + textexporter migration#449jonasscheid wants to merge 11 commits intonf-core:devfrom
Conversation
…preset normalization for ArrayList cells, bump snapshot version strings.
…prefix to preserve _exported output suffix.
|
Warning Newer version of the nf-core template is available. Your pipeline is using an old version of the nf-core template: 3.5.1. For more documentation on how to update your pipeline, please see the nf-core documentation and Synchronisation documentation. |
|
@pinin4fjords Ok for you if we proceed with 3.2.0 release and the 3.3.0 release includes the remaining openms tools ported to nf-core? I see even more value in porting the easypqp tools then |
|
I really don't think you should be actively adding to local modules except for highly pipeline-specific stuff. As I mentioned on the release review I wasn't going to push you to migrate existing locals right now, but the four new ones from #447 are different:
What's the major blocker for those going in nf-core/modules first? I do also worry that you've left the CLI override handling in |
I forgot to address this one, sorry about that
The openms fileconverter is a simple addition that I can do. I did not add the pridepy and sdrf_pipelines tool yet to nf-core, since they are in an earlier development phase and subject to more fundamental changes. Pridepy did change the command namings and depricated some quite fast (https://github.com/PRIDE-Archive/pridepy#cli-command-overview) and therefore I thought that we will first test it for some time locally and see if the packages mature well, before we create more overhead with updating and depricating nf-core modules |
…veSearchParams (renamed resolvePresetParams), add regression test, document precedence.
…le to process_low.
…s were deleted; NF 25.04 errors on missing include sources).
…k_max args (NF 25.04 rejects unquoted multi-colon selectors).
…x forbids withName: inside if {}).
…nsensusxml output to .converted in PROCESS_FEATURE.
Description
Release 3.2.0 preparation. Implements review feedback from PR #447 and migrates the local
openms/textexportermodule to itsnf-core/modulesequivalent.Fixed(from PR #447 review)OPENMS_FILECONVERTERversion extraction emitted a SOH byte because the sed backref used\1(single backslash) in Groovy — switched to\\1, matching every other OpenMS module.OPENMS_IDMASSACCURACYmeta.yml was a copy-paste ofopenms_idfilter— rewritten to reflect the actual(meta, mzmls, idxmls) → frag_err + optional prec_errsignature.OPENMS_IDMASSACCURACYconfig readparams.precursor_error_units— changed tometa.precursor_error_unitsso per-sample preset overrides apply.modules/local/openms/idmassaccuracy/main.nfnormalized to spaces.Changedopenms/fileconverter,openms/featurefinderidentification,openms/idconflictresolverlocal modules from OpenMS 3.4.1 → 3.5.0 (containeropenms:3.5.0--h78fb946_0).idmassaccuracystays on 3.4.1 —IDMassAccuracy.cppwas removed in OpenMS 3.5.0.openms/textexporterfrom local → nf-core/modules. The nf-core module drops the_exportedsuffix from the output filename, which collided with the SUMMARIZE_RESULTS input. Injectedext.prefix = { \"\${meta.id}_exported\" }inconf/modules.configto preserve the distinct-filename invariant.utils_nfcore_mhcquant_pipeline/main.nf:135. nf-schema parses empty TSV cells asArrayList [](notnull), so?.trim()threwUnknown method invocation 'trim' on ArrayList type. Replaced with a type-safe check. Also emptied literal single-spaceFixedModscells inassets/search_presets.tsv.-fixed_modificationsafter-variable_modifications" change was flagged as cosmetic but actually changes the CometAdapter CLI: passing-fixed_modifications \(empty value) vs omitting the flag produces different Comet search results (confirmed viasearch_presets.nf.test— peptidoforms shifted). Reverted, keeping the pre-release CLI behavior.tests/sdrf.nf.test→ addedtag \"test_sdrf\"for shard targeting.tests/test_single_quant.nf.test→ renamed tagsingle_replicate→test_single_quantto match profile-name convention.conf/test_single_quant.config→ migrated deprecatedmax_cpus/max_memory/max_timetoprocess.resourceLimits.validateInputSamplesheetfunction fromutils_nfcore_mhcquant_pipeline/main.nf(confirmed no callers).3.2.0dev→3.2.0(vianf-core pipelines bump-version). Snapshotv3.2.0devstrings updated across all 7tests/*.nf.test.snapfiles.Dependenciesopenms(three local modules)PR checklist
nf-core pipelines lint). — 480 passed / 64 warnings (pre-existing subworkflowmeta.ymlmissing) / 0 failures.default.nf.testre-run post-migration also passed (351s). Remaining tests skipped per user request.CHANGELOG.mdis updated.docs/usage.mdis updated. — No user-facing changes.docs/output.mdis updated. — No user-facing changes.README.mdis updated. — No new tools/authors.Follow-up notes
[release name]still inCHANGELOG.md:6— needs filling before tag.openms/psmfeatureextractorcan't be migrated to nf-core/modules without pipeline rework (local takes a secondfeature_fileinput and awks out an-extraflag; upstream takes idxml only).openms/idmassaccuracyhas no viable upstream migration (deprecated in OpenMS 3.5.0+).