Skip to content

Awkward raw_records chunk size #208

@dachengx

Description

@dachengx

Is your feature request related to an issue?

No

Describe the requested feature

For some raw_records with decompressed chunk size awkward, they might raise memory exceed error by chance, like run 050775.

To reproduce, set peaklets_memory in XENON_CONFIG as 14500 (MB):

python3 /home/xudc/outsource/outsource/scripts/submit.py --context xenonnt_offline --xedocs_version global_v16 --image el9.2024.09.1 --run 50775 --local_transfer --ignore_processed

But if you set memory to 16000, there will be no error.

According to @FaroutYLq , when setting the memory requirement to below 15GB we can use more nodes. So this chunk size is awkward.

Describe your (preliminary) solution if there is one

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions