Skip to content

Improve parallel io performance #71

@manodeep

Description

@manodeep

When io_layout is set to 1,1 - the output becomes serialised and a bottleneck for ESM1.6 throughput. Changing to parallel io with io_layout of say 8,5 removes that bottleneck (and improves ESM1.6 throughput by 10%); however, then results in (rare/somewhat frequent) collation failures. Opening the issue here to make the connection to the underlying model - this is the tracking issue in ESM1.6-configs.

Long-term option could be investigate how to properly switch to PIO (where there is previous work done by Marshall and Rui).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions