Skip to content

Break BlueprintsGraphOutputMapReduce into 2 MapReduce steps #161

@okram

Description

@okram

Map --- write vertices
Reduce -- an identity step
Map -- write edges

The reduce phase may require many few reducers so network isn't congested. Do as many reducers as slots available (non-transaction). Then in the proceeding map-phase, numerous tasks (like writing vertices) and write edges.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions