-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Description
Create a benchmarking module to evaluate DAG representations and downstream applications. Requirements:
- Structural integrity checks (acyclicity, edge ordering, schema conformance).
- Annotation consistency evaluations (F1, Cohen's kappa).
- Retrieval accuracy benchmarking (Precision@k, MRR).
- Predictive modeling evaluations comparing DAG-based datasets against linear narratives.'
Anything we can benchmark against?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels