Skip to content

Have a default simple output and print all metrics only when asked #30

@ipeirotis

Description

@ipeirotis

We seem to have too many metrics being reported now in the summary and in the object-probabilities.

Perhaps we should report only a small fraction of those. I think the following metrics are more than enough:

Categories: 2
Objects in Data Set: 1000
Workers in Data Set: 83
Labels Assigned by Workers: 5000
[Number of labels] Labels per worker: 60.2410
[Gold Tests] Gold tests per worker: 1.8072
DataQuality_Estm_DS_Min
DataQuality_Eval_DS_Min [only when we pass an evaluation file]
WorkerQuality_Estm_DS_Min_n
WorkerQuality_Estm_DS_Min_w
WorkerQuality_Eval_DS_Min_n [only when we pass an evaluation file]
WorkerQuality_Eval_DS_Min_w [only when we pass an evaluation file]

We should similarly limit the number of columns in the results/ (object-probabilities, worker-statistics, etc)

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions