Skip to content

Expand set of evaluation metrics  #21

@hhegre

Description

@hhegre

Write a function that returns and tabulates/visualizes an expanded set of standard evaluation metrics for the fatality predictions.

The candidates I am considering are:
RMSE based on log(Y+1)
RMSE based on Y
RMSE based on log(Y+c) where c is another constant than 1 (0.1, 0.01, ...)
RMSE for non-zero actuals - based on log(Y+1)
RMSE for zero actuals - based on log(Y+1)
Average precision for predictions collapsed into categories
Some calibration metrics from the prediction competition
Some metrics based on aggregate data (e.g. distance from global mean)

-- if anyone has other suggestions, please shout out. Also, I would like to get hold of some of the presentation code from the prediction competition.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions