Skip to content

add crit difference plot#72

Open
likunlan wants to merge 5 commits intomasterfrom
lkl_new_plot
Open

add crit difference plot#72
likunlan wants to merge 5 commits intomasterfrom
lkl_new_plot

Conversation

@likunlan
Copy link
Copy Markdown
Collaborator

add crit difference plot
@alona-sydorova
#49

Copy link
Copy Markdown
Collaborator

@alona-sydorova alona-sydorova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

grafik
leider gibt es auf dem Plot keine critical differences. ich hab es mit createCritDifferencesPlot(mlr.benchmark.example, "measure.mmce.test.mean") wie in deinem Beispiel probiert

@alona-sydorova
Copy link
Copy Markdown
Collaborator

alona-sydorova commented Apr 10, 2018

außerdem funktionieren andere Beispiele (large.benchmark und microbenchmark) gar nicht:
grafik

grafik

@likunlan
Copy link
Copy Markdown
Collaborator Author

likunlan commented Apr 12, 2018

@alona-sydorova
And now we can get a plot with baseline use test="bd"

the mlr::generateCritDifferencesData can not work with length(task.id) <2.
mircrobenchmark only has one task.id(we called problem), so my function also can not work.

the large.benchmark has many replication in a specificed problem. The input of mlr::generateCritDifferencesData do not consider about the replication. So, how to deal with these replication?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants