Refuses to rank on loss when the models were not trained on the same one. Two losses are two different scales: a Focal-Tversky of 0.05 is not better than a CCE-Dice of 0.14, it is not even the same question. Metrics are comparable because they measure the mask, not the objective.
Parameters
Name
Type
Description
Default
key
str
Which column to rank on.
'dice'
split
str
Which data to rank on.
'validation'
Returns
Name
Type
Description
str
The winning model’s name.
Raises
Name
Type
Description
EngineError
If there is no such column; the message lists the ones there are.