DetectionEngine.best_model

DetectionEngine.best_model(key='map_50', split='validation')

Which model scored highest on one column.

Parameters

Name Type Description Default
key str The column to rank on. map_50 by default - but on a small dataset read mean_matched_iou first: measured over five seeds on BCCD, average precision has a standard deviation of 0.0159 while matched overlap has 0.0026, six times steadier. How well the boxes fit is reproducible there and how many are found is not, because a borderline cell changing rank moves average precision and leaves the overlap alone. 'map_50'
split str Which data to rank on. 'validation'

Returns

Name Type Description
str The winning model’s name.

Raises

Name Type Description
EngineError If no such column exists - the message lists the ones that do - or if the column is undefined for any model, which happens when a class has no truth boxes in that split and so has no average precision to average.