Compare Model Results

📘

Preview Feature

Visually Compare Model Results

1. Go to the dataset explorer
2. Toggle Compare Models
3. Select Desired Model runs to compare
4. View results

For example here run #3322 in red appears to have missed quite a number of detections:

How to Add Data

1. Follow the normal pre-label process.
2. Include the keys:
   model_id : string
run_id : string

Diffgram handles the matching based on the model and run.

Annotation Single Example in JSON

Where each dictionary is an annotation.

JSON

{
    "model_id": "resnet",
    "run_id": "1822"
    "type": "box",
    "label_name": "apple",
    "number": null,
    "x_min": 415,
    "y_min": 357,
    "x_max": 706,
    "y_max": 720,
    "filename" : "apples.jpg",
 },

Full Example

You can use this in the Diffgram wizard with the apple file.

JSON

[
  {
    "type": "box",
    "label_name": "apple",
    "frame_number": null,
    "global_frame_number": null,
    "number": null,
    "x_min": 6,
    "y_min": 179,
    "x_max": 328,
    "y_max": 438,
    "lonlat": null,
    "coords": null,
    "radius": null,
    "bounds": null,
    "bounds_lonlat": null,
    "p1": null,
    "p2": null,
    "cp": null,
    "angle": 0.0,
    "filename" : "apples.jpg",
    "interpolated": false,
    "model_id": "resnet",
    "run_id":  "1822"
  },
  {
    "type": "box",
    "label_name": "apple",
    "frame_number": null,
    "global_frame_number": null,
    "number": null,
    "x_min": 301,
    "y_min": 149,
    "x_max": 567,
    "y_max": 408,
    "lonlat": null,
    "coords": null,
    "radius": null,
    "bounds": null,
    "bounds_lonlat": null,
    "p1": null,
    "p2": null,
    "cp": null,
    "angle": 0.0,
    "filename" : "apples.jpg",
    "interpolated": false,
    "model_id": "resnet",
    "run_id": "1822"
  },
  {
    "type": "box",
    "label_name": "apple",
    "frame_number": null,
    "global_frame_number": null,
    "number": null,
    "x_min": 484,
    "y_min": 100,
    "x_max": 719,
    "y_max": 297,
    "lonlat": null,
    "coords": null,
    "radius": null,
    "bounds": null,
    "bounds_lonlat": null,
    "p1": null,
    "p2": null,
    "cp": null,
    "angle": 0.0,
    "filename" : "apples.jpg",
    "interpolated": false,
    "model_id": "another",
    "run_id": "3322"
  },
  {
    "type": "box",
    "label_name": "apple",
    "frame_number": null,
    "global_frame_number": null,
    "number": null,
    "x_min": 43,
    "y_min": 375,
    "x_max": 368,
    "y_max": 700,
    "lonlat": null,
    "coords": null,
    "radius": null,
    "bounds": null,
    "bounds_lonlat": null,
    "p1": null,
    "p2": null,
    "cp": null,
    "angle": 0.0,
    "filename" : "apples.jpg",
    "interpolated": false,
    "model_id": "another",
    "run_id": "3322"
  },
  {
    "type": "box",
    "label_name": "apple",
    "frame_number": null,
    "global_frame_number": null,
    "number": null,
    "x_min": 549,
    "y_min": 232,
    "x_max": 873,
    "y_max": 512,
    "lonlat": null,
    "coords": null,
    "radius": null,
    "bounds": null,
    "bounds_lonlat": null,
    "p1": null,
    "p2": null,
    "cp": null,
    "angle": 0.0,
    "filename" : "apples.jpg",
    "interpolated": false,
    "model_id": "resnet",
    "run_id": "1822"
  },
  {
    "type": "box",
    "label_name": "apple",
    "frame_number": null,
    "global_frame_number": null,
    "number": null,
    "x_min": 373,
    "y_min": 335,
    "x_max": 691,
    "y_max": 704,
    "lonlat": null,
    "coords": null,
    "radius": null,
    "bounds": null,
    "bounds_lonlat": null,
    "p1": null,
    "p2": null,
    "cp": null,
    "angle": 0.0,
    "filename" : "apples.jpg",
    "interpolated": false,
    "model_id": "resnet",
    "run_id": "1822"
  },
  {
    "type": "box",
    "label_name": "apple",
    "frame_number": null,
    "global_frame_number": null,
    "number": null,
    "x_min": 415,
    "y_min": 357,
    "x_max": 706,
    "y_max": 720,
    "lonlat": null,
    "coords": null,
    "radius": null,
    "bounds": null,
    "bounds_lonlat": null,
    "p1": null,
    "p2": null,
    "cp": null,
    "angle": 0.0,
    "filename" : "apples.jpg",
    "interpolated": false,
    "model_id": "resnet",
    "run_id": "1822"
  },
  {
    "type": "box",
    "label_name": "apple",
    "frame_number": null,
    "global_frame_number": null,
    "number": null,
    "x_min": 742,
    "y_min": 347,
    "x_max": 1056,
    "y_max": 684,
    "lonlat": null,
    "coords": null,
    "radius": null,
    "bounds": null,
    "bounds_lonlat": null,
    "p1": null,
    "p2": null,
    "cp": null,
    "angle": 0.0,
    "filename" : "apples.jpg",
    "interpolated": false,
    "model_id": "resnet",
    "run_id": "1822"
  },
  {
    "type": "box",
    "label_name": "apple",
    "frame_number": null,
    "global_frame_number": null,
    "number": null,
    "x_min": 863,
    "y_min": 180,
    "x_max": 1193,
    "y_max": 534,
    "lonlat": null,
    "coords": null,
    "radius": null,
    "bounds": null,
    "bounds_lonlat": null,
    "p1": null,
    "p2": null,
    "cp": null,
    "angle": 0.0,
    "filename" : "apples.jpg",
    "interpolated": false,
    "model_id": "resnet",
    "run_id": "1822"
  }
    ]