fidoptOAIZIB-CM, knee bones and cartilage
Sagittal 3D DESS MR of the right knee of one adult of the Osteoarthritis Initiative, with the femur, the tibia and their cartilage labelled (OAIZIB-CM).
Read before comparing (1)
- Cases. The fixed MR of each KneeMR pair with its corrected labels, so the test and development subjects stay KneeMR's, apart. The pair's other MR stays on its native grid for the registration task.
| Accuracy | Cost | |||||||
|---|---|---|---|---|---|---|---|---|
| # | Method | Dice | Surface Dice | HD95 mm | Time s | RAM GB | GPU GB | Images |
| 1 | KonfAI segmentation app · TotalSegmentator (total_mr), KonfAI appGPUapp1 of 5 structures | 0.926 ±0.006 | 0.609 ±0.024 | 4.39 ±0.76 | 22 | 2.2 | 2.5 | |
| 2 | KonfAI segmentation app · TotalSegmentator (total_mr), the authors' packageGPUapp1 of 5 structures | 0.918 ±0.007 | 0.542 ±0.024 | 5.12 ±0.99 | 22 | 11.5 | 2.4 | |
| 3 | KonfAI segmentation app · MRSegmentator, KonfAI appGPUapp1 of 5 structures | 0.000 ±0.000 | 0.000 ±0.000 | 2.5 | 7.0 | |||
The order averages each method's ranks on Dice, Surface Dice, HD95 mm, so the first one is not always the best in every column. ± is the 95% interval of the mean over the 25 cases. Two neighbours are tied when a paired Wilcoxon test on the shared cases does not find the upper one better on Dice (5%): the places a method could hold are then shown under its own. The best value of each column is in colour. Click a row to see its images, a column title to sort by it. Time and memory measured on Workstation.
1 result not ranked: an older run, cases still missing, or a failure on every case
| Accuracy | Cost | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| # | Method | Dice | Surface Dice | HD95 mm | Time s | RAM GB | GPU GB | Machine | Images |
| KonfAI segmentation app · TotalSegmentator (total_mr), KonfAI appGPUapp1 of 5 structuresolder run | 0.926 ±0.006 | 0.609 ±0.024 | 4.39 ±0.76 | 5 | 2.1 | 3.2 | Laptop | ||
Dice: how much the organ contours overlap, 1 is perfect. Surface Dice: the share of the contours' surfaces within a tolerance of each other, 1 is perfect. HD95: distance between the contours' surfaces.
Case by case
Click a score to look at that result: the image, the truth in green and the method's map in red. Underlined scores have their image; for the others you see the case without the result.
About the data
- Truth
- contours by experts the dataset's labels: femur, femoral cartilage, tibia, medial and lateral tibial cartilage (OAI-ZIB's labels, the tibial cartilage split in two by a script)
- Source
- huggingface.co/datasets/YongchengYAO/OAIZIB-CM
zenodo.org/records/14934086
doi.org/10.1016/j.media.2018.11.009
doi.org/10.12752/4.ATEZ.1.0
doi.org/10.1016/j.media.2023.103035
github.com/YongchengYAO/CartiMorph
nda.nih.gov/oai - Licence
- CC BY-NC 4.0, over OAI images (the OAI's data use agreement) and ZIB segmentations for scientific use only
22 cases for tuning, never tested
241_261/fixed, 474_167/fixed, 266_313/fixed, 156_357/fixed, 274_050/fixed, 082_084/fixed, 119_228/fixed, 132_321/fixed, 113_419/fixed, 222_092/fixed, 311_272/fixed, 037_008/fixed, 103_362/fixed, 415_464/fixed, 329_169/fixed, 288_421/fixed, 359_055/fixed, 198_192/fixed, 136_067/fixed, 314_206/fixed, 041_005/fixed, 501_086/fixed