fidoptCHAOS MR, liver, kidneys and spleen
T1-DUAL in-phase or T2-SPIR MR of one patient's upper abdomen, with the liver, kidneys and spleen drawn by hand (CHAOS).
Read before comparing (1)
- Cases. Both images of each CHAOS_MR pair, as delivered: a test pair's images are test cases and a development pair's development cases, so a patient's two series stay in one split.
| Accuracy | Cost | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| # | Method | Dice | Surface Dice | HD95 mm | Time s | RAM GB | GPU GB | Machine | Images |
| 1 | KonfAI segmentation app · MRSegmentator, KonfAI appGPUapp | 0.890 ±0.022 | 0.627 ±0.048 | 9.27 ±1.49 | 4.7 | 5.9 | Workstation | ||
| 2 | KonfAI segmentation app · TotalSegmentator (total_mr), the authors' packageGPUapp | 0.855 ±0.021 | 0.542 ±0.056 | 11.65 ±1.42 | 14.4 | 3.6 | Laptop | ||
| 3 | KonfAI segmentation app · TotalSegmentator (total_mr), KonfAI appGPUapp | 0.847 ±0.022 | 0.522 ±0.055 | 13.07 ±2.86 | 25 | 3.4 | 4.0 | Workstation | |
The order averages each method's ranks on Dice, Surface Dice, HD95 mm, so the first one is not always the best in every column. ± is the 95% interval of the mean over the 20 cases. Two neighbours are tied when a paired Wilcoxon test on the shared cases does not find the upper one better on Dice (5%): the places a method could hold are then shown under its own. The best value of each column is in colour. Click a row to see its images, a column title to sort by it.
Dice: how much the organ contours overlap, 1 is perfect. Surface Dice: the share of the contours' surfaces within a tolerance of each other, 1 is perfect. HD95: distance between the contours' surfaces.
Case by case
Click a score to look at that result: the image, the truth in green and the method's map in red. Underlined scores have their image; for the others you see the case without the result.
About the data
- Truth
- contours by experts the liver, right kidney, left kidney and spleen, drawn by hand on every slice of each sequence by three radiologists and merged by majority vote (the dataset's labels)
- Source
- zenodo.org/records/3431873
chaos.grand-challenge.org/Data
chaos.grand-challenge.org/Rules
doi.org/10.1016/j.media.2020.101950
learn2reg.grand-challenge.org/Learn2Reg2021 - Licence
- CC BY-NC-SA 4.0
20 cases for tuning, never tested
case01/fixed, case01/moving, case02/fixed, case02/moving, case03/fixed, case03/moving, case10/fixed, case10/moving, case31/fixed, case31/moving, case20/fixed, case20/moving, case05/fixed, case05/moving, case19/fixed, case19/moving, case37/fixed, case37/moving, case32/fixed, case32/moving