AMOS MR, abdominal organs

Abdominal MR of one patient with the AMOS annotations of its organs (AMOS 2022, MR part).

10 test casesabdomenimage MR

Read before comparing (2)

Cases. The fixed images of AMOS_MRMR's pairs: a test pair's image is a test case, a development pair's a development case. The moving images are left out: their headers carry the pair's start, so they are not the images as delivered.
Intensities. The MR intensities have no common scale: the paper gives median intensities from 845 to 57422 depending on the scanner (its table 9), and the files are 16-bit integers or floats.

		Accuracy			Cost
#	Method	Dice	Surface Dice	HD95 mm	Time s	RAM GB	GPU GB	Images
11–2	KonfAI segmentation app · TotalSegmentator (total_mr), KonfAI appGPUapp	0.721 ±0.075	0.474 ±0.080	10.64 ±2.83	6	2.2	7.2
21–2	KonfAI segmentation app · TotalSegmentator (total_mr), the authors' packageGPUapp	0.718 ±0.079	0.477 ±0.082	10.67 ±2.25		18.1	3.6
3	KonfAI segmentation app · MRSegmentator, KonfAI appGPUapp14 of 15 structures	0.003 ±0.005	0.001 ±0.002	175.04 ±19.39	14	2.5	8.8

The order averages each method's ranks on Dice, Surface Dice, HD95 mm, so the first one is not always the best in every column. ± is the 95% interval of the mean over the 10 cases. Two neighbours are tied when a paired Wilcoxon test on the shared cases does not find the upper one better on Dice (5%): the places a method could hold are then shown under its own. The best value of each column is in colour. Click a row to see its images, a column title to sort by it. Time and memory measured on Laptop.

Dice: how much the organ contours overlap, 1 is perfect. Surface Dice: the share of the contours' surfaces within a tolerance of each other, 1 is perfect. HD95: distance between the contours' surfaces.

Case by case

Measure

Dice	1	2	3	4	5	6	7	8	9	10
KonfAI segmentation app · TotalSegmentator (total_mr), KonfAI app	0.691	0.704	0.480	0.807	0.716	0.722	0.812	0.643	0.800	0.832
KonfAI segmentation app · TotalSegmentator (total_mr), the authors' package	0.699	0.704	0.460	0.815	0.703	0.708	0.807	0.646	0.803	0.835
KonfAI segmentation app · MRSegmentator, KonfAI app	0.000	0.000	0.000	0.000	0.000	0.000	0.021	0.005	0.000	0.001

Click a score to look at that result: the image, the truth in green and the method's map in red. Underlined scores have their image; for the others you see the case without the result.

About the data

The first test caseClick to look at every case.

Truth: contours by experts the dataset's annotations of 15 organs, of which the MR scans hold 13 (12 or 13 in both scans of a pair)
Source: zenodo.org/records/7262581
arxiv.org/abs/2206.08023
Licence: CC BY 4.0

10 cases for tuning, never tested

pair_0581_0570/fixed, pair_0595_0548/fixed, pair_0592_0563/fixed, pair_0557_0553/fixed, pair_0589_0550/fixed, pair_0585_0559/fixed, pair_0551_0544/fixed, pair_0549_0554/fixed, pair_0573_0588/fixed, pair_0555_0517/fixed