Pancreatic-CT-CBCT-SEG, bowel on the planning CT

Breath-hold planning CT of one patient treated for pancreatic cancer, with the stomach and duodenum and the small bowel contoured by radiation oncologists.

10 test casesabdomenimage CT

Look at the images

Read before comparing (1)

Cases. The planning CTs, the fixed images of PancreaticCTCBCT's pairs: a test pair's image is a test case, a development pair's a development case.

		Accuracy			Cost
#	Method	Dice	Surface Dice	HD95 mm	Time s	RAM GB	GPU GB	Machine	Images
11–3	KonfAI segmentation app · MRSegmentator, KonfAI appGPUapp1 of 2 structures	0.072 ±0.036	0.046 ±0.028	96.70 ±22.70	54	24.6	8.1	Workstation
21–3	KonfAI segmentation app · TotalSegmentator (total), the authors' packageGPUapp1 of 2 structures	0.074 ±0.041	0.043 ±0.027	97.82 ±22.44		17.8	6.9	Workstation
31–3	KonfAI segmentation app · TotalSegmentator (total), KonfAI appGPUapp1 of 2 structures	0.073 ±0.040	0.042 ±0.027	97.59 ±22.48		11.0	5.6	Workstation
4	MONAI wholeBody CTGPUapp1 of 2 structures1 failed	0.060 ±0.041	0.041 ±0.030	95.91 ±24.70	14	3.0	17.1	Laptop

The order averages each method's ranks on Dice, Surface Dice, HD95 mm, so the first one is not always the best in every column. ± is the 95% interval of the mean over the 10 cases. Two neighbours are tied when a paired Wilcoxon test on the shared cases does not find the upper one better on Dice (5%): the places a method could hold are then shown under its own. The best value of each column is in colour. Click a row to see its images, a column title to sort by it.

1 result not ranked: an older run, cases still missing, or a failure on every case

		Accuracy			Cost
#	Method	Dice	Surface Dice	HD95 mm	Time s	RAM GB	GPU GB	Machine	Images
	MONAI wholeBody CTGPUapp1 of 2 structuresfailed on every case	0.000 ±0.000	0.000 ±0.000					Workstation

Dice: how much the organ contours overlap, 1 is perfect. Surface Dice: the share of the contours' surfaces within a tolerance of each other, 1 is perfect. HD95: distance between the contours' surfaces.

Case by case

Measure

Dice	1	2	3	4	5	6	7	8	9	10
KonfAI segmentation app · MRSegmentator, KonfAI app	0.024	0.056	0.046	0.001	0.076	0.058	0.052	0.009	0.006	0.034
KonfAI segmentation app · TotalSegmentator (total), the authors' package	0.024	0.050	0.043	0.001	0.093	0.058	0.056	0.009	0.005	0.033
KonfAI segmentation app · TotalSegmentator (total), KonfAI app	0.023	0.048	0.042	0.001	0.089	0.059	0.056	0.009	0.006	0.033
MONAI wholeBody CT	0.021	0.051	0.042	0.000	0.081	0.058	0.044	0.000	0.004	failed

Click a score to look at that result: the image, the truth in green and the method's map in red. Underlined scores have their image; for the others you see the case without the result.

About the data

The first test caseClick to look at every case.

Truth: contours by experts the stomach with the first two segments of the duodenum (1) and the rest of the small bowel (2), contoured on both images by radiation oncologists and reviewed by two medical physicists, cut to the volume of interest
Source: www.cancerimagingarchive.net/collection/pancreatic-ct-cbct-seg
doi.org/10.7937/TCIA.ESHQ-4D90
doi.org/10.1002/mp.14906
Licence: CC BY 4.0

10 cases for tuning, never tested

Pancreas-CT-CB_001/fixed, Pancreas-CT-CB_002/fixed, Pancreas-CT-CB_003/fixed, Pancreas-CT-CB_030/fixed, Pancreas-CT-CB_008/fixed, Pancreas-CT-CB_038/fixed, Pancreas-CT-CB_007/fixed, Pancreas-CT-CB_023/fixed, Pancreas-CT-CB_010/fixed, Pancreas-CT-CB_018/fixed