fidoptSynthRAD2023 CBCT/CT, pelvis
CT (fixed) and CBCT (moving) of the pelvis of one patient (SynthRAD2023, Task 2).
Read before comparing (3)
- Labels. TotalSegmentator, through its KonfAI app at a pinned revision, makes every case's labels: a method that registers on that network's features is scored against its own view of the anatomy.
- Mask. The challenge's body mask, the same for both images.
- Baseline. The pair is used as the challenge delivers it, rigidly aligned. With no registration the 18 test pairs score a label Dice of 0.44 (0.15 to 0.74).
| Accuracy | Smoothness | Cost | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| # | Method | Dice | Change | HD95 mm | SDlogJ | Folds % | Time s | RAM GB | GPU GB | Images |
| 1 | greedyCPUapp | 0.506 ±0.091 | +0.061 | 39.80 ±10.98 | 0.053 | 0.00 | 25 | 2.1 | ||
| No registration | 0.445 ±0.105 | 41.65 ±11.12 | 0.000 | 0.00 | ||||||
The order averages each method's ranks on Dice, HD95 mm, SDlogJ, so the first one is not always the best in every column. ± is the 95% interval of the mean over the 18 pairs. Two neighbours are tied when a paired Wilcoxon test on the shared pairs does not find the upper one better on Dice (5%): the places a method could hold are then shown under its own. The best value of each column is in colour. Click a row to see its images, a column title to sort by it. Time and memory measured on Laptop.
2 results not ranked: an older run, pairs still missing, or a failure on every pair
| Accuracy | Smoothness | Cost | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| # | Method | Dice | Change | HD95 mm | SDlogJ | Folds % | Time s | RAM GB | GPU GB | Machine | Images |
| ConvexAdam (MIND)GPUapp8/18 pairs | 0.529 ±0.147 | +0.084 | 36.97 ±19.87 | 0.118 | 1.52 | 6 | 2.6 | 2.9 | Laptop | ||
| NiftyRegCPUapp8/18 pairs | 0.410 ±0.188 | −0.035 | 41.96 ±21.71 | 0.036 | 0.06 | 35 | 1.1 | Laptop | |||
Dice: how much the organ contours overlap, 1 is perfect. HD95: distance between the contours' surfaces. SDlogJ: how irregular the deformation is, 0 is perfectly smooth. Folds: share of the image where the deformation folds over itself.
Pair by pair
Click a score to look at that result: the fixed image, and over it the moving image after registration, with the annotations. Underlined scores have their image; for the others you see the pair without the result. A green cell gained against no registration on that pair, a red one lost.
About the data
- Test pairs
- 18 test patients (10% of the 180 training patients) and 16 development patients (10% of those left), one case a patient and none in both, chosen before any result, centres 2PA, 2PB and 2PC alternated. The test list takes each centre's consecutive patients in ascending order from 2PA004, 2PB067 and 2PC002, development patients skipped. The development list holds 2PA's first three, six others, 2PA's and 2PB's last two and 2PC's last three.
- Truth
- contours by a program TotalSegmentator through its KonfAI app (VBoussot/TotalSegmentator-KonfAI, revision 07185697, konfai-apps of KonfAI 1.8.7), run by us on each image with one recipe (synthrad.py): task total on the CT and on the CBCT
- Licence
- CC BY-NC 4.0
16 pairs for tuning, never tested
pelvis_2PA001, pelvis_2PA002, pelvis_2PA003, pelvis_2PA056, pelvis_2PB076, pelvis_2PB081, pelvis_2PB050, pelvis_2PC034, pelvis_2PC027, pelvis_2PC097, pelvis_2PA095, pelvis_2PB129, pelvis_2PC098, pelvis_2PA092, pelvis_2PB126, pelvis_2PC096