Learn2Reg 2021, LungCT, validation
Lung CT of one patient at exhale (fixed) and inhale (moving), with manual landmarks (Learn2Reg 2021 Task 2, LungCT, validation).
Read before comparing (1)
- Truth. 81 to 100 manual landmarks a case.
No method has a result on every pair of this dataset yet.
| Accuracy | Smoothness | Cost | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| # | Method | TRE mm | Change | rTRE | SDlogJ | Folds % | Time s | RAM GB | GPU GB | Images |
| No registration | 14.64 ±15.09 | 0.0266 ±0.0274 | 0.000 | 0.00 | ||||||
TRE: distance between matching landmarks. rTRE: the TRE over the length of the image's diagonal, to compare datasets of other sizes and units. SDlogJ: how irregular the deformation is, 0 is perfectly smooth. Folds: share of the image where the deformation folds over itself.
Scored the way the challenge scores
The same results with the Learn2Reg 2021, LungCT challenge's own measures, on its validation pairs: mean ± standard deviation.
| Method | TRE | SDlogJ |
|---|---|---|
| No registration | 14.641 ± 6.076 | 0.000 ± 0.000 |
What the challenge published
On the challenge's test set: other pairs than the ones above, and entries trained or tuned for the task. It shows the level of the challenge; these are not results of this benchmark.
| Method | TRE | SDlogJ |
|---|---|---|
| No registration | 10.24 | |
| corrField | 1.75 | 0.050 |
| ConvexAdam | 1.79 | 0.060 |
| MEVIS | 1.68 | 0.080 |
| LapIRN | 1.98 | 0.060 |
| PDD-Net | 2.46 | 0.040 |
| LaTIM | 1.83 | 0.050 |
| Lifshitz | 2.26 | 0.070 |
| Imperial | 1.81 | 0.110 |
| PIMed | 2.34 | 0.040 |
| NiftyReg | 2.70 | 0.100 |
| Driver | 2.66 | 0.100 |
| Winter | 7.41 | 0.090 |
| Epicure | 6.55 | 0.070 |
| Multi-brain | 6.61 | 0.080 |
| Gunnarsson | 9.00 | 0.120 |
Pair by pair
Click a score to look at that result: the fixed image, and over it the moving image after registration, with the annotations. Underlined scores have their image; for the others you see the pair without the result. A green cell gained against no registration on that pair, a red one lost.
About the data
- Test pairs
- The task's 3 official validation pairs are the test cases. The 10 development pairs come from its training pairs 0004 to 0020, scored on its official corrField keypoints (fixed_keypoints.csv), since its manual landmarks are public for the validation pairs only.
- Truth
- landmarks by experts the challenge's public points
- Licence
- CC BY 4.0
10 pairs for tuning, never tested
0008_0000_0008_0001, 0017_0000_0017_0001, 0016_0000_0016_0001, 0015_0000_0015_0001, 0007_0000_0007_0001, 0005_0000_0005_0001, 0018_0000_0018_0001, 0014_0000_0014_0001, 0010_0000_0010_0001, 0012_0000_0012_0001