fidopt Interactive view

Learn2Reg 2021, LungCT, validation

Lung CT of one patient at exhale (fixed) and inhale (moving), with manual landmarks (Learn2Reg 2021 Task 2, LungCT, validation).

3 test pairslungsame patientfixed CT, moving CTdelivered aligned
Read before comparing (1)
  • Truth. 81 to 100 manual landmarks a case.

No method has a result on every pair of this dataset yet.

AccuracySmoothnessCost
#MethodTRE mmChangerTRESDlogJFolds %Time sRAM GBGPU GBImages
No registration14.64 ±15.090.0266 ±0.02740.0000.00

TRE: distance between matching landmarks. rTRE: the TRE over the length of the image's diagonal, to compare datasets of other sizes and units. SDlogJ: how irregular the deformation is, 0 is perfectly smooth. Folds: share of the image where the deformation folds over itself.

Scored the way the challenge scores

The same results with the Learn2Reg 2021, LungCT challenge's own measures, on its validation pairs: mean ± standard deviation.

MethodTRESDlogJ
No registration14.641 ± 6.0760.000 ± 0.000

What the challenge published

On the challenge's test set: other pairs than the ones above, and entries trained or tuned for the task. It shows the level of the challenge; these are not results of this benchmark.

MethodTRESDlogJ
No registration10.24
corrField1.750.050
ConvexAdam1.790.060
MEVIS1.680.080
LapIRN1.980.060
PDD-Net2.460.040
LaTIM1.830.050
Lifshitz2.260.070
Imperial1.810.110
PIMed2.340.040
NiftyReg2.700.100
Driver2.660.100
Winter7.410.090
Epicure6.550.070
Multi-brain6.610.080
Gunnarsson9.000.120

Source: Hering et al., Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learning, IEEE TMI 2023, Table VIII.

Pair by pair

TRE mm123
No registration20.1815.608.14

Click a score to look at that result: the fixed image, and over it the moving image after registration, with the annotations. Underlined scores have their image; for the others you see the pair without the result. A green cell gained against no registration on that pair, a red one lost.

About the data

The first test case of Learn2Reg 2021, LungCT, validation
The first test caseClick to look at every case.
Test pairs
The task's 3 official validation pairs are the test cases. The 10 development pairs come from its training pairs 0004 to 0020, scored on its official corrField keypoints (fixed_keypoints.csv), since its manual landmarks are public for the validation pairs only.
Truth
landmarks by experts the challenge's public points
Licence
CC BY 4.0
10 pairs for tuning, never tested

0008_0000_0008_0001, 0017_0000_0017_0001, 0016_0000_0016_0001, 0015_0000_0015_0001, 0007_0000_0007_0001, 0005_0000_0005_0001, 0018_0000_0018_0001, 0014_0000_0014_0001, 0010_0000_0010_0001, 0012_0000_0012_0001