fidopt Interactive view
Lesions and tumours, segmentation

PANORAMA

Contrast-enhanced CT of the upper abdomen of one patient with pancreatic ductal adenocarcinoma, from Radboud University Medical Center or University Medical Center Groningen, the tumour drawn by hand (PANORAMA's public set).

30 test casesabdomenimage CTresearch only
Look at the images
Read before comparing (8)
  • Deposit. The PANORAMA challenge's public training and development set: 2,238 contrast-enhanced CT studies of 2,224 patients, the provider's own from Radboud and Groningen plus 194 decathlon (Task07_Pancreas) and 80 NIH Pancreas-CT patients. 676 studies are PDAC; the reference standard is histopathology, cytology or radiology, per study. The phase is the provider's choice of a contrast-enhanced series, not stated per study.
  • Truth. The labels repository (github.com/DIAGNijmegen/panorama_labels), which the provider calls live and keeps fixing, is pinned to commit bf1d6ba. The lesion is drawn by hand on 482 PDAC studies and is a network's output on the 194 others, as are the veins, arteries, pancreas and ducts on every study. Only the hand-drawn lesion, label 1, is kept. No agreement between readers is given.
  • Pool. Of the 482 manual maps, 97 are decathlon patients and 3 non-PDAC studies with no lesion (100598, 100667, 101632); of one patient's two studies the first is kept. 100028_00001 and 100936_00001 are left out, their CT and map headers disagreeing on the slice spacing (8 against 4.8 mm, 0.754 against 0.5 mm). Fixes listed on the provider's forum need a sign-in and are not seen here.
  • Cases. The ten test tumours drawn first hold 2.2 to 25.6 mL (median 8.0 mL), each in one piece but on 101031_00001. The images are the zips' files as delivered, in Hounsfield units, with slices 0.7 to 3 mm apart; 100419_00001 holds values from -2659 to 15183, from a metal or contrast artefact.
  • Checks. On the 20 cases built first the tumour lies next to or inside the provider's automatic pancreas, and on four test cases axial overlays put a hypodense mass of the pancreas under the mask; the 40 added later pass prepare.py's checks and lie on a pancreatic mass in three planes. TotalSegmentator 2.18's pancreas holds 96% and 98% of two tumours, and 3% of 100065_00001's, at the neck.
  • Tolerance. PDAC is small and poorly defined on CT. The surface Dice is at 5 mm, as on MSD_Pancreas: several test cases have 3 or 4 mm slices, and the border of a pancreatic adenocarcinoma is a reader's call.
  • Outside numbers. None on these cases: the challenge scores detection on its hidden set of about 400 scans. Every study of the pool is public with its mask, so a model trained on PANORAMA's public set has seen the test cases.
  • Overlap. The decathlon and NIH Pancreas-CT patients are left out of the pool since MSD_Pancreas, PancreasCT8 and SAROSBodyCT build some of them; no other descriptor names PANORAMA. CPTACPDALesions is CPTAC's North American cohort, PancreaticCTCBCT Memorial Sloan Kettering's. PICAI holds prostate MR of Radboud and Groningen men: with unrelated ids a patient in both cannot be ruled out, but no image is shared.

No method has a result on every case of this dataset yet.

Case by case

Click a score to look at that result: the image, the truth in green and the method's map in red. Underlined scores have their image; for the others you see the case without the result.

About the data

Test cases
30 test studies drawn with seed 2026 among 379, then 30 development studies, the last of the same seeded order. The pool is the PDAC studies of the provider's own patients with a hand-drawn lesion, the first study of each patient, less two whose CT and map disagree; the decathlon and NIH Pancreas-CT patients are left out. The provider's test set is hidden.
Truth
contours by experts the PDAC lesion (label 1 of the provider's manual maps), drawn in ITK-SNAP 3.8 by one of two trained investigators supervised by a radiologist with over 20 years of pancreatic cancer experience (the labels repository's README); the same maps' veins, arteries, pancreas, pancreatic duct and common bile duct, made by the provider's network, are not kept
Licence
CC BY-NC 4.0 (the four Zenodo records and the labels repository's LICENSE.txt)
30 cases for tuning, never tested

102166_00001, 101857_00001, 101898_00001, 101909_00001, 101253_00001, 100555_00001, 101863_00001, 101128_00001, 100690_00001, 100296_00001, 102206_00001, 100409_00001, 100526_00001, 100050_00001, 100803_00001, 101612_00001, 100931_00001, 100820_00001, 101752_00001, 100790_00001, 102061_00001, 100234_00001, 102033_00001, 100583_00001, 100789_00001, 101800_00001, 100344_00001, 101271_00001, 101316_00001, 100655_00001