vismatch matchers

2D feature matchers run by vismatch, each with its authors' code and weights, the homography from the fixed image to the moving one fitted by OpenCV's MAGSAC: the variant names the matcher.

RegistrationGPUversion vismatch 1.4.0 (PyPI), weights checked by SHA-256 (setup.sh)every datasetBSD-3-Clause

Source

Run it

Its KonfAI app is not published yet.

Where it works

Its place on each kind of problem it has results on, among the methods ranked there. A method that leads one problem can trail another: read the one closest to yours.

Problem	matcher	Place	Ranked	Datasets
Retina photographs (2D), same eye	RoMa	1	of 6	2 of 2
Radiographs (2D), inter-patient	RoMa	1	of 6	2 of 2
Photographs of a planar scene (2D), ranked apart	ALIKED + LightGlue	1	of 6	1 of 1
Photographs of a planar scene (2D), ranked apart	RoMa	1	of 6	1 of 1
Photographs of a planar scene (2D), ranked apart	SIFT + LightGlue	1	of 6	1 of 1
Histology serial sections (2D), same block	ALIKED + LightGlue	1	of 6	1 of 1
Histology serial sections (2D), same block	SIFT + LightGlue	1	of 6	1 of 1
Drone to crewed aerial photographs	RoMa	1	of 6	1 of 1
Serial EM, known in-plane deformation	LoFTR	1	of 6	1 of 1
Serial EM, known in-plane deformation	RoMa	1	of 6	1 of 1
Retina photographs (2D), same eye	DISK + LightGlue	2	of 6	2 of 2
Radiographs (2D), inter-patient	LoFTR	2	of 6	2 of 2
Drone to crewed aerial photographs	ALIKED + LightGlue	2	of 6	1 of 1
Drone to crewed aerial photographs	LoFTR	2	of 6	1 of 1
Drone to crewed aerial photographs	SIFT + LightGlue	2	of 6	1 of 1
Retina photographs (2D), same eye	LoFTR	3	of 6	2 of 2
Radiographs (2D), inter-patient	SIFT + LightGlue	3	of 6	2 of 2
Histology serial sections (2D), same block	LoFTR	3	of 6	1 of 1
Histology serial sections (2D), same block	RoMa	3	of 6	1 of 1
Histology serial sections (2D), same block	XFeat	3	of 6	1 of 1
Serial EM, known in-plane deformation	XFeat	3	of 6	1 of 1
Retina photographs (2D), same eye	SIFT + LightGlue	4	of 6	2 of 2
Radiographs (2D), inter-patient	ALIKED + LightGlue	4	of 6	2 of 2
Photographs of a planar scene (2D), ranked apart	DISK + LightGlue	4	of 6	1 of 1
Serial EM, known in-plane deformation	ALIKED + LightGlue	4	of 6	1 of 1
Serial EM, known in-plane deformation	SIFT + LightGlue	4	of 6	1 of 1
Retina photographs (2D), same eye	XFeat	5	of 6	2 of 2
Radiographs (2D), inter-patient	DISK + LightGlue	5	of 6	2 of 2
Photographs of a planar scene (2D), ranked apart	XFeat	5	of 6	1 of 1
Drone to crewed aerial photographs	XFeat	5	of 6	1 of 1
Retina photographs (2D), same eye	ALIKED + LightGlue	6	of 6	2 of 2
Radiographs (2D), inter-patient	XFeat	6	of 6	2 of 2
Photographs of a planar scene (2D), ranked apart	LoFTR	6	of 6	1 of 1
Histology serial sections (2D), same block	DISK + LightGlue	6	of 6	1 of 1
Drone to crewed aerial photographs	DISK + LightGlue	6	of 6	1 of 1
Serial EM, known in-plane deformation	DISK + LightGlue	6	of 6	1 of 1

Results

Dataset	matcher	#	Read by	Score	Change	SDlogJ	Failed	Time s
Aariz cephalograms	LoFTR	1	TRE mm	7.87	−4.73	0.038	0	5
Aariz cephalograms	RoMa	1	TRE mm	7.89	−4.72	0.026	0	15
Aariz cephalograms	ALIKED + LightGlue	3	TRE mm	11.59	−1.02	0.067	0	4
Aariz cephalograms	SIFT + LightGlue	4	TRE mm	11.76	−0.85	0.106	0	4
Aariz cephalograms	XFeat	8	TRE mm	16.92	+4.32	0.583	0	4
Aariz cephalograms	DISK + LightGlue	9	TRE mm	142.31	+129.70	1.164	0	4
CAMUS	RoMa	1	Dice	0.758	+0.033	0.014	0	12
CAMUS	LoFTR	2	Dice	0.726	+0.001	0.002	0	3
CAMUS	XFeat	2	Dice	0.741	+0.016	0.019	0	3
CAMUS	SIFT + LightGlue	4	Dice	0.713	−0.012	0.027	0	3
CAMUS	DISK + LightGlue	5	Dice	0.680	−0.045	0.073	0	3
CAMUS	ALIKED + LightGlue	6	Dice	0.663	−0.062	0.096	0	3
COph100	RoMa	1	TRE px	5.58	−38.74	0.015	0	12
COph100	XFeat	2	TRE px	5.49	−38.83	0.026	0	3
COph100	LoFTR	3	TRE px	16.47	−27.85	0.008	0	3
COph100	DISK + LightGlue	4	TRE px	8.42	−35.91	0.018	0	3
COph100	SIFT + LightGlue	5	TRE px	7.85	−36.48	0.046	0	3
COph100	ALIKED + LightGlue	6	TRE px	32.65	−11.68	0.640	0	3
CRASAR-U-DROIDs, drone and crewed aerial registration	RoMa	1	TRE m	2.21		0.001	0	15
CRASAR-U-DROIDs, drone and crewed aerial registration	ALIKED + LightGlue	2	TRE m	2.16		0.001	0	5
CRASAR-U-DROIDs, drone and crewed aerial registration	LoFTR	2	TRE m	2.46		0.000	0	6
CRASAR-U-DROIDs, drone and crewed aerial registration	SIFT + LightGlue	2	TRE m	2.16		0.001	0	5
CRASAR-U-DROIDs, drone and crewed aerial registration	XFeat	5	TRE m	3.29		0.001	0	5
CRASAR-U-DROIDs, drone and crewed aerial registration	DISK + LightGlue	6	TRE m	2.29		0.001	0	5
CSXA cervical radiographs	RoMa	1	TRE mm	8.28	−5.65	0.061	0	12
CSXA cervical radiographs	DISK + LightGlue	2	TRE mm	8.27	−5.66	0.361	3	3
CSXA cervical radiographs	SIFT + LightGlue	3	TRE mm	13.38	−0.55	0.225	3	3
CSXA cervical radiographs	LoFTR	4	TRE mm	24.98	+11.05	0.322	0	3
CSXA cervical radiographs	XFeat	4	TRE mm	12.82	−1.11	0.668	0	3
CSXA cervical radiographs	ALIKED + LightGlue	6	TRE mm	32.15	+18.22	1.021	0	3
FIMD	DISK + LightGlue	1	TRE px	8.12	−498.16	0.003	0	5
FIMD	RoMa	1	TRE px	6.61	−499.67	0.003	0	10
FIMD	LoFTR	3	TRE px	9.68	−496.60	0.003	0	6
FIMD	SIFT + LightGlue	3	TRE px	7.67	−498.61	0.003	0	5
FIMD	ALIKED + LightGlue	5	TRE px	9.53	−496.75	0.003	0	5
FIMD	XFeat	6	TRE px	225.23	−281.05	0.722	0	5
FIRE	RoMa	1	TRE px	8.24	−440.02	0.011	0	11
FIRE	XFeat	2	TRE px	12.96	−435.30	0.013	0	5
FIRE	DISK + LightGlue	3	TRE px	13.20	−435.07	0.017	0	5
FIRE	SIFT + LightGlue	3	TRE px	13.82	−434.44	0.015	0	5
FIRE	ALIKED + LightGlue	5	TRE px	26.59	−421.67	0.032	0	5
FIRE	LoFTR		TRE px	448.27	=	0.000	10
HPatches	ALIKED + LightGlue	1	TRE px	0.86	−222.10	0.282	0	3
HPatches	RoMa	1	TRE px	0.97	−221.98	0.282	0	8
HPatches	SIFT + LightGlue	1	TRE px	0.76	−222.20	0.282	0	3
HPatches	DISK + LightGlue	4	TRE px	1.01	−221.95	0.282	0	4
HPatches	XFeat	5	TRE px	1.43	−221.52	0.287	0	3
HPatches	LoFTR	6	TRE px	1.54	−221.42	0.288	0	3
Serial sections, mouse prostate and liver (Kartasalo 2018)	ALIKED + LightGlue	1	TRE µm	38.11	−29.70	0.008	0	5
Serial sections, mouse prostate and liver (Kartasalo 2018)	SIFT + LightGlue	1	TRE µm	35.51	−32.29	0.013	0	4
Serial sections, mouse prostate and liver (Kartasalo 2018)	LoFTR	3	TRE µm	42.40	−25.40	0.006	0	5
Serial sections, mouse prostate and liver (Kartasalo 2018)	RoMa	3	TRE µm	40.67	−27.13	0.008	0	9
Serial sections, mouse prostate and liver (Kartasalo 2018)	XFeat	3	TRE µm	33.53	−34.27	0.020	0	4
Serial sections, mouse prostate and liver (Kartasalo 2018)	DISK + LightGlue	6	TRE µm	39.34	−28.46	0.014	0	5
MSU-PID	XFeat	1	Dice	0.624	+0.040	0.044	0	3
MSU-PID	RoMa	2	Dice	0.618	+0.034	0.015	0	7
MSU-PID	LoFTR	3	Dice	0.604	+0.020	0.024	0	3
MSU-PID	ALIKED + LightGlue	4	Dice	0.454	−0.130	0.590	0	3
MSU-PID	SIFT + LightGlue	5	Dice	0.394	−0.189	1.259	0	3
MSU-PID	DISK + LightGlue	6	Dice	0.278	−0.306	5.673	1	3
SNEMI3D sections, known in-plane deformation	LoFTR	1	TRE px	5.48		0.002	0	4
SNEMI3D sections, known in-plane deformation	RoMa	1	TRE px	5.55		0.001	0	8
SNEMI3D sections, known in-plane deformation	XFeat	3	TRE px	5.59		0.003	0	3
SNEMI3D sections, known in-plane deformation	ALIKED + LightGlue	4	TRE px	5.64		0.003	0	3
SNEMI3D sections, known in-plane deformation	SIFT + LightGlue	4	TRE px	5.81		0.003	0	3
SNEMI3D sections, known in-plane deformation	DISK + LightGlue	6	TRE px	5.90		0.004	0	3
TrackRAD2025, two frames of a sagittal cine MR sequence	ALIKED + LightGlue	4	Dice	0.629	+0.094	0.025	0	4
TrackRAD2025, two frames of a sagittal cine MR sequence	DISK + LightGlue	6	Dice	0.624	+0.089	0.009	0	3
TrackRAD2025, two frames of a sagittal cine MR sequence	SIFT + LightGlue	7	Dice	0.616	+0.081	0.008	0	4
TrackRAD2025, two frames of a sagittal cine MR sequence	RoMa	8	Dice	0.581	+0.046	0.006	0	8
TrackRAD2025, two frames of a sagittal cine MR sequence	XFeat	9	Dice	0.561	+0.026	0.006	0	4
TrackRAD2025, two frames of a sagittal cine MR sequence	LoFTR	10	Dice	0.546	+0.012	0.002	0	3
UVDoc, measured paper geometry with rendered document texture	LoFTR	1	TRE px	11.73	−357.78	0.020	0	4
UVDoc, measured paper geometry with rendered document texture	ALIKED + LightGlue	2	TRE px	9.94	−359.58	0.021	0	4
UVDoc, measured paper geometry with rendered document texture	SIFT + LightGlue	2	TRE px	13.73	−355.79	0.020	0	4
UVDoc, measured paper geometry with rendered document texture	DISK + LightGlue	4	TRE px	14.28	−355.24	0.021	0	4
UVDoc, measured paper geometry with rendered document texture	RoMa	4	TRE px	12.40	−357.12	0.021	0	8
UVDoc, measured paper geometry with rendered document texture	XFeat	6	TRE px	23.32	−346.19	0.027	0	3
WxBS	DISK + LightGlue	1	TRE px	74.89	−103.59	0.870	1	3
WxBS	LoFTR	2	TRE px	83.05	−95.43	1.151	0	3
WxBS	RoMa	2	TRE px	30.38	−148.09	1.896	0	8
WxBS	SIFT + LightGlue	6	TRE px	173.92	−4.56	1.390	5	3
WxBS	XFeat	7	TRE px	211.71	+33.23	2.078	0	3
WxBS	ALIKED + LightGlue	8	TRE px	288.83	+110.36	2.705	0	3

Source: github.com/gmberton/vismatch/tree/v1.4.0
Reference: Berton, Stoken et al., vismatch (image-matching-models)