Citation: | WEI Chuntao, ZHANG Dongmei. Feature Matching Method of Oblique Images Based on Geometric Constraints[J]. Journal of Southwest Jiaotong University, 2024, 59(2): 353-360. doi: 10.3969/j.issn.0258-2724.20210662 |
A feature point and line hierarchical matching method is proposed, suitable for oblique images to solve the challenges of large angle in view transformation, a few matches due to repeated texture, and low matching accuracy. Firstly, the line features of images derive from the line extraction (detection) algorithm (LineSegmentDector), follow constraints to pair, and construct line pair regions to match the improved SIFT feature descriptor. Secondly, after RANSAC algorithm eliminates mismatches, the epipolar constraint acts upon the initial matching results. Then, the obtained lines correct the local image, and the corrected local image uses SIFT matching, which contributes to calculating the original image reversely. The obtained matching points are used to globally correct the oblique image, and the feature points are matched; the grid-based motion statistics (GMS) algorithm eliminates the mismatches; the matching results go through reverse calculation and return to the original image. The line matching results and the point expanding matching results combine into final results, showing that the matching accuracy of the proposed method is close to that of ASIFT, but the number of matching is 1-3 times it.
[1] |
余美. 倾斜立体影像匹配若干问题研究[D]. 徐州: 中国矿业大学, 2018.
|
[2] |
LOWE D G. Distinctive image feature from scale-invariant key points[J]. International Journal of Computer Vision, 2004, 60(2): 91-110. doi: 10.1023/B:VISI.0000029664.99615.94
|
[3] |
MA J, CHAN C W, CANTERS F. Fully automatic subpixel image registration of multiangle CHRIS/Proba data[J]. IEEE Transactions on Geoscience and Remote Sensing, 2010, 48(7): 2829-2839.
|
[4] |
MOREL J M, YU G. ASIFT: a new framework for fully affine invariant image comparison[J]. SIAM Journal on Imaging Sciences, 2009, 2(2): 438-469. doi: 10.1137/080732730
|
[5] |
YU G, MOREL J M. ASIFT: an algorithm for fully affine invariant comparison[J]. Image Processing on Line, 2011, 1: 11-38. doi: 10.5201/ipol.2011.my-asift
|
[6] |
LI K, YAO J. Line segment matching and reconstruction via exploiting coplanar cues[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 125: 33-49. doi: 10.1016/j.isprsjprs.2017.01.006
|
[7] |
GIOIR RAFAEL G V, JAKUBOWICZ J , MOREL J M, et al. LSD: a fast line segment detector with a false detection control[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(4): 722-732.
|
[8] |
FAN B, WU F, HU Z. Robust line matching through line-point invariants[J]. Pattern Recognition, 2012, 45(2): 794-805. doi: 10.1016/j.patcog.2011.08.004
|
[9] |
MIKOLAJCZYK K, SCHMID C. Scale & affine invariant interest point detectors[J]. International Journal of Computer Vision, 2004, 60(1): 63-86. doi: 10.1023/B:VISI.0000027790.02288.f2
|
[10] |
MIKOLAJCZYK K, TUYTEIAARS T, SCHMID C, et al. A comparison of affine region detectors[J]. International Journal of Computor Vision, 2005, 65: 43-72. doi: 10.1007/s11263-005-3848-x
|
[11] |
姚国标,邓喀中,艾海滨,等. 倾斜立体影像自动准稠密匹配与三维重建算法[J]. 武汉大学学报(信息科学版),2014,39(7): 843-849.
YAO Guobiao, DENG Kazhong, AI Haibin, et al. An algorithm of automatic quasi-dense matching and three-dimensional reconstruction for oblique stereo images[J]. Geomatics and Information Science of Wuhan University, 2014, 39(7): 843-849.
|
[12] |
余美,邓喀中,杨化超,等. 基于WαSH局部特征的立体影像匹配[J]. 中国矿业大学学报,2018,47(3): 685-690.
YU Mei, DENG Kazhong, YANG Huachao, et al. Stereo images matching based on WαSH local features[J]. Journal of China University of Mining & Technology, 2018, 47(3): 685-690.
|
[13] |
肖雄武,郭丙轩,李德仁,等. 一种具有仿射不变性的倾斜影像快速匹配方法[J]. 测绘学报,2015,44(4): 414-421.
XIAO Xiongwu, GUO Bingxuan, LI Deren, et al. A quick and affine invariance matching method for oblique images[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(4): 414-421.
|
[14] |
YU Yinian, HUANG Kaiqi, CHEN Wei, et al. A novel algorithm for view and illumination invariant image matching[J]. IEEE Transactions on Image Processing, 2011, 21(1): 229-240.
|
[15] |
XIAO X W, GUO B X, SHI Y R, et al. Robust and rapid matching of oblique UAV images of urban area[C]//Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series. Wuhan: SPIE, 2013: 223-230.
|
[16] |
LI K, YAO J , XIA M H, et al. Joint point and line segment matching on wide-baseline stereo images[C]//2016 IEEE Winter Conference on Applications of Computer Vision (WACV). New York: IEEE, 2016: 1-9.
|
[17] |
陈敏,朱庆,何海清,等. 面向城区宽基线立体像对视角变化的结构自适应特征点匹配[J]. 测绘学报,2019,48(9): 1129-1140.
CHEN Min, ZHU Qing, HE Haiqing, et al. Structureadaptive feature point matching for urban area wide-baseline images with viewpoint variation[J]. Acta Geodaetica et Cartographica Sinica, 2019, 48(9): 1129-1140.
|
[18] |
张平,王竞雪. 直线对几何特征约束的近景影像特征匹配[J]. 遥感信息,2020,35(4): 124-132.
ZHANG Ping, WANG Jingxue. Line matching for close-range images with geometry features of line pairs[J]. Remote Sensing Information, 2020, 35(4): 124-132.
|
[19] |
RAGURAM R, CHUM O, POLLEFEYS M, et al. USAC: a universal framework for random sample consensus[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(8): 2022-2038.
|
[20] |
王竞雪,朱庆,王伟玺. 顾及拓扑关系的立体影像直线特征可靠匹配算法[J]. 测绘学报,2017,46(11): 1850-1858.
WANG Jingxue, ZHU Qing, WANG Weixi. Reliable line matching algorithm for stereo images with topological relationship[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(11): 1850-1858.
|
[21] |
RUBLEE E, RABAUD V, KONOLIGE K, et al. ORB: an efficient alternative to SIFT or SURF[C]//2011 International Conference on Computer Vision. Barcelona: IEEE, 2011: 2564-2571.
|
[22] |
LEVI G, HASSNER T. LATCH: learned arrangements of three patch codes[C]//2016 IEEE Winter Conference on Applications of Computer Vision (WACV). NewYork: IEEE, 2016: 1-9.
|
[23] |
李卓,刘洁瑜,李辉,等. 基于ORB-LATCH的特征检测与描述算法[J]. 计算机应用,2017,37(6): 1759-1762.
LI Zhuo, LIU Jieyu, LI Hui, et al. Feature detection and description algorithm based on ORB-LATCH[J]. Journal of Computer Applications, 2017, 37(6): 1759-1762.
|
[24] |
BIAN J W, LIN W Y, MATSUSHITA Y, et al. GMS: grid-based motion statistics for fast, ultra-robust feature correspondence[J]. International Journal of Computer Vision, 2020, 128(6): 1580-1593. doi: 10.1007/s11263-019-01280-3
|
[25] |
MIKOLAJCZYK K, SCHMID C. A performance evaluation of local descriptors[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(10): 1615-1630.
|
[26] |
SONG W H, JUNG H G, GWAK I Y, et al. Oblique aerial image matching based on iterative simulation and homography evaluation[J]. Pattern Recognition, 2019, 87: 317-331.
|
[27] |
杨蒙蒙,张爱华. 基于灰度共生矩阵和同步正交匹配追踪的分形图像压缩[J]. 计算机应用,2021,41(5): 1445-1449.
YANG Mengmeng, ZHANG Aihua. Fractal image compression based on gray-level co-occurrence matrix and simultaneous orthogonal matching pursuit[J]. Journal of Computer Applications, 2021, 41(5): 1445-1449.
|
[28] |
SARLIN P E, DETONE D, MALISIEWICZ T, et al. Superglue: Learning feature matching with graph neural networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2020: 4938-4947.
|