Center of distortion, homography, lens distortion correction, surround view, top down view


Advanced driver assistance systems (ADAS) have been developed to automate and modify vehicles for safety and better driving experience. Among all computer vision modules in ADAS, 360-degree surround view generation of immediate surroundings of the vehicle is very important, due to application in on-road traffic assistance, parking assistance etc. This paper presents a novel algorithm for fast and computationally efficient transformation of input fisheye images into required top down view. This paper also presents a generalized framework for generating top down view of images captured by cameras with fish-eye lenses mounted on vehicles, irrespective of pitch or tilt angle. The proposed approach comprises of two major steps, viz. correcting the fish-eye lens images to rectilinear images, and generating top-view perspective of the corrected images. The images captured by the fish-eye lens possess barrel distortion, for which a nonlinear and non-iterative method is used. Thereafter, homography is used to obtain top-down view of corrected images. This paper also targets to develop surroundings of the vehicle for wider distortion less field of view and camera perspective independent top down view, with minimum computation cost which is essential due to limited computation power on vehicles.


Bangadkar S, Dhane P, Nair S, Kutty K (2011). Mapping matrix for perspective correction from fish eye distorted images. IEEE-International Conference on Recent Trends in Information Technology, ICRTIT 2011 MIT, Anna University, Chennai. June 3-5. DOI:https://doi.org/10.1109/ICRTIT.2011.5972363

Brito JH, Angst R, Koser K, and Pollefeys M (2013). Radial distortion self-calibration. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1368-1375. DOI: https://doi.org/10.1109/CVPR.2013.180

Burchardt CB, Voss K (2001). A new algorithm to correct fish-eye- and strong wide-angle-lens-distortion from single images. Image Processing, 2001. Proceedings. International Conference on In Image Processing, 2001., Vol. 1 (2001), pp. 225-228. DOI:https://doi.org/10.1109/ICIP.2001.958994

Dhane P, Kutty K and Bangadkar S (2012). A generic non-linear method for fisheye correction. International Journal of Computer Applications (0975-8887) Volume 51-No.10, August. DOI:https://doi.org/10.5120/8082-1483

Hartley R and Kang SB (2007). Parameter-Free Radial Distortion Correction with Center of Distortion Estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 29,no.8. DOI:https://doi.org/10.1109/TPAMI.2007.1147

Kedzierski M, Fryskowska A (2008). Precise Method Of Fisheye Lens Calibration. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Vol. XXXVII. Part B5. Beijing.

Lin CC and Wang MS (2012). A vision based top-view transformation model for a vehicle parking assistant. Sensors, vol. 12, pp. 4431–4446. DOI: https://doi.org/10.3390/s120404431

Li H and Hartley R (2005). A Non-iterative Method for Correcting Lens Distortion from Nine Point Correspondences. In Proc. OmniVision’05, ICCV-workshop. DOI: https://doi.org/

Li W, Qu F, Wang Y, Liu P (2014). A Fast Vehicle Top-View System. 2nd International Conference on Systems and Informatics. DOI: https://doi.org/10.1109/ICSAI.2014.7009320

Melo R, Antunes M, Barreto JP, Falcao G and Goncalves N (2013). Unsupervised Intrinsic Calibration from a Single Frame Using a. IEEE International Conference on Computer Vision, pp. 537-544.

DOI: https://doi.org/10.1109/ICCV.2013.72

Peer P and Solina F (2002). Panoramic depth imaging: Single standard camera approach. International Journal of Computer Vision, 47(1-3), 149-160. DOI: https://doi.org/10.1023/A:1014541807682

Santhanam SM, Balisavira V, Roh SH and Pandey VK (2014). Lens Distortion Correction and Geometrical Alignment for Around View Monitoring System. In Consumer Electronics (ISCE 2014), The 18th IEEE International Symposium on 2014 Jun 22 (pp. 1-2). DOI: https://doi.org/10.1109/ISCE.2014.6884316

Schnabel R, Wahl R and Klein R (2007). Efficient RANSAC for point‐cloud shape detection. In Computer graphics forum, Blackwell Publishing Ltd (Vol. 26, No. 2, pp. 214-226). DOI: https://doi.org/10.1111/j.1467-8659.2007.01016.x

Yu M and Ma G (2014). 360° Surround View System with Parking Guidance. SAE International, 2014-01-0157. DOI: https://doi.org/10.4271/2014-01-0157

Zhang Q and Kamata SI (2015). Fisheye Image Correction Based on Straight-line Detection and Preservation. IEEE International Conference on Systems, Man, and Cybernetics. DOI:https://doi.org/10.1109/SMC.2015.314

Zhang B, Appia V, Pekkucuksen I, Batur AU, Shastry P, Liu S, Sivasankaran S, Chitnis K and Liu Y (2014). A surround view camera solution for embedded systems. IEEE Conference on Computer Vision and Pattern Recognition. DOI: https://doi.org/10.1109/CVPRW.2014.103




How to Cite

Bawa, V. S., Kumar, K., & Kumar, V. (2017). A GENERALIZED NON-LINEAR METHOD FOR DISTORTION CORRECTION AND TOP-DOWN VIEW CONVERSION OF FISH EYE IMAGES. Image Analysis and Stereology, 36(2), 141–150. https://doi.org/10.5566/ias.1660



Original Research Paper