Depth-assisted rectification for real-time object detection and pose estimation

João Paulo Silva do Monte Lima, Francisco Paulo Magalhães Simões, Hideaki Uchiyama, Veronica Teichrieb, Eric Marchand

Research output: Contribution to journalArticlepeer-review

10 Citations (Scopus)


RGB-D sensors have become in recent years a product of easy access to general users. They provide both a color image and a depth image of the scene and, besides being used for object modeling, they can also offer important cues for object detection and tracking in real time. In this context, the work presented in this paper investigates the use of consumer RGB-D sensors for object detection and pose estimation from natural features. Two methods based on depth-assisted rectification are proposed, which transform features extracted from the color image to a canonical view using depth data in order to obtain a representation invariant to rotation, scale and perspective distortions. While one method is suitable for textured objects, either planar or non-planar, the other method focuses on texture-less planar objects. Qualitative and quantitative evaluations of the proposed methods are performed, showing that they can obtain better results than some existing methods for object detection and pose estimation, especially when dealing with oblique poses.

Original languageEnglish
Pages (from-to)193-219
Number of pages27
JournalMachine Vision and Applications
Issue number2
Publication statusPublished - Feb 1 2016

All Science Journal Classification (ASJC) codes

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Computer Science Applications


Dive into the research topics of 'Depth-assisted rectification for real-time object detection and pose estimation'. Together they form a unique fingerprint.

Cite this