Mosaicing-by-recognition for video-based text recognition

Seiichi Uchida, Hiromitsu Miyazaki, Hiroaki Sakoe

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)


Text recognition captured in multiple frames by a hand-held video camera is a challenging task because it is possible to capture and recognize a longer line of text while improving the quality of the text image by utilizing the redundancy of the overlapping areas between the frames. For this task, the video frames should be registered, i.e., mosaiced, after compensating for their distortions due to camera shakes. In this paper, a mosaicing-by-recognition technique is proposed where the problems of video mosaicing and text recognition are formulated as a unified optimization problem and solved by a dynamic programming-based optimization algorithm simultaneously and collaboratively. Experimental results indicate that, even if the frames undergo various distortions such as rotation, scaling, translation, and nonlinear speed fluctuation of camera movement, the proposed technique provides fine mosaic image by accurate distortion estimation (around 90% of perfect estimation) and character recognition accuracy (over 95%).

Original languageEnglish
Pages (from-to)1230-1240
Number of pages11
JournalPattern Recognition
Issue number4
Publication statusPublished - Apr 2008

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'Mosaicing-by-recognition for video-based text recognition'. Together they form a unique fingerprint.

Cite this