TY - GEN
T1 - Tissue shape acquisition with a hybrid structured light and photometric stereo endoscopic system
AU - Visentini-Scarzanella, Marco
AU - Hanayama, Tatsuya
AU - Masutani, Ryunosuke
AU - Yoshida, Shigeto
AU - Kominami, Yoko
AU - Sanomura, Yoji
AU - Tanaka, Shinji
AU - Furukawa, Ryo
AU - Kawasaki, Hiroshi
N1 - Funding Information:
This work was supported by The Japanese Foundation for the Promotion of Science, Grant-in-Aid for JSPS Fellows no. 26.04041.
Publisher Copyright:
© Springer International Publishing Switzerland 2016.
PY - 2016
Y1 - 2016
N2 - In situ 3D reconstruction from endoscopic images is important to determine the correct course of action for, e.g., treatment of abnormal growths. Currently, the endoscopist has to rely solely on visual cues in order to infer the growth’s shape and size and determine an appropriate treatment. However, tissue uniformity and scale ambiguity from traditional monocular endoscopes make this visual assessment prone to errors and time consuming. We propose a practical system to densely reconstruct both shape and size of tissues with minimal modifications to a standard endoscope. We present a custom single-fiber structured light probe projecting a wave pattern on the tissue surface that allows semidense reconstruction with few ambiguities. Based on the coarse reconstruction, we retrieve the surface reflectance parameters according to a hybrid diffuse/specular model which are used to initialise a close-range Photometric Stereo reconstruction. By taking into account the tissue characteristics and the light fall-off, our Photometric Stereo formulation provides dense metric 3D shape information without the need for surface normal integration. A preliminary study was carried out both on phantoms and ex vivo samples of human tissue.
AB - In situ 3D reconstruction from endoscopic images is important to determine the correct course of action for, e.g., treatment of abnormal growths. Currently, the endoscopist has to rely solely on visual cues in order to infer the growth’s shape and size and determine an appropriate treatment. However, tissue uniformity and scale ambiguity from traditional monocular endoscopes make this visual assessment prone to errors and time consuming. We propose a practical system to densely reconstruct both shape and size of tissues with minimal modifications to a standard endoscope. We present a custom single-fiber structured light probe projecting a wave pattern on the tissue surface that allows semidense reconstruction with few ambiguities. Based on the coarse reconstruction, we retrieve the surface reflectance parameters according to a hybrid diffuse/specular model which are used to initialise a close-range Photometric Stereo reconstruction. By taking into account the tissue characteristics and the light fall-off, our Photometric Stereo formulation provides dense metric 3D shape information without the need for surface normal integration. A preliminary study was carried out both on phantoms and ex vivo samples of human tissue.
UR - http://www.scopus.com/inward/record.url?scp=84961231006&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84961231006&partnerID=8YFLogxK
U2 - 10.1007/978-3-319-29965-5_5
DO - 10.1007/978-3-319-29965-5_5
M3 - Conference contribution
AN - SCOPUS:84961231006
SN - 9783319299648
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 46
EP - 58
BT - Computer-Assisted and Robotic Endoscopy - 2nd International Workshop, CARE 2015, Held in Conjunction with MICCAI 2015, Revised Selected Papers
A2 - Reichl, Tobias
A2 - Reiter, Austin
A2 - Luo, Xiongbiao
A2 - Mariottini, Gian-Luca
A2 - Luo, Xiongbiao
PB - Springer Verlag
T2 - 2nd International Workshop on Computer-Assisted and Robotic Endoscopy, CARE 2015
Y2 - 5 October 2015 through 5 October 2015
ER -