ディズニーがリアルタイムで色を反映するARぬりえを公開 - Live Texturing of Augmented Reality Characters from Colored Drawings
拡張現実(AR)ぬりえといえば、世界的にはQuiver(元colMix)、日本ではナレッジワークス株式会社が開発したdaub(ARぬりえ ぬってポン！だーぶ)が有名だ。今回、ディズニーの研究部門Disney Researchが塗った色をリアルタイムに3DCGに反映するARぬりえを2015年10月初めに発表した。
従来のARぬりえとの大きな違いは、台紙に色を塗った色がその瞬間に3Dキャラクターに反映される点だ。ユニークではあるが、塗りながらタブレットやiPadを持つことはできないので、端末が設置されていることが必要になるだろう。また、リアルタイムに台紙(認識するターゲット)の状態を端末側のカメラで読み取りながら3DCGへ反映させるため、高性能なCPUとグラフィック性能が要求されるであろう。
ディズニーならではの夢を強く打ち出したアプリになる事を期待したい。
しかし、きっと台紙やコンテンツにお金がかかるんだろうな...
Link to publication page: http://www.disneyresearch.com/publica...
Coloring books capture the imagination of children and provide them with one of their earliest opportunities for creative expression. However, given the proliferation and popularity of digital devices, real-world activities like coloring can seem unexciting, and children become less engaged in them. Augmented reality holds unique potential to impact this situation by providing a bridge between real-world activities and digital enhancements. In this paper, we present an augmented reality coloring book App in which children color characters in a printed coloring book and inspect their work using a mobile device.
The drawing is detected and tracked, and the video stream is augmented with an animated 3-D version of the character that is textured according to the child’s coloring. This is possible thanks to several novel technical contributions. We present a texturing process that applies the captured texture from a 2-D colored drawing to both the visible and occluded regions of a 3-D character in real time. We develop a deformable surface tracking method designed for colored drawings that uses a new outlier rejection algorithm for real-time tracking and surface deformation recovery. We present a content creation pipeline to efficiently create the 2-D and 3-D content. And, finally, we validate our work with two user studies that examine the quality of our texturing algorithm and the overall App experience.
(via http://www.disneyresearch.com/)
従来のARぬりえとの大きな違いは、台紙に色を塗った色がその瞬間に3Dキャラクターに反映される点だ。ユニークではあるが、塗りながらタブレットやiPadを持つことはできないので、端末が設置されていることが必要になるだろう。また、リアルタイムに台紙(認識するターゲット)の状態を端末側のカメラで読み取りながら3DCGへ反映させるため、高性能なCPUとグラフィック性能が要求されるであろう。
ディズニーならではの夢を強く打ち出したアプリになる事を期待したい。
しかし、きっと台紙やコンテンツにお金がかかるんだろうな...
Link to publication page: http://www.disneyresearch.com/publica...
Coloring books capture the imagination of children and provide them with one of their earliest opportunities for creative expression. However, given the proliferation and popularity of digital devices, real-world activities like coloring can seem unexciting, and children become less engaged in them. Augmented reality holds unique potential to impact this situation by providing a bridge between real-world activities and digital enhancements. In this paper, we present an augmented reality coloring book App in which children color characters in a printed coloring book and inspect their work using a mobile device.
The drawing is detected and tracked, and the video stream is augmented with an animated 3-D version of the character that is textured according to the child’s coloring. This is possible thanks to several novel technical contributions. We present a texturing process that applies the captured texture from a 2-D colored drawing to both the visible and occluded regions of a 3-D character in real time. We develop a deformable surface tracking method designed for colored drawings that uses a new outlier rejection algorithm for real-time tracking and surface deformation recovery. We present a content creation pipeline to efficiently create the 2-D and 3-D content. And, finally, we validate our work with two user studies that examine the quality of our texturing algorithm and the overall App experience.
(via http://www.disneyresearch.com/)
