xRの世界 | The world of xR (xReality)

拡張現実 Augmented Realty/仮想現実 Virtual Reality/複合現実 Mixed Reality の技術がもたらす DX(デジタルトランスフォーメーション)

サウンドで目に見える世界を拡張するプロトタイプ - Virtual LSD prototype 1 #AR

Augmented Reality
あなたが聞く音楽のリズムや曲調に基づいてリアルタイムで照明や映像をコントロールし、その音楽の世界を拡張するというののようだ。Java、JMF、処理、JHLabsフィルタ、BoofCVで実現されている。


Creator: Robby Wauters

Student Master of Computer Science @ KU Leuven, Belgium.
First prototype of my thesis at the KULeuven, called Virtual LSD.
I would like to augment the environment of a user (who is listening to music) in real-time using sound data.

Suppose...
You would have a augmented reality goggle attached to your sound-playing device (iPhone, Laptop, mp3 player). While you're walking around town or in your garden, various illustrations would be generated in real-time based on the music you hear. Lighting is based on the rhythm of the music, coloring is based on the mood/genre, real life objects are being altered or enhanced by certain tunes. You would have a fully immersive audio & visual experience.

Uses Java, JMF, Processing, JHLabs filters, BoofCV.

(via YouTube by  )