VisionBlaster - Solutions in Computer Vision
Unity Augmented Reality
Unity3d 2.6 Integration - Head Controlled Camera
Now that Unity's 2.6 version free version has been launched, VisionBlaster's caught up with a new version of the streamer script. Now working with connectionless UDP the script is robust and can join the streamer at any time. 6 degrees of freedom are being communicated and this video shows an integration using only translation.
This video shows how to control Unity's 3d camera using head moves. As he goes left or right, up or down, the camera pans accordingly. Whe he moves forward or backward the camera detects the distance and will zoom in or out.
All these features can be obtained through the download of an open source streamer that uses FaceAPI non commercial license to communicate to VisionBlaster's Unity script, which can be used with a drag and drop to the camera and a few adjustments. In order to purchase this low cost script click here.
The 6 degrees of freedom streamer is available as an open source project at: http://code.google.com/p/6dofstreamer/
In order to test the head rotation demo in your computer, simply download the streamer here and the Island Demo here.Unity3d Game Creation

Unity3d and FaceAPI integration
This video shows realtime integration of 6 degrees of freedom head tracking using a simple webcam with Unity3D. As the camera is moved closer you can see the actor rotating his head exactly like the person. Headtracking is done with the non-commercial version of FaceAPI. As the human head is moved, the algorithm calculates head pose and measures pitch, yaw and roll angles. These angles are sent to Unity3D where a script maps moves to the actor, Lerpz. When the 'F' key is pressed, the player throws a lightning bolt in the direction the person is looking at, adding a further degree of user interaction. Part of this project is open source software.
In order to download the demo get the 6 degrees of freedom streamer from http://6dofstreamer.googlecode.com/files/faceapistreamer0.9.zip . The streamer may require Intel Integrated Performance Primitive libraries, so, it's better to firstly install the non-commercial version of FaceAPI, which is available here http://www.seeingmachines.com/product/faceapi/downloads/ . In case it is not installed firstly, the ippcore5.2.dll not found error might happen.
After starting the streamer and making sure your head has been detected in FaceAPI, check the results of the integration executing Lerpz demo: http://6dofstreamer.googlecode.com/files/LerpzFaceAPI0.9.zip
Lerpz should move his head according to yours. Press the 'F' button to throw a lightning bolt in the direction he is facing. Arrows will move him and the space bar will jump.
In order to purchase the integration script one can visit this page. You can download the documentation here.
OpenCV consulting
At Vision Blaster you will find years of experience in OpenCV consulting. Custom systems or software programs can be supported in the following areas:
- image processing
- template matching
- segmentation
- tracking
- stereo vision
- machine learning
- haar feature cascade training
- integration with Unity3D, Quest3D, and Blender





