This post is a report on a summary of my progress and results so far and future plans for the project. For now, Mr Rodney has assigned me to do a project for Siggraph Asia and look into ARtoolkit codes to try and modify it further if possible.

Literature Reviews
The following journal papers were useful:
MagicMouse: an Inexpensive 6-Degree-of-Freedom Mouse - E. Woods, P. Mason, M. Billinghurst.
Interaction Techniques for Musical Performance with Tabletop Tangible Interfaces - J.Patten, B.Recht, H.Ishii
Virtual Object Manipulation on a Table-Top AR Environment - H. Kato, M. Billinghurst, I. Poupyrev, K. Imamoto, K. Tachibana

Also the following book/sites:
ARtoolkit -
OpenGL Programming Guide: The Official Guide to Learning OpenGL, version 2.1

Progress so far
  • The ARtoolkit has been setup on my laptop and is working fine. Familiarize myself with the ARtoolkit and openGL concept.
  • TouchDesigner has been installed on my laptop with the latest video drivers installed (though its a third-party driver and thus at times TouchDesigner may crash).
  • I have had to familiarize myself with TouchDesigner and a few of the operators and got a few things going (from the youtube video).
-This is posted on youtube but can't actually see the bubbles. The high-res video has been uploaded to .

Future Plans
  • To make the movement of the shark geometry move more randomly.
  • Once the random movement is done, more geometries easily be implemented.
  • Add texture to the bubbles.
  • Understand fully how the AR Tool kit is implemented into TouchDesigner using the SHM (Shared Memory).
  • Have the shark to interact with the marker - once the marker is shown, the shark will move towards the marker.
  • Clean up the AR Tool kit codes.