Microsoft - Principal Designer - Sheng Kai Tang

Prof. Shih-Yuan Wang

Prof. Yu-Ting Sheng

 

MR & UR robotic arm Collaboration Interface
Explore the possible ways of combing digital fabrication and augmented reality interface

Additive robotic system 
With the aids of robotic arms, digital speculations and locations could be approached accurately. 

UR 10 robotic arms *2 
Hololens G1 *4 
self-developed air pad tool*4 

By using Microsoft Hololens, we placed the digital object in the augmented reality interface. At the same time, the robotic arm recognized the locations where it places the real bricks to match the outcome in the digital environment. This working scenario could only be built up based on the exploration of a mixed reality robotic fabrication interface. 
This method aims to explore the possibilities between digital fabrication and user interface. Without using visual programming software(Grasshopper, CAM), users could intuitively pick up building materials and arrange them directly by using specified hand gestures set in Unity. With the accuracy of robotic arms, the structure could be built up even remotely by a user far away from the construction site.