A camera-based multi-touch interface builder for designers

Abstract

In our daily life, human beings tend to use both hands to accomplish complex tasks, but not to computers. However, multi-touch technology allows users to control all objects on the screen with more than just one linger. Therefore, how designers can take advantage of such technology and explore its potentials? So we propose a multi-touch interface builder called MToolKit for easy and effective construction of multi-touch interface for designers. By using camera-based sensor framework, we further analyze the multi-touch examples available for the interactive patterns. With these analysis and design requirement for building up an interface builder for designers, we conduct a two-point input and implemented them into our system called MToolkit. MToolkit was implemented by java and based on processing programming environment and a video processing C++ library with java wrapper. An example of using our MToolkit is elaborated in this paper.