Touchable Surface:The Advanced Way of Handling Computer System

Transcription

1 Touchable Surface:The Advanced Way of Handling Computer System Mr. Ratan Rajabhau Chavan Master of Engineering in Computer Science and Engineering Sipna College of Engineering and Technology, Amravati Abstract:- Surface Computing is new approach to work with computer, which takes so far from traditional way of handling computer. With the help of this technology, we can experienced the touchable surface and also with making use of Wiimote device we can play games without handling traditional input devices like keyboard, mouse and joysticks. In this paper implementation of surface computing is described with software and hardware. This technology accepts new ideas to interact with digital content by placing IR pen on surface and making lots of fun by playing games and handling computer system with position-sensing ability of this technology. Keywords: Surface Computing, Wiimote, IR pen, Motion Sensing, GlovePie, Smooth Board, I. INTRODUCTION Surface computing is technology which deals with NUI (Natural User Interface) that allows people to work with computers without handling keyboard and mouse. This paper gives us new approach of handling computer system and playing games on particular surface using some devices and not making use of traditional input devices like keyboard, mouse and joysticks. In this paper, the concept surface computing is implemented and also experienced the advanced way of handling computer system and playing games without using any input devices. To implement this technology, we need some devices like projector, IR pen, Wiimote and Smoothboard and GlovePie software s for working it properly. The detailed description about all these devices and software s are given in related work. With the help of all these devices how we can make any surface touchable and play games on that surface by using Wiimote and IR pen is explained in implementation part of the paper. 1. METHODOLOGY 2.1 SURFACE COMPUTING Dr.Prof. Vishwas T. Gaikwad M.E.(Electronics), Ph.D. Sipna College of Engineering and Technology Surface computing is new approach of working with computers that takes so far from the traditional way of handling computers that is mouse-and-keyboard experience. It is NUI [Natural User Interface] that allows people to interact with the digital world the same way they have interacted with everyday items such as photos, paint, music, etc. with their hands, with gestures and by putting real world object on the surface. It is totally new category of product for users to interact with. Surface computing is completely spontaneous and free mind to accept new ideas to interact with digital content. It is very thin line between physical and virtual worlds. By using hands or placing particular device (such as IR pen) everyday objects on the surface such as any item we are going to purchase at a retails store or using like paint brush, we can interact,share and collaborate like have never done before. Imagine one student went to a library and seated on study table, on that table all the books in the library are given department wise and that student touches the surface of table and chooses book that he wants to read. The book he is selected get opened and student will start reading instead of issuing book from library. With this technology the efforts of students get decreases. In above example the study table is computed surface. We really see this broadeningcontent opportunities and delivery systems. Surface computing is very powerful movement. In fact, it is drastic change from DOS [Disk Operating System] to GUI [Graphical User Interface]. This paper shows that many people are intimidated and isolated by day to day growing technologies. Lots of features that are available in mobile phones, PCs and other electronic devices aren t used because the technology is threatening. Surface computing breaks down those traditional barriers to the technology because of that people can interact with all kinds of digital content in more spontaneously and efficient manner. It is all about technology adapting to the user ISSN: Page 94

2 instead of the user adapting to the technology. Bringing this kind of NUI [Natural User Interface] innovation to the computing space/surface iswhat surface computing is all about. 2.2 SMOOTHBOARD Smoothboard is software for calibrating the surface using Wiimote and IR pen. Smooth-board makes us easily change our flat screen display (Projected screen) into interactive surface with just a Wiimote and IR pen. Smooth-board provides us an intuitive interface that enables user to make interaction with their computer directly at the screen. Smoothboard allows us to control our computer away from the screen with the use of Wiimote. With the help of Smoothboard we can make impressive presentations that will be free from keyboard and mouse. 2.3 CALIBRATING SURFACE After installing and loading, Smoothboard will need to calibrate with IR pen using Wiimote. For calibration Press the A button on the Wiimote or we can click on the Quick Calibration button in the main window of Smoothboard software. To calibrate projected surface face the Wiimote towards center of the screen where the position of Wiimote is approximately 2times the height of the screen. Click with an IR pencalibration markers shown on the screen in the following sequence:[4] Fig..1. Schematic plot of Wiimote for IR LED location sensing. This value may be required higher if screen is very large. Repeat the calibration process until the tracking utilization is not more than 30% and whitecolored area should be completely within black area. When the calibration process is complete that interactive surface is ready to use.[4] If the calibration marker point does not change when IR pen clicked, then that point may be out of range of the view of Wiimote.This type of problem might be caused by faulty or depleted IR pen. First top left corner, then top right corner then bottom right corner and at last bottom left corner. After completing all four points the calibration window will disappear. If we want to cancel the calibration, just double click on the screen or simply press ESC button of the keyboard. After done with Calibration, click the calibration by viewing at the calibration viewer and tracking utilization on Smoothboard s main window. The white-colored area on tracking utilization window which represents the screen which is calibrated should be within the black colored area.the tracking utilization that is calibrating surface should be more than 30% for a screen the size of a surface. 2.4 WIIMOTE Fig.2.Tracking utilization of surface The Wiimote is a wireless input device or controller and is consist of twelve buttons in which four buttons are arranged into a directional pad and remaining is spread over device. Wiimote has symmetric design makes us allow to use it with either right hand or left hand. Fig. 3 gives us overview of the layout of Wiimote [4]. The expansion port on the bottom of the Wiimote is used for connecting the remote to auxiliary controller which gives input options of the Wiimote. Auxiliary Controller is used for establishing the communication between host and Wiimote in other words we can say that auxiliary ISSN: Page 95

3 controller is interface of Wiimote to communicate with host. One of the auxiliary controllers is Nunchuck. It is having features that an analog stick more number of control option. 2.5 COMMUNICATION The Wiimote is wireless device, so to establish communication with the host is accomplished through a Bluetooth wireless link. This Bluetooth controller is Broadcom 2042 chip, which is designed to use it with devices which follow Bluetooth Human Interface Device (HID) standard, such as mouse and keyboard. All the Bluetooth devices are not compatible with Wiimote. 2.6 MOTION SENSOR Fig.3 Layout of Nintendo Wiimote Fig.4 Nintendo Nunchuck The Wiimote contains four blue LEDs these four LEDs are used during normal use of Wiimote that shows that this device is in Bluetooth discoverable mode (all blue LEDs are blinking) or it will indicate users number controller( only one LED will illuminated ). Controller is provided with rumble with the help of motor with an unbalanced weight which is attached to it inside the Wiimote, which can activated to cause the controller to vibrate and it has low quality speakers which is used for short sound effects while using of it.[1] The Wiimote internally has integrated circuit called ADXL330 accelerometer. Wiimote device has ability to measure acceleration along with three axes. This device is supported by springs built out of silicon, which is enough to enable the position-sensing abilities and gone through the force exerted on these springs in which the sensors measures the acceleration of the Wiimote. Due to the use of sign conversion this quantity is proportional to the net force exerted by the users hand on Wiimote while handling it. The Wiimote is also augmented with an infrared image on in front although it having motionsensing abilities with the accelerometer. This feature of Wiimote is designed only to locate IR beacons within the user s field of view and hence creating position-sensing abilities. These beacons will be transmitted through sensor bar. The location of the beacons in contrast to the Wiimote sensors will be found by tracking the system can derive more accurate pointing information.[4] The Wiimote we are going to use is of the Nintendo. The Nintendo sensor bar contains 10 LEDs, five of them on each side. The LEDs are closed to the center which is pointing inward and remaining ones are pointing outward. The LEDs available in Wiimote enables it to calculate the distance from sensor bar and even angles of the device with respect to the ground. Out of these size and pixel data can be requested. It is not compulsory to use sensor bar consist of as many light as the version of Nintendo have. A sensor bar containing two LEDs will be 6.[4] ISSN: Page 96

4 Fig.5 Motion sensing with three axes 2.7 GLOVEPIE APPLICATION GlovePie(Glove Programmable Input Emulator) is software application specifically designed for emulating joystick and keyboard input through running custom scripts. This application was designed initially for virtual reality gloves as system for emulating joystick and keyboard input. Still it has evolved to support all kinds of devices. In this paper, we are going to implement the concept of surface computing by two ways one is by making surface as computer system and second is by playing games on surface without using keyboard, mouse or joystick. Infirst way, to make surface as computer system that ismaking surface touchable. We need all devices mentioned above and most important thing that will make surface that is Smoothboard software application. With the help of all these devices and software we will able to make any surface touchable. To implement this, first computer system and projector should be connected with each other and projection of projector should be on surface that we want to make touchable then with the help of Bluetooth we have to connect Wiimote device to the computer system and placed that Wiimote in a such a way that position of the Wiimote is approximately two times the height of screen. After all this we have to install Smoothboard software application. To make surface touchable we need to calibrate the surface with IR pen. For calibration press button A of Wiimote or click the quick calibration button in main window of Smoothboard software. How surface will calibrate? It is given in calibration. After calibration that surface is ready for use, with the help of IR pen we can use surface as computer system. With the help of GlovePie it is possible to program the input from the Wiimote. To use Wiimote we have to do programming that is used with keyboard, mouse or joystick. GlovePie is compatible with Windows Operating Systems, though there are lots of other programs for utilizing the Wiimote in other Operating System. II. IMPLEMENTATION In this paper, we are going to experience the advanced level of technology, in which with the help of some devices we are making surface has a computer system in that we will not use mouse or keyboard anymore and also we will play games without handling mouse, keyboard and joystick. This all kind of stuffs that we are going to do is possible under the concept of surface computing. For making all this we needsome devices like PC, projector for projecting on the surface, one or two IR pens and most important devices Wiimote. These devices can make any surface as touchable surface or we can say that devices can make any surface which we will use as computer system. Fig. 6. Surface using as computer system In second way, wecan play games on the surface with the help of Wiimote. For this we need all devices that used for touchable surface but there is only one difference is that we have to useglovepie software instead of Smoothboard software. With the help of GlovePie we can make interaction between Wiimote and computer system. GlovePieapplication software is specifically designed for virtual reality gloves as system for emulating joystick, keyboard and mouse input. In GlovePie we have to make coding in such a way that while playing games keys of keyboard is replaced by Wiimote s 12 buttons. After done with coding in GloviePiethe surface is ready to play game from anywhere in the range of Bluetooth device using Wiimote. ISSN: Page 97

5 In this way we can make any surface touchable and play games on that surface with the help of surface computing. REFERENCES [1]J. Krejsa, S. Vechet, Infrared beacons based localization of mobilerobot, Electron. Electr. Eng. 117 (2012) [2] C. Wingrave, B. Williamson, J. Rose, A. Miller, E. Charbonneau, J. Bott,J. Laviola, The wiimote and beyond: spatially convenient devices for3d user interfaces, IEEE Compute. Graphics Appl. 30 (2010) [3] J.C. Lee, Hacking the Nintendo wii remote, IEEE Pervasive Compute. (2008) [4] Studying thewiimote:exploration to Enhance the Feeling of Interactivity in Applications pdf. [5] Shen,C.,et al Informing the Design of Direct-Touch Tabletops. IEEE Compute. Graph. Appl. 26, 5 (Sep. 2006) Fig.7 Playing game using Wiimote [6] Terrenghi,L., et al. Affordances for manipulation of physical versus digital media on interactive surfaces. In Proceedings of CHI '07. ACM, New York, NY, [7] Van de Mortel, D., Ju, H., Apartgame: a multi-user tabletop game platform for intensive public use. In IUI '07: pages 49 52, NewYork, NY, USA, [8] Wigdor, D. et al (2009) We Space: the design development and deployment of a walk-up and share multi-surface visual collaboration system. In Proc. CHI '09, Fig.8 Playing basketball using Wiimote III. CONCLUSION This paper is totally about surface computing which is growing technology in which surface is calibrated and make use of that surface as screen of computer system and enjoy the new experience of handling computer without traditional input devices. In this paper, we studied the concept of surface computing in detailed and also we experienced the technology that makes any surface touchable with the help of Wiimote and IR pen. Similarly we can play games on that surface without using any traditional input devices like keyboard, mouse and joystick instead of these we can use Wiimote as input device like keyboard, mouse and joysticks. In short we can say that we will learn the technology with only one input device that is Wiimote and enjoy the gaming experienced and handle the computer system with only one input device. ISSN: Page 98