Programming Interactivity: A Designer's Guide to Processing, Arduino, and openframeworks

Transcription

1 Programming Interactivity: A Designer's Guide to Processing, Arduino, and openframeworks Table of contents Introductions Chapter 1: Introducing Interaction Design What This Book Is for Programming for Interactivity Design and Interaction Art and Interaction Data Exchange and Exploration Working Process Chapter 2: Programming Basics Why You ll Read This Chapter More Than Once The Nature of Code Variables Control Statements Functions Objects and Properties Scope Chapter 3: Processing Downloading and Installing Processing Exploring the Processing IDE The Basics of a Processing Application The Basics of Drawing with Processing Capturing Simple User Interaction Importing Libraries Loading Things into Processing Running and Debugging Applications Exporting Processing Applications Conclusion Chapter 4: Arduino Starting with Arduino Touring Two Arduino Boards Touring the Arduino IDE The Basics of an Arduino Application Features of the Arduino Language How to Connect Things to Your Board Hello World Debugging Your Application

2 Importing Libraries Running Your Code Chapter 5: Programming Revisited Object-Oriented Programming Classes Public and Private Properties Inheritance Processing: Classes and Files C++: Classes and Files Pointers and References Chapter 6: openframeworks Your IDE and Computer Taking Another Quick Tour of C++ Getting Started with of Touring an of Application Creating Hello, World Drawing in 2D Displaying Video Files and Images Importing Libraries Compiling an of Program Debugging an of Application Themes Chapter 7: Sound and Audio Sound As Feedback Sound and Interaction How Sound Works on a Computer Audio in Processing Sound in openframeworks openframeworks and the FMOD Ex Library The Sound Object Library The Magic of the Fast Fourier Transform Physical Manipulation of Sound with Arduino A Quick Note on PWM Creating Interactions with Sound Further Resources Chapter 8: Physical Input Interacting with Physical Controls Thinking About Kinetics Getting Gear for This Chapter Controlling Controls

3 Turning Knobs Using Lights Detecting Touch and Vibration Communicating with Other Applications Sending Messages from the Arduino Detecting Motion Reading Distance Understanding Binary Numbers Detecting Forces and Tilt Introducing I2C What Is a Physical Interface? Chapter 9: Programming Graphics The Screen and Graphics Seeing Is Thinking, Looking Is Reading Math, Graphics, and Coordinate Systems Drawing Strategies Processing and Transformation Matrices Creating Motion Using Vectors Using Graphical Controls Importing and Exporting Graphics Chapter 10: Bitmaps and Pixels Using Pixels As Data Using Pixels and Bitmaps As Input Providing Feedback with Bitmaps Looping Through Pixels Manipulating Bitmaps Analyzing Bitmaps in of Using Pixel Data Using Textures Saving a Bitmap Chapter 11: Physical Feedback Using Motors Using Servos Using Household Currents Working with Appliances Introducing the LilyPad Board Using Vibration Using an LED Matrix Using LCDs

4 Using Solenoids for Movement Chapter 12: Protocols and Communication Communicating Over Networks Using XML Understanding Networks and the Internet Handling Network Communication in Processing Understanding Protocols in Networking Using ofxnetwork Creating Networks with the Arduino Using Carnivore to Communicate Communicating with Bluetooth Communicating Using MIDI Explorations Chapter 13: Graphics and OpenGL What Does 3D Have to Do with Interaction? Understanding 3D Working with 3D in Processing Making Custom Shapes in Processing Using Coordinates and Transforms in Processing Working with 3D in OpenGL Using Matrices and Transformations in OpenGL Using Vertices in OpenGL Drawing with Textures in of Lighting in OpenGL Blending Modes in OpenGL Using Textures and Shading in Processing Using Another Way of Shading Using an ofshader Addon What to Do Next Chapter 14: Detection and Gestures Computer Vision OpenCV Using Blobs and Tracking Using OpenCV in Processing Detecting Gestures Implementing Face Recognition Exploring Touch Devices with of Chapter 15: Movement and Location

5 Using Movement As and in Interaction Using Software-Based Serial Ports Understanding and Using GPS Storing Data Logging GPS Data to an Arduino Sending GPS Data Determining Location by IP Address What to Do Next Chapter 16: Interfaces and Controls Examining Tools, Affordances, and Aesthetics Reexamining Tilt Exploring InputShield Understanding Touch Exploring Open Source Touch Hardware Communicating Using OSC Using the Wiimote Chapter 17: Spaces and Environments Using Architecture and Space Sensing Environmental Data Using an XBee with Arduino Placing Objects in 2D Using the X10 Protocol Setting Up an RFID Sensor Reading Heat and Humidity Chapter 18: Further Resources? Bibliography Conclusion Appendix: Circuit Diagram Symbols Programming Glossary Colophon