In this Appendix chapter, we discuss HCI, the interaction between Man and Machine which has been a quite successful approach.

Similar documents
CSC384 Intro to Artificial Intelligence

Lecture 1: The Visual System

Telling Humans and Computers Apart (Automatically) How Lazy Cryptographers do AI

Comparative Analysis of CAPTCHA Based Techniques : A Review

This puzzle is based on the following anecdote concerning a Hungarian sociologist and his observations of circles of friends among children.

Optical Character Recognition (OCR)

Problem-Based Group Activities for a Sensation & Perception Course. David S. Kreiner. University of Central Missouri

Graphical Environment Tool for Development versus Non Graphical Development Tool

GLOVE-BASED GESTURE RECOGNITION SYSTEM

FILMS AND BOOKS ADAPTATIONS

SIPAC. Signals and Data Identification, Processing, Analysis, and Classification

Classifying Manipulation Primitives from Visual Data

Strategic White Paper

Reflection Report International Semester

The Scientific Data Mining Process

Wait-Time Analysis Method: New Best Practice for Performance Management

Application development = documentation processing

Artificial Intelligence and Asymmetric Information Theory. Tshilidzi Marwala and Evan Hurwitz.

I d Rather Stay Stupid: The Advantage of Having Low Utility

Decision Making under Uncertainty

Risk Management Advisory Services, LLC Capital markets audit and control

Appendices master s degree programme Human Machine Communication

N-CAP Users Guide. Everything You Need to Know About Using the Internet! How Worms Spread via (and How to Avoid That)

What is Artificial Intelligence?

The Advantages and Disadvantages of Using a Visual System

CHAPTER 15: IS ARTIFICIAL INTELLIGENCE REAL?

GLOBAL REASONING TEST PRACTICE TEST

Appendix A. Functional Requirements: Document Management

INTRUSION PREVENTION AND EXPERT SYSTEMS

Appendices master s degree programme Artificial Intelligence

Information Visualization WS 2013/14 11 Visual Analytics

Kant s Fundamental Principles of the Metaphysic of Morals

A Client-Server Interactive Tool for Integrated Artificial Intelligence Curriculum

Binocular Vision and The Perception of Depth

2015 State of Artificial Intelligence & Big Data in the Enterprise

OPTIMALITY THEORY AND THE THREE LAWS OF ROBOTICS 1

Five Tips for Presenting Data Analyses: Telling a Good Story with Data

How to Copyright Your Book

Enhancing Cloud Security By: Gotcha (Generating Panoptic Turing Tests to Tell Computers and Human Aparts)

Visual Planning and Scheduling Systems. A White Paper. Gregory Quinn President Quinn & Associates Inc September 2006 Updated October 2006

Everything you wanted to know about using Hexadecimal and Octal Numbers in Visual Basic 6

COMP6053 lecture: Relationship between two variables: correlation, covariance and r-squared.

What is Organizational Communication?

Five Best Practices for Maximizing Big Data ROI

CHAPTER 1. Introduction to CAD/CAM/CAE Systems

Problem of the Month: Cutting a Cube

Healthcare, transportation,

Taxonomy Enterprise System Search Makes Finding Files Easy

LESSON 7: IMPORTING AND VECTORIZING A BITMAP IMAGE

Exercise. Rule #1 Exercise boosts brain power.

Introduction. Chapter 1

The Very Best Way We Know to Play the Exacta

Computer Integrated Manufacturing CIM A T I L I M U N I V E R S I T Y

Artificial Intelligence in Retail Site Selection

Reading and Taking Notes on Scholarly Journal Articles

CHAPTER 4. Standards Battles and Design Dominance

Avoid the biggest pitfalls with Video Conferencing

Grid Computing for Artificial Intelligence

Strategic Alignment An ORTEC White Paper

The Taxman Game. Robert K. Moniot September 5, 2003

HOW TO WRITE A FILM ESSAY

Workshop Perceptual Effects of Filtering and Masking Introduction to Filtering and Masking

Social & Political Philosophy. Karl Marx ( ) Economic and Philosophic Manuscripts of 1844

Introduction to the Perceptual Computing

Form Design Guidelines Part of the Best-Practices Handbook. Form Design Guidelines

A Theoretical Perspective on Leadership Development in the Construction Industry

Part I. The Picture class

Assessment Management

World Trade Analysis

A PUBLIC AGENDA CITIZEN CHOICEWORK GUIDE FOR COMMUNITY CONVERSATIONS, CLASSROOMS, STUDY GROUPS AND INDIVIDUALS. Public Agenda

Using Emergent Behavior to Improve AI in Video Games

Best Practices for Improving the Quality and Speed of Your Agile Testing

What's New? Web Forms for Marketers 2.1. An Overview of the New Functionality in Web Forms for Marketers 2.1. What's New?

ABBYY recognition technologies ideal alternative to manual data entry. Automating processing of exam tests.

What is the Future for Mail Sorting?

Illustrator - bezier pen, advanced techniques

Enterprise Organizations Need Contextual- security Analytics Date: October 2014 Author: Jon Oltsik, Senior Principal Analyst

The Big Four: Contrast, Repetition, Alignment, Proximity

Socialprise: Leveraging Social Data in the Enterprise Rev 0109

Big Data. Donald Kossmann & Nesime Tatbul Systems Group ETH Zurich

Lowercase Letters Capital Letters Picture Cards

Final Assessment Report of the Review of the Cognitive Science Program (Option) July 2013

Whitepaper. Innovations in Business Intelligence Database Technology.

Balanced Scorecard: Better Results with Business Analytics

Planning Your Analysis. Copyright 2012 The University of Utah - All Rights Reserved

6.2.8 Neural networks for data mining

Retail Analytics The perfect business enhancement. Gain profit, control margin abrasion & grow customer loyalty

Lockout/Tagout (LOTO): Automating the process

APPLICATION OF MULTI-AGENT SYSTEMS FOR NETWORK AND INFORMATION PROTECTION

Epsilon Sigma Phi Conference Session. Maximize your Professional Relationships Through Coaching with EI

Coaching the team at Work

Test Automation Architectures: Planning for Test Automation

TEXTUAL ETL THE COMPONENTS. A WHITE PAPER BY W H Inmon. copyright 2014 Forest Rim Technology, all rights reserved

DESCRIPTIVE STATISTICS. The purpose of statistics is to condense raw data to make it easier to answer specific questions; test hypotheses.

Test-Retest Reliability and The Birkman Method Frank R. Larkey & Jennifer L. Knight, 2002

COOL ART WITH MATH & SCIENCE OPTICAL ILLUSIONS CREATIVE ACTIVITIES THAT MAKE MATH & SCIENCE FUN FOR KIDS! A NDERS HANSON AND ELISSA MANN

Determine If An Equation Represents a Function

How To Improve Your Profit With Optimized Prediction

What is Data Mining, and How is it Useful for Power Plant Optimization? (and How is it Different from DOE, CFD, Statistical Modeling)

Dashboards with Live Data For Predictive Visualization. G. R. Wagner, CEO GRW Studios, Inc.

Transcription:

Human and Computer One, a robot may not injure a human being, or through inaction, allow a human being to come to harm; Two, a robot must obey the orders given it by human beings except where such orders would conflict with the First Law; Three, a robot must protect its own existence as long as such protection does not conflict with the First or Second Laws. Isaac Asimov in I. Robot In this Appendix chapter, we discuss HCI, the interaction between Man and Machine which has been a quite successful approach. The main thesis argued in this work is the Integrated White+Black Box Approach, where we combine both white-box approach (which strongly utilizes human visual perception and intelligence) with black-box approach (which strongly utilizes computer strength in processing computations). Here, we elaborate various aspects from the two players involved: the human and the computer, to further support our arguments. The Strengths of Human Despite the ever increasing popularity of transferring our (human) works to computers for simplification of our life, there are still a lot of human tasks that cannot be done (or still poorly done) by current 1 computer, such as in areas of visual perception and intelligence. To illustrate the strength of human over computer, we highlight the recent research in CAPTCHA [1] (Completely Automated Public Turing Test to Tell Computers and Humans Apart) 2. Currently, CAPTCHA uses the following simple idea that: It is generally easier for computer to generate visualization than to derive information from the generated images. Figure 1: Gimpy [1]: What are the words written here? While it is considered easy for human to read the extremely distorted and corrupted words in Figure 1. (There are six of them: Cushion, Floor, Full, Hair, Serious, Sweet), it is difficult (but 1 Nobody knows whether future technologies will be able to take over the one or more areas where human is currently better. When that really happens, the works related with Human Computer Interaction around that areas must be revised. 2 Nowadays, many web services use CAPTCHA to verify that the user is really human instead of a malicious computer program. For example, when a user sign up for a free e-mail account, he will be asked to do what human is known to be good at but difficult for machine. This is to prevent the free e-mail account to be auto registered by malicious web-bots spammers. 1

not impossible as of mid 2007)) for the current state-of-the-art Optical Character Recognition (OCR) algorithms to correctly decipher the words. This CAPTCHA is called gimpy. Gimpy works by randomly grabs few letters or numbers and then distorts them using different colors, stretching the letters, adding extra noises such as dots and lines, etc. Despite such nasty alterations, most human pass this test quite easily 3. Figure 2: Pix [1]: What is the common object in these 4 sub-figures? Another case of superiority of human visual perception and intelligence in deriving information is shown in another CAPTCHA called pix (See Figure 2). Pix grabs four pictures with the same label (the pictures are already labeled by another human beforehand) and ask the user to find a single word that best describes the main object of the four pictures. Human can easily answer: worm (circled), but at this moment, to the best of the author s knowledge, there is yet a computer algorithm that can connect the correlation between those distinct pictures. Figure 3: Bongo [1]: What is the major difference between the left and right figure? In Figure 3, another CAPTCHA called Bongo is shown. In this IQ test, the users are asked to tell the major difference of the 4 pictures on the left side versus 4 pictures on the right. The answer is easy for human: Pictures on the left are drawn with thick lines whereas the pictures on the right are drawn with thin lines. It seems hard to create a dedicated algorithm to accomplish the same thing. Figure 4: Examples of visual features that are easily identified by human. 3 Sometimes, some GIMPY is set to be quite hard that even normal human has difficulties. The research between creating good CAPTCHA is still ongoing. 2

Yet another case is shown in Figure 4. Human can easily distinguish several visual features of whether a specific object in the given picture has an oval shape or triangle shape, curvy or straight, big or small, and so on. Computer needs a sophisticated algorithm to achieve the same feat and currently still not perfect. So, although computers are much faster than human in numerical computation, human are still far better at carrying out low-level tasks such as speech and image recognition (shown above). This is due in part to the massive parallelism employed by human brain, which makes it easier to solve such problems. Comparison of Human versus Computer In Table 1, we try to elaborate the differences between human and computer. Strengths Weaknesses Human Have common sense and bigger knowledge base, thus can percept his environment better than computer given appropriate means (especially in visual form). Can think (synthesize) new rules out of the box. Psychologically, human decision is more trusted than computer expert system decision. Can detect trends, patterns, or anomalies, in visualization data. Good in learning. Easily tired and bored, thus can only be utilized for a short period of time, perhaps as oracle only. Cannot do micro manage. Biased and inconsistent. Can make error. Not a perfect decision maker. Actually cannot see anything if the data is presented in awkward manner. Computer Speed: Fast. Reliable. Endurance: Not tired. Unbiased. Consistent. Can try much more combinations than what human is capable of. Difficult to synthesize new rules (cannot think out of the box ). Limited knowledge base. No common sense. Table 1: The Comparison of Human versus Computer From Table 1 above, we see that collaboration is possible. To maximize the benefit, each player should utilize his/its strengths to the fullest: Human should focus himself in doing what human are good and computer are not, and vice versa. Information visualization can be used to bridge the information flow between computer to human. In the context of addressing SLS Design and Tuning Problem like what we have seen in Chapter?? and Chapter??, we merge the individual strengths to form a better functionality as illustrated in Figure 5 and elaborated in Table 2. Human Understand the box : the COP fitness landscape and SLS Trajectory behavior. Think outside the box : Find insights of what is happening within the SLS Improve the SLS Design: Add good search strategies. Computer Process the box : Run the SLS. Visualize information: Compute FLST visualization, compute some statistics. Fine Tune: Use computer speed to fine tune the focused configuration space. Table 2: Human+Computer Tasks in Integrated White+Black Box Approach 3

Figure 5: Summary of the Collaboration Summary 1. The collaboration of two things is useful if and only if: (a) Both participants have some advantages that the other has not. (b) It can be proven that the advantages of each participant are complimentary for achieving the goals. (c) Appropriate interfaces are used. 2. We have shown that in the context of addressing SLS Design and Tuning Problem, human and computer in form of Integrated White+Black Box Approach are complementary and that information visualization can be used as a good interface to connect them. 4

Bibliography [1] Luis von Ahn, Manuel Blum, Nick J. Hopper, and John Langford. CAPTCHA: Telling humans and computers apart. In Lecture Notes in Computer Science, pages 294 311. Springer. 5

Index CAPTCHA, 1 Bongo, 2 Gimpy, 1 Pix, 2 Human and Computer, 1 The Strengths of Human, 1 6