Toward Automatic Recognition of Spontaneous Facial Actions

Transcription

1 University Press Scholarship Online You are looking at 1-10 of 15 items for: keywords : facial recognition Toward Automatic Recognition of Spontaneous Facial Actions Marian Stewart Bartlett, Javier R. Movellan, Gwen Littlewort, Bjorn Braathen, Mark G. Frank, and Terrence J. Sejnowski in What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS) Published in print: 2005 Published Online: March 2012 ISBN: eisbn: Publisher: Oxford University Press DOI: / acprof:oso/ This chapter presents an approach for developing a fully automatic Facial Action Coding System (FACS). The approach uses state-of-theart machine learning techniques that can be applied to recognition of any facial action. The results of Study I provided guidance as to which image representations, or feature extraction methods, are most effective for facial action recognition. Gabor wavelets and Independent Component Analysis gave best performance. Study II found that machine learning techniques applied directly to the warped images is a promising approach for automatic coding of spontaneous facial expressions. Generally, the data employed hand-labeled feature points for the head pose tracking step. Furthermore, three of the issues are discussed in detail: (1) collection of a database of spontaneous facial expressions, (2) fully automatic face detection and tracking, and (3) fully automatic 3D head pose estimation. Automatic Facial Expression Recognition Jacob Whitehill, Marian Stewart Bartlett, and Javier R. Movellan in Social Emotions in Nature and Artifact Published in print: 2013 Published Online: January 2014 ISBN: eisbn: Publisher: Oxford University Press DOI: / acprof:oso/ In this chapter we define the problem space and describe the core components of automatic facial expression recognition systems. In particular, we discuss the most prominent methods of face Page 1 of 6

2 segmentation, face registration, feature extraction, classification, and temporal integration. We then present several practical applications of expression recognition technology. Finally, we comment on the core future challenges to the field, including generalization to multiple poses and ethnicities, collection of better training data, evaluation infrastructure, and commercialization. Facial Recognition Technology from the Lab to the Marketplace DOI: /nyu/ This chapter examines how automated facial recognition and related technologies were envisioned and designed to serve a set of institutional priorities during the period of political-economic neoliberalization in the United States. In the United States the effort to program computers to identify human faces began in the 1960s in research labs funded by the Department of Defense and intelligence agencies. By the 1990s new companies were formed to commercialize the technology, searching for market especially among institutions operating proprietary computer networks and large-scale identification systems. Across these sectors, biometric identification promised to enable the securitization of identity, the intensification of identification practices at a proliferation of sites a priority that has gone hand in hand with political-economic and governmental neoliberalization. Automated Facial Expression Analysis and the Mobilization of Affect DOI: /nyu/ This chapter explores the development of automated facial expression analysis, the effort to program computers to recognize facial expressions as they form on and move across people's faces. While facial recognition Page 2 of 6

3 technology treats the face as a blank somatic surface to be differentiated from other faces as an index of identity, automated facial expression analysis treats the dynamic surface of the face as the site of differentiation. In automated facial expression analysis, the dimensions and intensities of facial movements are analyzed as indices of emotion and cognition to determine what people are thinking and feeling. Automation of facial expression analysis promises to accomplish what facial recognition technology fails to do: read the interior of the person off the surface of the face, using the face itself as a field of classifiable information about the individual. Introduction: Experimenting with the Face DOI: /nyu/ This introductory chapter provides an overview of facial recognition technology (FRT). In the post 9/11 context, FRT emerged as an existing, reliable, and high-tech solution to the most pressing problem facing the United States. Indeed, new forms of human-machine integration promise to make surveillance systems function more effectively and extend their reach over time and space. However, whether these experimental technologies can or should be made to accomplish these goals remains open to debate, one that often plays out in press and policy discussion as a trade-off between security and privacy. This book explores the web of cultural practices and ideas, along with the policy programs and institutional priorities, in which automated face perception technologies are embedded. Dynamic Faces: Insights from Experiments and Computation Cristobal Curio, Heinrich H. Bulthoff, and Martin A. Giese (eds) Published in print: 2010 Published Online: August 2013 ISBN: eisbn: Item type: book Publisher: The MIT Press DOI: / mitpress/ The recognition of faces is a fundamental visual function that is important for social interaction and communication. Scientific interest in facial recognition has increased dramatically over the last decade. Researchers in such fields as psychology, neurophysiology, and Page 3 of 6

4 functional imaging have published more than 10,000 studies on face processing. Almost all of these studies focus on the processing of static pictures of faces; however, little attention has been paid to the recognition of dynamic faces, faces as they change over time a topic in neuroscience that is also relevant to a variety of technical applications, including robotics, animation, and human computer interfaces. This book offers an interdisciplinary overview of recent work on dynamic faces from the biological and computational perspectives. The chapters cover a range of topics, including the psychophysics of dynamic face perception, results from electrophysiology and imaging, clinical deficits in patients with impairments of dynamic face processing, and computational models that provide insights about the brain mechanisms for the processing of dynamic faces. The book offers neuroscientists and biologists a reference for designing experiments and provides computer scientists with knowledge that will help them improve technical systems for the recognition, processing, synthesizing, and animating of dynamic faces. Police Power and the Smart CCTV Experiment DOI: /nyu/ This chapter discusses the idea of Smart CCTV the integration of automated facial recognition with video surveillance. Recognizing a business opportunity, entrepreneurs attempting to commercialize facial recognition technology introduced the idea as a potential solution to the problems of surveillance labor and video overload. In June 2001, Visionics Corporation began a project with the Tampa Police Department (TPD) to incorporate the company's automated facial recognition product, called FaceIt, into Ybor City. However, after a two-year free trial period, the Tampa Police abandoned the effort to integrate automated facial recognition with the Ybor City CCTV system, citing its failure to identify a single wanted individual. The failure of this experiment demonstrates that building a functioning Smart CCTV system involves resolving a complex combination of social and technological problems. Page 4 of 6

5 Face Recognition Steven Z. Rapcsak in The Roots of Cognitive Neuroscience: Behavioral Neurology and Neuropsychology Published in print: 2013 Published Online: January 2014 ISBN: eisbn: Publisher: Oxford University Press DOI: / acprof:oso/ Neuropsychological evidence suggests that the recognition of facial identity is mediated by a distributed neural system. Damage to the temporal versus frontal lobe components of this face memory network produces qualitatively different types of recognition impairments. Specifically, whereas temporal lobe lesions result in clinical syndromes characterized by memory loss for familiar faces (prosopagnosia, person recognition disorders), frontal lobe lesions give rise to memory distortions involving false recognition/misidentification of unfamiliar faces. To account for these observations, we propose that dynamic functional interactions between temporal lobe memory and frontal executive systems normally play a critical role in maintaining face recognition accuracy by modulating the relationship between two complementary cognitive operations that involve processing faces at different levels of specificity: individuation and categorization. Inventing the Security-Conscious, Tech-Savvy Citizen DOI: /nyu/ This chapter examines how social uses of facial recognition and other biometrics are being defined at the level of individual users, and how the securitization of identity is incorporated at the level of individual practice. While biometric identification systems are being envisioned and designed mainly for large-scale institutional uses, developers have experimented with consumer applications. These consumer applications encourage the cooperation of individual users in the process of biometric system development and institutionalization. Moreover, consumer application of biometrics are designed with the new responsibilities and competencies of the security-conscious, tech-savvy citizen in mind. Page 5 of 6

6 The chapter then looks at two types of consumer applications: personal security applications and facial recognition software designed for the management of personal photo collections and online photo sharing. Finding the Face of Terror in Data DOI: /nyu/ This chapter studies the preoccupation with facial recognition technology (FRT) in the post-9/11 context. It considers claims of its technical neutrality by investigating the cultural logic that defined the technology and the practical politics that shaped system development. While the promise of facial recognition lay in its potential to individualize the terrorist threat by targeting specifically identified terrorist individuals, the effort to define it as a homeland security technology also made use of an implicit classifying logic, including rhetorical moves that reinforced old-fashioned notions of deviant facial types. Thus, the facialization of terrorism defining non-state forms of political violence with recourse to the racist logic of a mythic and demonized facial type was prevalent in discourse about FRT, appearing alongside claims about its technical neutrality. Page 6 of 6