An Automatic Method to Generate the Emotional Vectors of Emoticons Using Blog Articles

Similar documents
Cost Accounting 1. B r e a k e v e n A n a l y s i s. S t r a t e g y I m p l e m e n t a t i o n B a l a n c e d S c o r e c a r d s

Discover the power of reading for university learners of Japanese in New Zealand. Mitsue Tabata-Sandom Victoria University of Wellington

Document and entity information

この 外 国 弁 護 士 による 法 律 事 務 の 取 扱 いに 関 する 特 別 措 置 法 施 行 規 則 の 翻 訳 は 平

California Subject Examinations for Teachers

Bushido: Way of the Samurai. Golden Screens. Chokuo TAMURA Hawks with pine and plum blossom x cm each

Data Mining for Risk Management in Hospital Information Systems

JF Standard for Japanese-Language Education 2010

How To Teach English At Kumon

医 学 生 物 学 一 般 問 題 ( 問 題 用 紙 1 枚 解 答 用 紙 2 枚 )

Graduate Program in Japanese Language and Culture (Master s Program) Application Instructions

Electricity Business Act ( Act No. 170 of July 11, 1964)

Teacher Training and Certificate System

レッドハット 製 品 プライスリスト Red Hat Enterprise Linux2013 新 製 品 (ベースサブスクリプション) 更 新 :2015 年 4 22

Advanced Training Program for Teachers of the Japanese-Language Application Instructions For FY 2016

Local production for local consumption( 地 産 地 消 ) Worksheet 1. Task: Do you agree with this idea? Explain the reasons why you think so.

ใบสม ครเข าร วมโครงการน ส ตแลกเปล ยนมหาว ทยาล ยเกษตรศาสตร

レッドハット 製 品 プライスリスト Red Hat Enterprise Linux 製 品 (RHEL for HPC) 更 新 :2015 年 4 22

Unwillingness to Use Social Networking Services for Autonomous Language Learning among Japanese EFL Students

LEAVING CERTIFICATE 2011 MARKING SCHEME JAPANESE HIGHER LEVEL


育 デジ (Iku-Digi) Promoting further evolution of digital promotion

Panasonic AC-DC Power Supply Design Support Service

Most EFL teachers in Japan find that there are groups of verbs which consistently

Why today? What s next?

Direct Marketing Production Printing & Value-Added Services: A strategy for growth

Public Financial Assistance for Formal Education in Japan

Quality of. Leadership. Quality Students of Faculty. Infrastructure

Christ Episcopal Church Sei Ko Kai

HIF 2015 Japanese Language and Japanese Culture Program

EDB-Report. 最 新 Web 脆 弱 性 トレンドレポート( ) ~ Exploit-DB( 公 開 されている 内 容 に 基 づいた 脆 弱 性 トレンド 情 報 です


Upper Secondary Education in Japan

2009 年 3 月 26 日 2 泊 3 日 スーザン 田 辺 先 生 引 率 のセーレム 市 の 高 校 生 が 当 会 の 会 員 宅 や 会 員 友 人 宅 にホームステイをしました 以 下 は 彼 らの 感 想 文 です

Stormy Energy Future and Sustainable Nuclear Power

For victims of traffic accidents

Ritsumeikan University Global 30 Project AY 2012 Follow-up

Act on Special Measures Concerning Nuclear Emergency Preparedness (Act No. 156 of December 17, 1999)

In-class student presentations are a common method of oral evaluation in communicationfocused

平 成 26 年 度 生 入 学 選 考 試 験 英 語 [ 特 待 生 入 試 ]

第 2 回 Linux-HA Japan 勉 強 会

Preschool Education and Care in Japan

2016 July 5. August 16

Cash, Receivables & Marketable Securities

外 部 委 託 が 進 む 中 での 地 方 自 治 体 職 員 の 雇 用 の 保 護 PROTECTION OF EMPLOYMENT FOR LOCAL GOVERNMENT WORKERS UNDER OUTSOURCING

SPECIFICATION. Not recommend for new design. MS6M Power Integrated Module 7MBR15UF060 MS6M Fuji Electric Device Technology Co.,Ltd.

BULBOUS CELL MEDIA GROUP

Effect of Captioning Lecture Videos For Learning in Foreign Language 外 国 語 ( 英 語 ) 講 義 映 像 に 対 する 字 幕 提 示 の 理 解 度 効 果

Ibaraki University. Graduate School of Agriculture. (Master s Program)

AUTOMOBILE LIABILITY SECURITY ACT

Research on Support for Persons with Mental Disability to Make Transition to Regular Employment

Integrating Elements of Local Identity into Communication Activities

Grade 8 Language and Literature (English) Course Description

TS-3GB-S.R v1.0 VoIP Supplementary Services Descriptions: Call Forwarding - Unconditional

Bluetooth FAQ. This document is an FAQ (Frequently Asked Questions) about Bluetooth in general and Logitech products using Bluetooth technology.

Changing Views on Motivation in a Globalizing World

The existence of credential effects in Canadian nursing education; Quebec versus the rest of Canada

Grant Request Form. Request Form. (For continued projects)

Wicket Hiroto Yamakawa

Chiba Institute of Technology Graduate School

Abbreviations. Learning Goals and Objectives 学 習 到 達 目 標. Structure of Presentation

Electrical engineering have fun with building your own devices and travelling the world. Iwate Prefectural Mizusawa High School Sebastian DIEBOLD

Design Act ( Act No. 125 of 1959)

Employment Security Act (Act No. 141 of 1947)

Hello, Chicago Okinawa Kenjinkai members,

Beginning English Conversation Student Manual

Green Solution with Simegy

Current Situation of Research Nurse Education and Future Perspectives in Japan

英 語 上 級 者 への 道 ~Listen and Speak 第 4 回 ヨーロッパからの 新 しい 考 え. Script

Utilization & Promotion Activities of Cloud in Japan

Interest in the relationship between religion and language

Procedures to apply for Doctoral Degree

EFL Information Gap Activities for Architecture Majors

Absolute Beginner s Guide to Hiragana (With an Introduction to Grammar and Kanji)

Industrial Accident Compensation Insurance Application Guidance for Foreign Workers <Volume 2>

How Should Remote Monitoring Sensor Be Accurate?

7 myths about cars and free trade agreements

Studies of Large-Scale Data Visualization and Visual Data Mining

Grade 9 Language and Literature (English) Course Description

The Course of Study is the series of guidelines for subject

For thousands of years, teachers have looked for products to assist them in educating

Agenda. About Gengo. Our PostgreSQL usage. pgpool-ii. Lessons

レッドハット 製 品 プライスリスト 標 準 価 格. Red Hat Enterprise Linux 製 品 (RHEL Server)

GRADUATE SCHOOL OF INTERNATIONAL RELATIONS

Visitors International

JALT2009. The 35th JALT International Conference on Language Teaching and Learning The Teaching-Learning Dialogue: An Active Mirror

AW Travelling Light

prefecture key (7) (9) (10) (15) (17) (18) (26) (32) (34) (35) (39) (41)

Addressing Japan s Healthcare Challenges with Information Technology

New Publication of IIMA Global Market Volatility Index

Gender Equality in Education in Japan

Educational Administration in Japan

Introduction to the revised Child Care and Family Care Leave Law

第 9 回 仮 想 政 府 セミナー Introduction Shared Servicesを 考 える ~Old but New Challenge~ 東 京 大 学 公 共 政 策 大 学 院 奥 村 裕 一 2014 年 2 月 21 日

My experience of Ruby Education in Taiwan

Melonbooks DL Howto How to register, purchase and enjoy Doujin contents that are sold in Melonbooks DL and shut-out disgusting excuse of reproduction.

Investigation of rules for translating Japanese geographical names into English

The Four-Woman Concert in Genji Monogatari: A Window into Heian Musical Performance and Teaching. Lloyd Botway

Transcription:

An Automatic Method to Generate the Emotional Vectors of Emoticons Using Blog Articles Sho Aoki, Osamu Uchida Abstract In recent years, reputation analysis and opinion mining services using the articles written in personal blogs, message boards, and community web sites such as Facebook, MySpace, and Twitter have been developed. To improve the accuracy of the reputation analysis and the opinion mining, we have to extract emotions or reactions of writers of documents accurately. And now, graphical emoticons (emojis in Japanese) are often used in blogs and SNSs in Japan, and in many cases these emoticons have the role of modalities of writers of blog articles or SNS messages. That is, to estimate emotions represented by emoticons is important for reputation analysis and opinion mining. In this study, we propose a methodology for automatically generating the emotional vectors of graphical emoticons automatically using the collocation relationship between emotional words and emoticons which is derived from many blog articles. The experimental results show the effectiveness of the proposed method. Keywords Collective intelligence, Consumer-generated media, Blog, Emoticon, Emotional vector, Emotional word, Emoji, Opinion mining, Reputation analysis, User-generated content. I. INTRODUCTION N recent years, there has been a rapid spread of media such I as blogs, wikis, message boards, customer review sites, and social networking sites (SNSs), which make it possible for individuals to more easily generate information. These are collectively referred to as consumer-generated media or user-generated content, and the numbers of such media users are growing at an explosive rate. For example, Facebook [1], a leading SNS, has more than 600 million users worldwide and was the top visited website in the United States in 2010. Concurrent with the growth of SNSs, has been efforts to develop technology that could analyze such user-generated content for useful applications. One such tool is reputation analysis [2] and opinion mining [3]. Both of them can be considered as kinds of Web mining technologies used to analyze sentences posted to media (such as blogs, customer review sites, and SNSs) to Manuscript received April 5, 2011. S. Aoki was with the Graduate School of Engineering, Tokai University, 4-1-1 Kitakaname, Hiratsuka, Kanagawa, 259-1292 Japan. He is now with the Japan Aviation Electronics Industry, Ltd., Tokyo, Japan (e-mail: oginter1113@gmail.com). O. Uchida is with the Department of Human and Information Science, Tokai University, 4-1-1 Kitakaname, Hiratsuka, Kanagawa, 259-1292 Japan (corresponding author to provide phone: +81-463-58-1211; fax: +81-463-58-9461; e-mail: o-uchida@tokai.ac.jp). determine if the sentence writer has positive or negative impressions of, for example, a particular product. To accomplish this, reputation analysis and opinion mining utilizes the technology of natural language processing [4], and typically analyzes the emotional words that appear in the text of such media [5], [6]. In this study, we focus on the graphical emoticons ( emojis in Japanese [7]) that appear in sentences posted to blogs. In Japan, emojis have long been used with mobile phone email services [7] [10]. Especially among younger users, emojis provide a way to express emotions that cannot be adequately communicated in words. For example, the sweat-drop emoticon shown at the left in Fig. 1 can be used to express a wide range of emotions including embarrassment, indignation, quandary, and shock. Meanwhile, emoticons that express happiness include the heart symbol and face symbols that show happy expressions. Now, emojis have spread widely into other media formats. For example, in gmail, we can use graphical emoticons easily (Fig. 2). Because emojis effectively communicate the emotions (modality) of the writer, many users have become accustomed to their use when posting daily writings on blogs and SNSs not only from mobile phone but also from their personal computers (Fig. 3 shows an example of blog article with emojis). By determining the writer s emotions, as expressed by the emoticons that exist in sentences posted to blogs and SNSs, it is possible to improve the accuracy of Web mining technologies such as reputation analysis and opinion mining. For example, the following two texts are same but the emoticons at the end of these texts are not equal. The dish I ordered wasn t good. The dish I ordered wasn t good. If we only use the text for estimating the emotion, it is natural that two emotions derived from these texts are equal. However, it is expected that the emotion of the writer of the second sentence is madder than the first writer s one. It is evident from the example that to use the emoticon for analyzing writers emotions is very important. Because of this situation, there have been many studies on estimating the emotion by using emoticons. However, almost all of them were research for not Fig. 1 Examples of graphical emoticons (Emojis) 346

Fig. 2 Graphical emoticons (Emojis) utilizable in gmail (Hello, everyone.) (Today, I enjoyed my first date in a while.) (We went for a drive.) (Topic: Regular life) Fig. 3 Example of blog article with emojis graphical emoticons (emojis) but ASCII glyphs emoticons such as :-). Accordingly, in this paper we propose a methodology that automatically generates the emotional vector of graphical emoticons (emojis). To accomplish this, we collected a large volume of blog articles containing graphical emoticons and analyzed the co-occurrences of emoticons and emotional words to determine how the respective emoticons are used to facilitate emotional expression. In this study, we set 14 emotional vector dimensions, using Plutchik s emotion model [11] as a reference. II. PREVIOUS STUDY (My first date in a while) (Long distance love is hard, but we are lovey-dovey.) A. Study on Emoticons There have been lots of studies on ASCII glyphs emoticons [12] [20]. For example, Tanaka et al. [12] proposed methods for extracting emoticons n text and classifying them into some emotional categories. Kato et al. [13] examined the relationships between four emotional states anger, joy, sadness, and guilt and four different emoticons in mobile phone email communication. Ptaszynski et al. [14] proposed a system for affect analysis of emoticons based on theory of kinesics. Yuasa et al. [15] showed that emoticons convey emotions without the cognition of faces by using fmri. On the other hand, studies on graphical emoticons (emojis) are in an early phase. Yamamoto et al. [21] proposed a method for emoji disambiguation. Hagiwara and Mizuno [22] proposed an information retrieval method for mobile phones that enables the use of emoji in search queries, and their method is embedded into a practical mobile information retrieval system [23]. Yamashita et al. [24] discussed applications for using the emotional vector of emoji to deduce the mind state of email users, and for use in music retrieval systems. B. Analysis of Emotions and Impression from Text There has also been a great deal of study on extracting emotions and impressions from text for purposes such as reputation analysis and opinion mining [5], [25] [42]. For example, Shimizu and Hagiwara [25] proposed a method for estimating impressions based on the frequency of joint word co-occurrences in texts published on the World Wide Web. Kumamoto and Tanaka [26] proposed a method for extracting the impressions people receive from reading articles in newspapers. Emura et al. [27] proposed a method for extracting writer emotions based on the assumption that the emoticons added at the end of sentences express emotions. The kizasi.jp site [28] evaluates weblog users emotions toward keywords that are topical among weblogs, and appends emotional word tags to those keywords. III. PURPOSE OF STUDY Determining the emotions expressed via emoticons is important for reputation analysis and opinion mining by utilizing reviews from blogs, message boards, consumer review sites, and SNSs. In this study, we attempt to evaluate the emotions that are expressed via emoticons using not one sentiment but 14 emotional vector dimensions, because it is expected that some graphical emoticons mean a lot of emotions. Yamashita et al. [24] discussed the use of emotional vectors of graphical emoticon (emojis) when estimating writer mind states, but because the emotional vectors were made by questionnairing conducted by small people, questions were raised regarding the accuracy of the emotional vectors. In this study, we propose a method that can automatically generate emotional vectors of graphical emoticons (emojis) using a large volume of blog articles. We set 14 dimensions of emotional 347

Table 1: Examples of corresponding emotionally expressive words for 14 emotions Fig. 4 Plutchik s model of emotions vectors using Plutchik s emotion model (Fig. 4) [11] as a reference, and selected 288 emotional words from two Japanese dictionaries [43], [44], which we then divided into 14 basic emotions. IV. METHODOLOGY In this study, we used 14 dimensions of emotional vectors, using Plutchik s emotion model [11] as a reference, to express the emotions expressed in emoticons. The 14 dimensions comprise eight basic emotions (joy, trust, fear, surprise, sadness, disgust, anger, and anticipation) and six of the eight mixed emotions (love, awe, disapproval, remorse, contempt, and optimism). In this study, we assumed that emoticons used by writers in weblogs and the emotional words that appeared in the same sentence, were equivalent emotional expressions. We then prepared the emoticon emotional vectors by examining the frequency of co-occurrences between the emoticons and emotional words. We selected a total of 288 emotional words from two Japanese dictionaries [43], [44] and subjectively categorized the words into 14 basic emotions (Table 1). The concrete methodology used to prepare the emotional vectors is as follows. First, we collected a large volume of blog articles and extracted only those sentences with graphical emoticons (emojis). We then determined which sentences with emoticons also contained emotional words, and extracted those sentences. Then, we counted the co-occurrence of emoticons and emotional words in the extracted sentences. For example, in the sentence 自 分 に 腹 が 立 つ (I m angry at myself), the emotional word 腹 が 立 つ (angry) corresponds to the emotion anger, so we increase the frequency of the emotion anger for the emoticon. Using the same process, we tabulated the frequency for all of the extracted sentences. Finally, by normalizing the component values of the vectors so that they added up to a value of one, we prepared 14 dimensional emotional vectors. Emotion joy trust fear surprise sadness disgust anger anticipation love awe disapproval remorse contempt optimism Emotionally expressive words うれしい (happy), 楽 しい (fun), おもしろい (interesting), 幸 福 (blessed), 思 いがけない (unexpected), 喜 ぶ (delight), 愉 快 (amusing), 嬉 しさ (happiness), 楽 しみ (cherish), 感 謝 (thankful), 満 足 (satisfied) やむを 得 ない (inevitable), 仕 方 がない (unavoidable), しょうがない (inescapable) 恐 ろしい (terrifying), 怖 い (scary), 恐 怖 (fear), 危 ない (dangerous), 不 気 味 (eerie), 怖 い (scary) 凄 い (amazing), すさまじい (stupendous), 激 しい (fierce), 素 晴 らしい (splendid), とてつもない (incredible), 驚 く (amazed), びっくり (surprised), 仰 天 (astonished), 衝 撃 (shocked) 悲 しい (sad), 寒 い (cold), 悲 観 (pessimistic), やるせない (disconsolate), 悲 哀 (sorrow), 悲 痛 (heartrending), 感 傷 (sentimental), 嘆 き (sorrow), かわいそう (pitiful), 泣 く (crying), 涙 (tears), 哀 れみ (compassion) いまいましい (annoying), 薄 気 味 悪 い (creepy), うるさい (obnoxious), 嫌 い (dislike) しつこい (persistent), 険 悪 (loathing), 憎 悪 (hatred), 憎 い (hateful), 恨 み (resentment), 不 満 (dissatisfied), 心 外 (offensive), 残 念 (disappointment),, 遺 憾 (regret) あつかましい (audacious), 怒 り (rage), いらだたしい (irritating), くやしい (chagrin), 情 けない (pitiable), 腹 立 たしい (maddening), 腹 が 立 つ (angry), 不 愉 快 (unpleasant), 激 怒 (infuriated), 憤 怒 (enraged), 憤 慨 (outraged) 願 ってもない (unexpected), むなしい (futile) いとしい (lovely), 可 愛 い (cute), 恋 しい (longing), 慈 悲 深 い (benevolent), 愛 情 (affection), やさしい (gentle), 好 き (like), 友 情 (friendship), 愛 する (loved), 恋 愛 (romance), 惚 れる (enamored) 偉 い (impressive), かたじけない (indebted), かっこいい (cool), 尊 い (precious) 辛 い (difficult), やりきれない (unbearable), 切 ない (heartrending), 失 望 (disappointed), 絶 望 (despair), 情 けない (pitiable) うしろめたい (shame), やましい (guilty), 悔 しい (frustration), 悔 し 涙 (frustrated tears), 後 悔 (regret), 嫉 妬 (jealousy) あり 得 ない (unimaginable), くだらない (silly), ばかばかしい (ridiculous), 軽 蔑 (contemptible), 侮 蔑 (despise), 蔑 む (scorn), 見 下 す (condescension), 馬 鹿 にする (ridicule) 感 慨 深 い (profound), 待 ち 遠 しい (look forward), 豊 か (rich) 348

V. EXPERIMENT In order to validate the effectiveness of the proposed method, we conducted an experiment to designate emotional vectors using actual weblog articles. In this experiment, we collected blog articles written in Japanese from Ameba Blog [45], which has the largest number of active users in Japan. We collected articles from 3,700 blog sites and then extracted sentences that contain both emotional words and emoticons. This provided us with 45,256 sentences. Table 2 shows examples of the extracted sentences. While we can see from the table that some sentences were unsuitable for categorization, most sentences could be suitably categorized by the emotions expressed. We then generated emoji emotional vectors based on the extracted sentences. Figures 5 16 show examples of the prepared emotional vectors. We can see from the figures that there are certain emoticons with large component values for specific emotions, and other emoticons for which the component values are widely distributed among various emotions. In particular, for example, the emoticon has certain components that are in opposition to Plutchik s emotion model, which is to say that it is used to express components of widely contrasting emotions. Therefore, it is clear that it is not appropriate to uniquely attach specific emotions to that emoticon. The knowledge derived from the experimental results indicates that the number of kinds of emotions represented by graphical emoticons may be larger than that of ASCII glyphs emoticons, and we think that this consequence is an important outcome of this study. Fig. 5 Emotional vector of Fig. 6 Emotional vector of VI. SUMMARY AND FUTURE WORKS In this study, we proposed a methodology that can be used to automatically generate the emotional vector of various graphical emoticons (emojis) using the emotional words that co-occur with such emoticons. Furthermore, we conducted an experiment collecting and examining a large volume of blog articles, and showed the effectiveness of the proposed method. In our study, we set 14 dimensions for emotional vectors and subjectively divided 288 emotional words into 14 emotions. In the future, we will attempt to validate the number of dimension, and consider its application in areas such as for developing systems that perform accurate reputation analysis and opinion mining. This might be accomplished by combining our new method with existing methods for estimating emotions and impressions. Fig. 7 Emotional vector of ACKNOWLEDGMENT We would like to thank Professors Shohachiro Nakanishi and Hiroaki Kikuchi of Tokai University for valuable discussions. Fig. 8 Emotional vector of 349

Fig. 9 Emotional vector of Fig. 13 Emotional vector of Fig. 10 Emotional vector of Fig. 14 Emotional vector of Fig. 11 Emotional vector of Fig. 15 Emotional vector of Fig. 12 Emotional vector of Fig. 16 Emotional vector of 350

Table 2: Examples of sentences with co-occurrence of emoticons and emotionally expressive words Emotion joy trust fear surprise sadness disgust anger anticipation love awe disapproval remorse contempt optimism Sample extracted sentences 来 てくださった 方 々に 感 謝 いたします (I am thankful to those who came.) 久 々の 水 族 館 楽 しみだよ (I m cherishing the aquarium visit, as I haven t been for awhile.) みんな 疲 れていたからしょうがないよね (I guess it s inescapable, since everyone was tired.) 焦 ったってしょうがないから (It doesn t help to be impatient.) 生 首 みたいで 怖 いね これ (It s scary, like a severed head.) やはり 恐 怖 心 を 取 らなければなりません (I guess you have to get rid of the fear.) 久 しぶりに, 衝 撃 的 に 激 ウマだったぁ (It was shockingly super-tasty, something I haven t experienced in awhile.) すごいなって 思 います (I think it s amazing.) 涙 を 我 慢 していた (I held back my tears.) 悲 痛 な 声 が 聞 こえてくる (I can hear this heartrending voice.) この 世 でワースト3に 入 るくらい 嫌 い (It s one of the top three things I most dislike in the world.) ずるがしこいヤツだ (He s a sly fellow.) 自 分 に 腹 が 立 つ (I m mad at myself.) あの 男 つくづく 不 愉 快 な 奴 だ (I find that guy quite unpleasant.) ねがってもない 大 チャンスだぞ (It s an unexpected opportunity.) まぁ 期 待 してもしょうがないけど (Well, I can t expect too much.) 好 きになってきてるんです (I m starting to like him.) いや~ 惚 れました (Well, I m enamored.) 出 来 上 がりがオシャレでかっこいい (The end result is stylish and cool.) 真 剣 だからかっこいい (He s cool because he s serious.) みなさんには 失 望 しました (I was disappointed with you all.) 暖 かくて 切 ない 人 間 味 溢 れる 内 容 です (It s warm and heartrending, and full of humanity.) 悔 しいぜ (I m frustrated.) くよくよしてても 前 に 進 めないさ (You can t move forward if you worry about it all the time.) 私 のブログはくだらないね~ (My blog is sure silly.) 大 声 で 馬 鹿 にされた (I was ridiculed in a loud voice.) バリエーション 豊 かだよね (It s rich in variation.) 次 回 のオリンピックが 待 ち 遠 しいです (I m looking forward to the next Olympics.) 351

REFERENCES [1] Facebook, http:// www.facebook.com/ [2] F. R. Farmer and B. Glass, Building Web Reputation Systems, Yahoo Press, 2010. [3] B. Pang and L. Lee, Opinion mining and sentiment analysis, Foundations and Trends in Information Retrieval, vol. 2, issues 1-2, pp. 1 135, 2008. [4] P. Jackson and I. Moulinier, Natural Language Processing for Online Applications: Text Retrieval, Extraction and Categorization, 2nd ed., John Benjamins Publishing Company, 2007. [5] P. Turney, Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews, in Proc. 40th Annual Meeting of the Association for Computational Linguistics, 2002, pp. 417 424. [6] Y. Qu, J. Shanahan, and J. Wiebe, Exploring Attitude and Affect in Text: Theories and Applications, AAAI Press, 2004. [7] Wikipedia, http://en.wikipedia.org/wiki/emoji [8] A. Marcus, Icons, symbols, and signs: Visible languages to facilitate communication, Interactions, vol. 10, Issue 3, pp. 37 43, 2003. [9] M. Daliot-Bul, Japan's mobile technoculture: the production of a cellular playscape and its cultural implications, Media, Culture & Society, vol. 29, no. 6, pp. 954 971, 2007. [10] NTT Docomo, http://www.nttdocomo.co.jp/english/service/imode/make/content/pictog raph/ [11] R. Plutchik, The multifactor-analytic theory of emotion, Journal of Psychology, vol. 50, pp. 153 171, 1960. [12] Y. Tanaka, H. Takamura, and M. Okumura, Extraction and classification of facemarks, in Proc. 10th International Conference on Intelligent User Interfaces, 2005. [13] S. Kato, Y. Kato, and D. Scott, Relationships between emotional states and emoticons in mobile phone email communication in Japan, International Journal on E-Learning, vol. 8, issue 3, pp. 385 401, 2009. [14] M. Ptaszynski, J. Maciejewski, P. Dybala, R. Rzepka, and K. Araki, CAO: A fully automatic emoticon analysis system based on theory of kinesics, IEEE Trans. on Affective Computing, vol. 1, issue. 1, pp. 46-59, 2010. [15] M. Yuasa, K. Saito, and N. Mukawa, Emoticons convey emotions without cognition of faces: An fmri study, in Proc. Human Factors in Computing Systems 2006, 2006, pp. 1565 1170. [16] N. Suzuki and K. Tsuda, Express emoticons choice method for smooth communication of e-business, in Proc. 10th International Conf. Knowledge-Based and Intelligent Information and Engineering Systems, 2006, pp. 296 302. [17] A. Wolf, Emotional expression online: Gender differences in emoticon use, CyberPsychology and Behavior, vol. 3, no. 5, pp. 827 833, 2004. [18] N. Suzuki and K. Tsuda, Automatic emoticon generation method for Web community, in Proc. IADIS International Conf. Web Based Communities, 2006, pp. 331 334. [19] D. Derks, A.E.R. Bos, and J. von Grumbkow, Emoticons and social interaction on the Internet: The importance of social context, Computers in Human Behavior, vol. 23, issue 1, pp. 842 849, 2007. [20] T. Yamada, S. Tsuchiya, S. Kuroiwa, and F. Ren, Classification of facemarks using N-gram, in Proc. Intarnational Conf. Natural Language Processing and Knowledge Engineering, 2007, pp. 322 327. [21] C. Yamamoto, K. Bessho, T. Uchiyama, and T. Uchiyama, A method for processing a text with emoji, in Proc.16th Annual Conf. of the Association for Natural Language Processing, 2010, pp. 567 570 (in Japanese). [22] M. Hagiwara and T. Mizuno, Semantic analysis of emoticons for mobile information retrieval system, in Proc. JSAI SIG-KBS, vol. 89, pp. 47 53, 2010 (in Japanese). [23] Baidu.jp, http://m.baidu.jp/ [24] R. Yamashita, K. Tani, and K. Takami, A method of deducing the user s state of mind by analyzing pictographic characters and emoticons in mobile phone emails and a method of selecting music suitable for the user s state of mind, in Proc. 2008 IEEE Region 10 Conference, 2008. [25] K. Shimizu and M. Hagiwara, Image estimation of words on adjective co-occurrences, IEICE Trans. on Information and Systems, vol. J89-D, no. 11, pp. 2483 2490, 2006 (in Japanese). [26] T. Kumamoto and K. Tanaka, Proposal of impression mining from news articles, in Lecture Notes in Computer Science, vol. 3681, Springer, 2005, pp. 901 910. [27] K. Emura, M. Yasugi, S. Miyazaki, T. Kuboyama, T. Aoki, and, H. Yasuda, SVM-based emotion extraction from moblog text, Technical report of IEICE, vol. 106, no. 473, (KBSE-65), pp. 61 66, 2007, (in Japanese). [28] kizasi.jp, http://kizasi.jp/ [29] B. Pang, L. Lee, and S. Vaithyanathan, Thumbs up? Sentiment classification using machine learning techniques, in Proc. ACL 2002 Conf. on Empirical Methods in Natural Language Processing, 2002, pp. 79 86. [30] S. Morinaga, K. Yamanishi, K. Tateishi, and T. Fukushima, Mining product reputations on the Web, in Proc. 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2002. [31] S.O. Kim and E. Hovy, Determining the sentiment of opinions, in Proc. 20th International Conf. Computational Linguistics, 2004, pp. 1367 1373. [32] T. Wilson, J. Wiebe, and R. Hwa, Just how mad are you? Finding strong and weak opinion clauses, in Proc. 19th National Conf. Artificial Intelligence, 2004. [33] N. Evangelopoulos, Text Mining for Customer Satisfaction Monitoring, in Proc. 5th WSEAS International Conf. on Simulation, Modeling and Optimization, 2005, pp. 196 201. [34] N. Evangelopoulos, Case-based free text evaluation for customer satisfaction monitoring, WSEAS Trans. on Information Science and Engineering, vol.2, issue 11, pp. 1790-1797, 2005. [35] C. Cesarano, B, Dorr, A. Picariello, D. Reforgiato, A. Sagoff, and V. S. Subrahmanian, Oasys: An Opinion Analysis System, in Proc. AAAI 2006 Spring Symp. Computational Approaches to Analyzing Weblogs, 2006, pp. 21 26. [36] P. Chesley, B. Vincent, L. Xu, and R. K. Srihari, Using verbs and adjectives to automatically classify blog sentiment, in Proc. AAAI 2006 Spring Symp. Computational Approaches to Analyzing Weblogs, 2006, pp. 27 29. [37] F. Benamara, A. Cesarano, A. Picariello, D. Reforgiato, V. S. Subrahmanian, Sentiment analysis: Adverbs and adjectives are better than adjectives alone, in Proc. 2007 International Conf. Weblogs and Social Media, 2007, pp. 203 206. [38] V.S. Subrahmanian and D. Reforgiato, AVA: Adjective-verb-adverb combinations for sentiment analysis, Intelligent Systems, vol. 23, no. 4, pp. 43 50, 2008 [39] A. Abbasi, H. Chen, A. Salem, Sentiment analysis in multiple languages: Feature selection for opinion classification in Web forums, ACM Trans. on Information Systems, vol. 26, no. 3, article 12, 2008. [40] G. Berned, R. Farkas, Opinion mining in Hungarian based on textual and graphical clues, in 8th WSEAS International Conf. on Simulation, Modeling and Optimization, 2008, pp. 408 412. [41] K. P. P. Shein, Ontology based combined approach for sentiment classification, in 3rd International Conf. on Communication and Information Technology, 2009, pp. 112 115. [42] Y. Dang, Y. Zhang, H. Chen, A lexicon-enhanced method for sentiment classification: An experiment on online product reviews, Intelligent Systems, vol. 25, no. 4, pp. 46 53, 2010. [43] A. Nakamura, Dictionary of Emotive Expressions, Tokyo: Tokyodo Publishing, 1993 (in Japanese). [44] Y. Tobita and H. Asada, Dictionary of Modern Adjective Usage, Tokyo: Tokyodo Publishing, 1991 (in Japanese). [45] Ameba BLOG, http://ameblo.jp/ Sho Aoki was born in 1986. He received the B.E and the M.E. degrees from Tokai University, Japan, in 2009 and 2011, respectively. In 2011, he joined Japan Aviation Electronics Industry, Limited. His research interests include natural language processing and social Web computing. Osamu Uchida was born in 1973. He received the B.E degree from Meiji University, Japan, in 1995, the M. Info. Sci. degree from Japan Advanced Institute of Science and Technology in 1997, and the Ph.D. degree from University of Electro-Communications, Japan, in 2000. From 2000 to 2002, he was a research associate with Kanagawa Institute of Technology, Japan. He joined Tokai University, Japan, in 2002, and since 2007, he has been an associate professor with the Department of Human and 352

Information Science, Tokai University. His research interests include information theory, image processing, Web computing, and natural language processing. He is a member of IEEE, IEICE (The Institute of Electronics, Information and Communication Engineers), IPSJ (The Information Processing Society of Japan), IIEEJ (The Institute of Image Electronic Engineers of Japan), and JSAI (The Japanese Society for Artificial Intelligence). 353