Big Social Data Analysis

Size: px
Start display at page:

Download "Big Social Data Analysis"

Transcription

1 13 Big Social Data Analysis Erik Cambria, Dheeraj Rajagopal, Daniel Olsher, and Dipankar Das CONTENTS From Small to Big Social Data Analysis Large-Scale Sentiment Analysis and Tracking Toward the Concept-Level Analysis of Big Sentiment Data Conclusion References From Small to Big Social Data Analysis As the Web rapidly evolves, Web users too are evolving with it. In an era of social connectedness, people are becoming increasingly enthusiastic about interacting, sharing, and collaborating through social networks, online communities, blogs, Wikis, and other online collaborative media. In recent years, this collective intelligence has spread to many different areas, with particular focus on fields related to everyday life such as commerce, tourism, education, and health, causing the size of the social Web to expand exponentially. The distillation of knowledge from such a large amount of unstructured information, however, is an extremely difficult task, as the contents of today s Web are perfectly suitable for human consumption, but remain hardly accessible to machines. Big social data analysis grows out of this need and it includes disciplines such as social network analysis, multimedia management, social media analytics, trend discovery, and opinion mining. The opportunity to capture the opinions of the general public about social events, political movements, company strategies, marketing campaigns, and product preferences, in particular, has raised growing interest both within the scientific community, leading to many exciting open challenges, as well as in the business world, due to the remarkable benefits to be had from marketing and financial market prediction. This has led to the emerging fields of opinion mining and sentiment analysis, which deal with information retrieval and knowledge discovery from text using data mining and natural language processing (NLP) techniques to distill knowledge and opinions from the huge amount of information on 401

2 402 Big Data Computing the World Wide Web. Opinion mining and sentiment analysis are branches of the broad field of text data mining [21] and refer generally to the process of extracting interesting and nontrivial patterns or knowledge from unstructured text documents. They can be viewed as an extension of data mining or knowledge discovery from (structured) databases [12,36]. As the most natural form of storing information is text, opinion mining is believed to have a commercial potential higher than that of data mining. Opinion mining, however, is also a much more complex task, as it involves dealing with text data that are inherently big, unstructured, and fuzzy. Most of the existing approaches to opinion mining rely on the extraction of a vector representing the most salient and important text features, which is later used for classification purposes. Some of the most commonly used features are term frequency [42] and presence [33]. The latter is a binary-valued feature vectors in which the entries merely indicate whether a term occurs (value 1) or not (value 0) formed a more effective basis for reviewing polarity classification. This is indicative of an interesting difference between typical topic-based text categorization and polarity classification. While a topic is more likely to be emphasized by frequent occurrences of certain keywords, overall sentiment may not usually be highlighted through repeated use of the same terms. Other term-based features are often added to the features vector. Position is one of these, in consideration of how the position of a token in a text unit can affect the way in which the token affects the sentiment of the text. Also presence of n-grams, typically bi-grams and tri-grams, is often taken into account as useful features. Some methods also rely on the distance between terms. Part of speech (POS) information (nouns, adjectives, adverbs, verbs, etc.) are also commonly exploited in general textual analysis as a basic form of word sense disambiguation [41]. Certain adjectives, in particular, have been proved to be good indicators of sentiment and sometimes have been used to guide feature selection for sentiment classification. In other works, eventually, the detection of sentiments was performed through selected phrases, which were chosen via a number of prespecified POS patterns, most including an adjective or an adverb [39]. All such approaches mainly rely on parts of text in which opinions and sentiments are explicitly expressed, for example, polarity terms, affect words, and their co-occurrence frequencies. Opinions and sentiments, however, are often conveyed implicitly through context- and domain-dependent concepts, which make purely syntactical approaches ineffective. To this end, novel approaches that go beyond mere word-level sentiment analysis are needed. Such approaches should employ new techniques capable of better grasping the conceptual rules that govern sentiment and the clues that can convey these concepts from realization to verbalization in the human mind. Next-generation opinion mining systems need broader and deeper common-sense knowledge bases and more cognitive and affective inspired reasoning methods, in order to better understand natural language opinions and sentiments and, hence, more

3 Big Social Data Analysis 403 efficiently bridge the gap between (unstructured) textual information and (structured) machine-processable data. Large-Scale Sentiment Analysis and Tracking Sentiment analysis research at large scale has mainly been performed through syntactical approaches. Godbole et al. [16] proposed a system for large-scale analysis of news and blogs built on Lydia [32]. Their approach involves the identification of sentiments and the subsequent assignment of orientation to them. Seven sentiment dimensions were chosen, namely general, health, crime, sports, business, politics, and media. An initial seed of sentiments is expanded using the synonym and antonym queries in two steps. During the first iteration, a preliminary score for each word is calculated using a WordNet-based depth function. During the second iteration, the number of flips, or apparent alternations, of words is calculated. The words that qualify above the 5-hop threshold are classified as valid sentiment words. The extracted sentiments were assigned both a polarity and a subjectivity score, which were exploited for the classification of news and blogs. Kucuktunc et al. [24] showed that human factors affect sentiments extracted from big data. They analyzed the Yahoo! Answers Corpus, a large-scale online question and answering system, where people ask questions and the community provides relevant answers. Users can choose a category for the question and vote on answers. Corpus contained 412 M sentences with about 34 M questions and 132 M answers. Several features that affected the sentiment of answers were analyzed: textual features, for example, question length (a general observation was that negative sentiments were dominant in the longer questions), punctuation (after 3 4 question marks, the attitude and sentimentality of the sentence shows a decreasing trend), and starting words; topical and temporal features; demographical features, for example, gender (women show a general positive attitude in their answers, whereas men are mostly neutral), age (a general trend is that the sentimentality decreases with increasing age), and education level (an increased sentimentality level is observed with increasing education level). A large-scale distributed system for Twitter sentiment analysis was built by Khuc et al. [23]. Twitter is a huge source of text data but the character limit of 140 makes it difficult to mine the sentiment data effectively. Twitter data, in fact, do not comply well with the existing NLP engines because of the increased use of nonlexical words and smileys to indicate sentiments. The primary advantage of Khuc et al. s system is the identification of sentiments of nontrivial sentiment words such as abbreviations and extended words, for example, lol and veeerrryyy goooodddd, and emoticons. After a lexicon builder

4 404 Big Data Computing normalizes the incoming tweets, a co-occurrence matrix is created through bi-gram phrases using the MapReduce framework. The cosine similarity between words is then computed and the edges with low cosine score are removed. Finally, a sentiment score propagation algorithm is implemented and the sentiment scores are calculated. Brew et al. [2] use a crowdsourced approach to label sentiments. They ask volunteers to manually annotate RSS feeds and use these for training on a daily basis, in order to create a sentiment tag cloud. Although the approach presents very good accuracy, the scope of the work is very narrow. The major issue with using machine-learning techniques is that a model that works well for sentiments in one domain might not work well for another. To overcome such an issue, Glorot et al. [14] proposed a deep learning approach that trains a classifier in one domain and successfully applies it to another. This method is called domain adaptation. The intuition behind using the intermediate concepts is that these better guide the semantic and affective transfer among domains. The approach works at two levels. Firstly, an unsupervised classifier learns higher-level features from Amazon reviews in all available domains. Secondly, a linear SVM with squared hinge loss is used for the training phase on the labeled data from the source domain and tested on the target domain. A task that immediately derives from large-scale sentiment analysis is big sentiment data tracking, that is, the aggregation of all the scattered emotional information related to a specific topic through the delivery of an at-aglance presentation of the main sentiment topics or a graphical visualization of how sentiment changes from time to time over multiple events. To this end, related sentiment components need to be gathered and associated in a structured way, so that the affective information is tractable with respect to user, topic/event, sentiment, and time. In many applications, analysts and other users are interested in tracking changes in sentiment about a product, political candidate, company, or other issues, over time. Early work proposed to detect and track events from text archives [40]. Such events were extracted from different newspaper texts, stories, and other important documents, where occurrence time of events, temporal location, and ordering of the events were specified. The event sentiment association highlights the fact that, though events and sentiments are closely coupled with each other from social, psychological, and commercial perspectives, there has been very little attention regarding their detection. The identification of the temporal relations between two events by taking the sentiment feature into account is also crucial in analyzing and tracking human sentiments. This is also important in a wide range of other NLP applications that include temporal question answering, document summarization, current information retrieval systems, etc. Later studies focused on temporal sentiment identification from social events. Fukuhara et al. [13] analyzed the temporal trends of sentiments and topics from a text archive that provided timestamps in weblogs and news

5 Big Social Data Analysis 405 (a) (b) Anger Anger Panicky Proceed Joy Panicky Proceed Joy 1 1 Attentive Attentive Ecstatic Ecstatic Disagreeable Enthusiastic Disagreeable Enthusiastic Disgust Disgust Initial Fear Initial Amused Fear position Amused 0.4 position 0.4 Hopeful Hopeful 0.2 Absence of input Annoyed information Annoyed Neutral 0 Serene Neutral Serene Final position Satisfied Satisfied 0.4 Final position 0.4 Sadness Sadness FIGURE 13.1 Ensemble sentiment streams obtained when fusing natural language data and facial expressions, without (a) and with (b) Kalman filtering. articles. The system produces two kinds of graphs: topic graph, which shows the temporal change of topics associated with a sentiment, and sentiment graph, which shows temporal change of sentiments associated with a topic. Mishne and de Rijke [28] proposed MoodViews, a system for the analysis of sentiment temporal changes based on LiveJournal mood tags. Similarly, Havre et al. [20] proposed ThemeRiver, a tool for visualizing thematic flows along with a timeline. In the context of multimodal sentiment analysis, finally, Cambria et al. [3] proposed a scalable methodology for fusing multiple cognitive and affective recognition modules in real time. Such a methodology is able to fuse any number of unimodal categorical modules, with very different time-scales and output labels. This is possible thanks to the use of a multidimensional vector space that provides the system with mathematical capabilities to deal with temporal issues. The proposed methodology outputs a continuous multidimensional stream that represents the user s cognitive and affective progress over time in a novel and efficient way (Figure 13.1). A Kalman filtering technique controls the ensemble stream in real time to ensure temporal consistency and robustness. In particular, the methodology has been shown effective to fuse two different modalities: natural language data and facial expressions. In general, evaluation issues are largely solved for categorical recognition approaches. Unimodal categorical modules can be exhaustively evaluated, thanks to the use of large well-annotated databases and wellknown measures and methodologies (such as percentage of correctly classified instances, cross-validation, etc.). The evaluation of the performance of dimensional approaches is, however, an open and difficult issue to be solved. To this end, future works are expected to focus in depth on evaluation issues applicable to dimensional approaches and multimodality.

6 406 Big Data Computing Toward the Concept-Level Analysis of Big Sentiment Data Standard approaches to opinion mining can be classified into three main categories: keyword spotting, lexical affinity, and statistical methods. All such approaches mainly rely on specific affect words that need to be explicitly used in the opinionated text. Hence, when emotions are conveyed implicitly, standard approaches are unable to correctly mine opinions and sentiments. More recent approaches to sentiment analysis, for example, the energy-based knowledge representation formalism [30] and sentic computing [4], in turn, work at concept-level in which they exploit semantic networks that allow one to take into account the conceptual and affective information implicitly conveyed by natural language concepts. Although scientific research in the area of emotion stretches back to the nineteenth century when Charles Darwin and William James proposed theories of emotion that continue to influence thinking today [8,22], the injection of affect into computer technologies is much more recent. During most of the last century, research on emotions was conducted by philosophers and psychologists, whose work was based on a small set of emotion theories that continue to underpin research in this area. The first researchers to try linking text to emotions were actually social psychologists and anthropologists who tried to find similarities on how people from different cultures communicate [31]. This research was also triggered by dissatisfaction with the dominant cognitive view centered around humans as information processors [26]. Later on, in the 1980s, researchers such as Turkle [38] began to speculate about how computers might be used to study emotions. Systematic research programs in this front began to emerge in the early 1990s. For example, Scherer [35] implemented a computational model of emotion as an expert system. A few years later, Picard s landmark book affective computing [34] prompted a wave of interest among computer scientists and engineers looking for ways to improve human computer interfaces by coordinating emotions and cognition with task constraints and demands. Affect detection is critical because an affect-sensitive interface can never respond to users affective states if it cannot sense their affective states. Affect detection need not be perfect but must be approximately on target. Affect detection is, however, a very challenging problem because emotions are constructs (i.e., conceptual quantities that cannot be directly measured) with fuzzy boundaries and with substantial individual difference variations in expression and experience. To overcome such an issue, sentic computing * builds upon a brain-inspired and psychologically motivated affective categorization model [5] that can potentially describe the full range of emotional experiences in terms of four independent but concomitant dimensions, whose different levels of activation make up the total emotional state of the mind *

7 Big Social Data Analysis 407 Sensitivity Aptitude Attention 1 Vigilance Ecstasy 1 e 4/18σ 2 σ 2π 1 e 1/18σ 2 σ 2π 1 e 1/18σ 2 σ 2π 1 e 4/18σ 2 σ 2π 1 FIGURE 13.2 The hourglass of emotions. 0 Admiration (Figure 13.2). In sentic computing, whose term derives from the Latin sentire (root of words such as sentiment and sentience) and sensus (intended both as capability of feeling and as common-sense), the analysis of natural language is based on affective ontologies and common-sense reasoning tools, which enable the analysis of text not only at document-, page-, or paragraph-level, but also at sentence- and clause-level. In particular, sentic computing involves the use of AI and Semantic Web techniques, for knowledge representation and inference; mathematics, for carrying out tasks such as graph mining and multi-dimensionality reduction; linguistics, for discourse analysis and pragmatics; psychology, for cognitive and affective modeling; sociology, for understanding social network dynamics and social influence; finally ethics, for understanding related issues about the nature of mind and the creation of emotional machines. In order to effectively mine and analyze opinions and sentiments, it is necessary to bridge the gap between unstructured natural language data and structured machine-processable data. To this end, an intelligent software engine has been proposed, within the umbrella of sentic computing, to Rage Loathing Anger Disgust Annoyance Boredom Grief Interest Pensiveness Pleasantness Anticipation Pleasantness Serenity Distraction Joy Acceptance Apprehension Sadness Surprise Attention Aptitude Sensitivity Trust Fear Amazement Terror

8 408 Big Data Computing Training corpus CF-IOF Spectral association Concept n-grams IsaCore SBoCs Concept n-grams Text Pre-processing Hourglass model lemmas Sentic parser Affective valence indicators Sentic medoids AffectNet extract the semantics and sentics (i.e., the conceptual and affective information) associated with natural language text, in a way that the opinions and sentiments in it contained can be more easily aggregated and interpreted. The engine exploits graph mining and multi-dimensionality reduction techniques on IsaCore [7] and AffectNet [4], respectively (Figure 13.3). Several other affect recognition and sentiment analysis systems [1,9 11,25,27,37] are based on different emotion categorization models, which generally comprise a relatively small set of categories (Table 13.1). The Hourglass of Emotions, in turn, allows the opinion-mining engine to classify affective information both in a categorical way (according to a wider number of emotion categories) and in a dimensional format (which facilitates comparison and aggregation). The opinion-mining engine consists of four main components: a preprocessing module, which performs a first skim of the opinion; the sentic parser, whose aim is to extract concepts from the opinionated text; the IsaCore module, for inferring the semantics associated with the given concepts; the AffectiveSpace module, for the extraction of sentics. The pre-processing module first exploits linguistic dictionaries to interpret all the affective valence indicators usually contained in opinionated text, for example, special punctuation, complete upper-case words, cross-linguistic onomatopoeias, exclamation words, degree adverbs, and emoticons. Second, the module detects negation and spreads it in such a way that it can be accordingly associated to concepts during the parsing phase. Handling SBoCs Truncated SVD AffectiveSpace Semantics Sentics FIGURE 13.3 Opinion mining engine block diagram. After performing a first skim of the input text, the engine extracts concepts from it and, hence, infers related semantics and sentics.

9 Big Social Data Analysis 409 TABLE 13.1 An Overview of Recent Model-Based Sentiment Analysis Systems Study Techniques Model Corpora Knowledge Base [25] NB, SVM 2 categories Political articles None [10] LSA, MLP, NB, KNN 3 categories Dialog turns ITS interaction [11] Cohesion indices 4 categories Dialog logs ITS interaction [9] VSM, NB, SVM 5 categories ISEAR ConceptNet [37] WN presence, LSA 6 categories News stories WNA [27] WN presence 6 categories Chat logs WNA [1] Winnow linear, C4.5 7 categories Children stories None [15] VSM, k-means 24 categories YouTube, LiveJournal ConceptNet, WNA, HEO [6] VSM, neural networks [7] VSM, k-medoids, LDA 24 categories PatientOpinion ConceptNet, WNA 24 categories Twitter, LiveJournal, PatientOpinion ConceptNet, Probase Note: Studies are divided by techniques applied, number of categories of the model adopted, corpora, and knowledge base used. negation is an important concern in opinion- and sentiment-related analysis, as it can reverse the meaning of a statement. Such task, however, is not trivial as not all appearances of explicit negation terms reverse the polarity of the enclosing sentence and that negation can often be expressed in rather subtle ways, for example, sarcasm and irony, which are quite difficult to detect. Lastly, the module converts text to lower-case and, after lemmatizing it, splits the opinion into single clauses according to grammatical conjunctions and punctuation. For parsing text, a modified version of COGPARSE [29] is exploited for quickly identifying meaningful stretches of text without requiring timeconsuming phrase structure analysis. The use of constructions, defined as stored pairings of form and function [17], makes it possible to link distributed linguistic components to one another, easing extraction of semantics from linguistic structures. Constructions are composed of fixed lexical items and category-based slots, or spaces that are filled in by lexical items during text processing. An interesting example from the relevant literature would be the construction [<ACTION> <OBJECT> <DIRECTION> <OBJECT>], instances of which include sneeze the napkin across the table or hit the ball over the fence. Constructions help us understand not only how various lexical items work together to create overall meanings, but also give the parser a sense of what categories of words are used together and thus which words to expect where. The sentic parser uses this knowledge to determine which constructions are matched by which lexical items and how good each match is. Each sentic parser s construction contributes its own unique semantics and carries a unique name. The sentic parser uses

10 410 Big Data Computing knowledge about the lexical items found in text to choose the best possible construction for each span of text. Specifically, the parser looks each lexical item up in AffectNet and IsaCore, obtaining information about the basic category membership of that word. It then efficiently compares these potential memberships with the categories specified for each construction in the Corpus, finding the best matches so that, for example, the parser can extract a concept such as buy christmas present from a sentence such as today I bought a lot of very nice Christmas bells. Constructions are typically nested within one another: the sentic parser is capable of finding only those construction overlaps that are semantically sensible based on the overall semantics of constructions and construction slot categories, thus greatly reducing the time taken to process large numbers of texts. In the Big Data environment, a key benefit of construction-based parsing is that only small regions of correct text are required in order to extract meaning; word category information, and the generally small size of constructions mean that use can still be made of error-filled or otherwise normally unparseable texts. Texts do not have to have correct sentence-wide phrase structure in order to be parsed. Additionally, the sentic parser provides, for each retrieved concept, its relative frequency, valence, and status, that is, the concept s occurrence in the text, its positive or negative connotation, and the degree of intensity with which the concept is expressed, respectively. For each clause, the module outputs a small bag of concepts (SBoC), which is later on analyzed separately by the IsaCore and AffectiveSpace modules to infer the conceptual and affective information associated with the input text, respectively. In case any of the detected concepts is found more than once in the vector space (i.e., any of the concepts has multiple senses), all the SBoC concepts are exploited for a context-dependent coarse sense disambiguation. In particular, to represent the expected semantic value of the clause as a whole, the vectors corresponding to all concepts in the clause (in their ambiguous form) can be averaged together. The resulting vector does not represent a single meaning but the ad hoc category of meanings that are similar to the various possible meanings of concepts in the clause [19]. Then, to assign the correct sense to the ambiguous concept, the concept sense with the highest dot product (and thus the strongest similarity) with the clause vector is searched. Once natural language text is deconstructed into concepts, these are given as input to both the Isacore and the AffectiveSpace modules. While the former exploits the graph representation of the common and common-sense knowledge base to detect semantics, the latter exploits the vector space representation of AffectNet to infer sentics. In particular, the IsaCore module applies spectral association for assigning activation to key nodes of the semantic network, which are used as seeds or centroids for classification. Such seeds can simply be the concepts corresponding to the class labels of interest plus their available synonyms and antonyms, if any. Seeds can

11 Big Social Data Analysis 411 also be found by applying CF-IOF [4] on a training corpus (when available), in order to perform a classification that is more relevant to the data under analysis. After seed concepts are identified, the module spreads their values across the IsaCore graph. This operation, an approximation of many steps of spreading activation, transfers the most activation to concepts that are connected to the seed concepts by short paths or many different paths in affective common-sense knowledge. Therefore, the concepts of each SBoC provided by the sentic parser are projected on the matrix resulting from spectral association in order to calculate their semantic relatedness to each seed concept and, hence, their degree of belonging to each different class. Such classification measure is directly proportional to the degree of connectivity between the nodes representing the retrieved concepts and the seed concepts in the IsaCore graph. The concepts retrieved by the sentic parser are also given as input to the AffectiveSpace module, which, in turn, exploits dimensionality reduction techniques to infer the affective information associated with them. To this end, the concepts of each SBoC are projected into AffectiveSpace and, according to their position in the vector space representation of affective common-sense knowledge, they are assigned to an affective class defined through the sentic medoids technique [3]. As well as in the IsaCore module, the categorization does not consist in simply labeling each concept, but also in assigning a confidence score to each emotional label, which is directly proportional to the degree of belonging to a specific affective cluster (dot product between the given concept and the relative sentic medoid). Such affective information can also be exploited to calculate a polarity value associated with each SBoC provided by the sentic parser, as well as to detect the overall polarity associated with the opinionated text. In order for the engine to perform fast real-time opinion mining, the sentic vector associated with each AffectNet concept can be calculated a priori and saved in an SQL database. At runtime, then, the sentic vectors relative to each of the concepts composing the SBoC can be retrieved from such a database and aggregated to compute the overall affective information associated with the specific SBoC. This allows the sentic extraction process to be faster than directly applying the AffectiveSpace process. Similarly, spectral association can be computed a priori on IsaCore and the semantic classification of each concept (i.e., a set of different topic labels and the confidence associated with these) can be stored in an SQL database. On average, in fact, while the processing of a 100-word opinion is in the order of tens of seconds when directly applying the AffectiveSpace and IsaCore processes, the extraction of semantics and sentics is in the order of seconds when using the corresponding SQL databases. Both resources are in the order of hundreds of megabytes and, hence, easily exportable and embeddable into bigger systems for the development of applications in fields such as social media marketing, human computer interaction, and e-health [4].

12 412 Big Data Computing Conclusion As society evolves at the same pace of the Web, online social data are becoming increasingly important for both individuals and businesses. The Web 2.0, however, has unleashed an era of online participation that is causing user-generated contents to grow exponentially and, hence, to become continuously larger and more complex. In order to reduce such complexity, we need to adopt a multidisciplinary approach to big social data analysis, which combines different perspectives by means of social media analytics, trend discovery, multimedia management, social network analysis, opinion mining, and more. Specifically, in order to translate mere collected intelligence into true collective intelligence [18], we need to aim for a concept-level analysis of online social data that can enable the aggregation of the semantics and sentics associated with text. Next-generation opinion mining systems, thus, need broader and deeper affective commonsense knowledge bases, coupled with more brain-inspired and psychologically motivated reasoning models, in order to better understand natural language opinions through more efficiently bridging the gap between (unstructured) human-processable information and (structured) machineprocessable data. References 1. C. Alm, D. Roth, and R. Sproat. Emotions from text: Machine learning for textbased emotion prediction. In HLT/EMNLP, pp , Vancouver, A. Brew, D. Greene, and P. Cunningham. Using crowdsourcing and active learning to track sentiment in online media. In ECAI, pp , Lisbon, E. Cambria, N. Howard, J. Hsu, and A. Hussain. Sentic blending: Scalable multimodal fusion for the continuous interpretation of semantics and sentics. In IEEE SSCI, pp , Singapore, E. Cambria and A. Hussain. Sentic Computing: Techniques, Tools, and Applications. Springer, Dordrecht, the Netherlands, E. Cambria, A. Livingstone, and A. Hussain. The hourglass of emotions. In A. Esposito, A. Vinciarelli, R. Hoffmann, and V. Muller, editors, Cognitive Behavioral Systems, volume 7403 of Lecture Notes in Computer Science, pp Springer, Berlin, E. Cambria, T. Mazzocco, and A. Hussain. Application of multi-dimensional scaling and artificial neural networks for biologically inspired opinion mining. Biologically Inspired Cognitive Architectures, 4:41 53, E. Cambria, Y. Song, H. Wang, and N. Howard. Semantic multi-dimensional scaling for open-domain sentiment analysis. IEEE Intelligent Systems, DOI /MIS , 2013.

13 Big Social Data Analysis C. Darwin. The Expression of the Emotions in Man and Animals. John Murray, London, T. Danisman and A. Alpkocak. Feeler: Emotion classification of text using vector space model. In AISB, Aberdeen, S. D Mello, S. Craig, J. Sullins, and A. Graesser. Predicting affective states expressed through an emote-aloud procedure from autotutor s mixed-initiative dialogue. International Journal of Artificial Intelligence in Education, 16:3 28, S. D Mello, N. Dowell, and A. Graesser. Cohesion relationships in tutorial dialogue as predictors of affective states. In Conf. Artificial Intelligence in Education, pp. 9 16, Brighton, U. Fayyad, G. Piatetsky, and P. Smyth. From data mining to knowledge discovery: An overview. In Advances in Knowledge Discovery and Data Mining, U. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy, eds. pp MIT Press, Cambridge, T. Fukuhara, H. Nakagawa, and T. Nishida. Understanding sentiment of people from news articles: Temporal sentiment analysis of social events. In ICWSM, Boulder, X. Glorot, A. Bordes, and Y. Bengio. Domain adaptation for large-scale sentiment classification: A deep learning approach. In ICML, Bellevue, M. Grassi, E. Cambria, A. Hussain, and F. Piazza. Sentic web: A new paradigm for managing social media affective information. Cognitive Computation, 3(3): , N. Godbole, M. Srinivasaiah, and S. Skiena. Large-scale sentiment analysis for news and blogs. In ICWSM, Boulder, A. Goldberg. Constructions: A new theoretical approach to language. Trends in Cognitive Sciences, 7(5): , T. Gruber. Collective knowledge systems: Where the social web meets the semantic web. Web Semantics: Science, Services and Agents on the World Wide Web, 6(1):4 13, C. Havasi, R. Speer, and J. Pustejovsky. Coarse word-sense disambiguation using common sense. In AAAI CSK, Arlington, S. Havre, E. Hetzler, P. Whitney, and L. Nowell. Themeriver: Visualizing thematic changes in large document collections. IEEE Transactions on Visualization and Computer Graphics, 8(1):9 20, M. Hearst. Text data mining: Issues, techniques, and the relationship to information access. In UW/MS Workshop on Data Mining, Berkeley, W. James. What is an emotion? Mind, 34: , V. Khuc, C. Shivade, R. Ramnath, and J. Ramanathan. Towards building largescale distributed systems for twitter sentiment analysis. In ACM Symposium on Applied Computing, pp , Riva del Garda, O. Kucuktunc, B. Cambazoglu, I. Weber, and H. Ferhatosmanoglu. A large-scale sentiment analysis for Yahoo! answers. In ACM International Conference on Web Search and Data Mining, pp , Seattle, W. Lin, T. Wilson, J. Wiebe, and A. Hauptmann. Which side are you on? Identifying perspectives at the document and sentence levels. In Conference on Natural Language Learning, pp , Boston, C. Lutz and G. White. The anthropology of emotions. Annual Review of Anthropology, 15: , 1986.

14 414 Big Data Computing 27. C. Ma, A. Osherenko, H. Prendinger, and M. Ishizuka. A chat system based on emotion estimation from text and embodied conversational messengers. In International Conference on Active Media Technology, pp , Kagawa, G. Mishne and M. de Rijke. Capturing global mood levels using blog posts. In AAAI, pp , Boston, D. Olsher. COGPARSE: Brain-inspired knowledge-driven full semantics parsing. In Advances in Brain Inspired Cognitive Systems, Volume of 7366 Lecture Notes in Computer Science, pp. 1 11, D. Olsher. Full spectrum opinion mining: Integrating domain, syntactic and lexical knowledge. In ICDM, Brussels, C. Osgood, W. May, and M. Miron. Cross-Cultural Universals of Affective Meaning. University of Illinois Press, Brussels, pp , B. Pang and L. Lee. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2:1 135, B. Pang, L. Lee, and S. Vaithyanathan. Thumbs up? Sentiment classification using machine learning techniques. In EMNLP, pp , Philadelphia, R. Picard. Affective Computing. The MIT Press, Boston, K. Scherer. Studying the emotion-antecedent appraisal process: An expert system approach. Cognition and Emotion, 7: , E. Simoudis. Reality check for data mining. IEEE Expert, 11(5), C. Strapparava and R. Mihalcea. Learning to identify emotions in text. In ACM Symp. Applied Computing, pp , Fortaleza, S. Turkle. The Second Self: Computers and the Human Spirit. Simon & Schuster, New York, P. Turney. Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In ACL, pp , Philadelphia, C. Wayne. Multilingual topic detection and tracking: Successful research enabled by corpora and evaluation. In LREC, pp , Athens, Y. Wilks and M. Stevenson. The grammar of sense: Using part-of-speech tags as a first step in semantic disambiguation. Journal of Natural Language Engineering, 4(2): , H. Wu, R. Luk, K. Wong, and K. Kwok. Interpreting TF-IDF term weights as making relevance decisions. ACM Transactions on Information Systems, 26(3), Article 13, 2008.

Sentiment analysis for news articles

Sentiment analysis for news articles Prashant Raina Sentiment analysis for news articles Wide range of applications in business and public policy Especially relevant given the popularity of online media Previous work Machine learning based

More information

SenticNet: A Publicly Available Semantic Resource for Opinion Mining

SenticNet: A Publicly Available Semantic Resource for Opinion Mining Commonsense Knowledge: Papers from the AAAI Fall Symposium (FS-10-02) SenticNet: A Publicly Available Semantic Resource for Opinion Mining Erik Cambria University of Stirling Stirling, FK4 9LA UK eca@cs.stir.ac.uk

More information

Sentiment Analysis. D. Skrepetos 1. University of Waterloo. NLP Presenation, 06/17/2015

Sentiment Analysis. D. Skrepetos 1. University of Waterloo. NLP Presenation, 06/17/2015 Sentiment Analysis D. Skrepetos 1 1 Department of Computer Science University of Waterloo NLP Presenation, 06/17/2015 D. Skrepetos (University of Waterloo) Sentiment Analysis NLP Presenation, 06/17/2015

More information

A Comparative Study on Sentiment Classification and Ranking on Product Reviews

A Comparative Study on Sentiment Classification and Ranking on Product Reviews A Comparative Study on Sentiment Classification and Ranking on Product Reviews C.EMELDA Research Scholar, PG and Research Department of Computer Science, Nehru Memorial College, Putthanampatti, Bharathidasan

More information

RRSS - Rating Reviews Support System purpose built for movies recommendation

RRSS - Rating Reviews Support System purpose built for movies recommendation RRSS - Rating Reviews Support System purpose built for movies recommendation Grzegorz Dziczkowski 1,2 and Katarzyna Wegrzyn-Wolska 1 1 Ecole Superieur d Ingenieurs en Informatique et Genie des Telecommunicatiom

More information

Using Text and Data Mining Techniques to extract Stock Market Sentiment from Live News Streams

Using Text and Data Mining Techniques to extract Stock Market Sentiment from Live News Streams 2012 International Conference on Computer Technology and Science (ICCTS 2012) IPCSIT vol. XX (2012) (2012) IACSIT Press, Singapore Using Text and Data Mining Techniques to extract Stock Market Sentiment

More information

THE EVER-GROWING amount of available information

THE EVER-GROWING amount of available information 1 Semantic Multi-Dimensional Scaling for Open-Domain Sentiment Analysis Erik Cambria, Member, IEEE, Yangqiu Song, Member, IEEE, Haixun Wang, Member, IEEE, and Newton Howard, Member, IEEE Abstract The ability

More information

Text Mining: The state of the art and the challenges

Text Mining: The state of the art and the challenges Text Mining: The state of the art and the challenges Ah-Hwee Tan Kent Ridge Digital Labs 21 Heng Mui Keng Terrace Singapore 119613 Email: ahhwee@krdl.org.sg Abstract Text mining, also known as text data

More information

Sentiment analysis on news articles using Natural Language Processing and Machine Learning Approach.

Sentiment analysis on news articles using Natural Language Processing and Machine Learning Approach. Sentiment analysis on news articles using Natural Language Processing and Machine Learning Approach. Pranali Chilekar 1, Swati Ubale 2, Pragati Sonkambale 3, Reema Panarkar 4, Gopal Upadhye 5 1 2 3 4 5

More information

Sentiment analysis on tweets in a financial domain

Sentiment analysis on tweets in a financial domain Sentiment analysis on tweets in a financial domain Jasmina Smailović 1,2, Miha Grčar 1, Martin Žnidaršič 1 1 Dept of Knowledge Technologies, Jožef Stefan Institute, Ljubljana, Slovenia 2 Jožef Stefan International

More information

Sentiment Analysis on Big Data

Sentiment Analysis on Big Data SPAN White Paper!? Sentiment Analysis on Big Data Machine Learning Approach Several sources on the web provide deep insight about people s opinions on the products and services of various companies. Social

More information

Text Analytics. A business guide

Text Analytics. A business guide Text Analytics A business guide February 2014 Contents 3 The Business Value of Text Analytics 4 What is Text Analytics? 6 Text Analytics Methods 8 Unstructured Meets Structured Data 9 Business Application

More information

TOOL OF THE INTELLIGENCE ECONOMIC: RECOGNITION FUNCTION OF REVIEWS CRITICS. Extraction and linguistic analysis of sentiments

TOOL OF THE INTELLIGENCE ECONOMIC: RECOGNITION FUNCTION OF REVIEWS CRITICS. Extraction and linguistic analysis of sentiments TOOL OF THE INTELLIGENCE ECONOMIC: RECOGNITION FUNCTION OF REVIEWS CRITICS. Extraction and linguistic analysis of sentiments Grzegorz Dziczkowski, Katarzyna Wegrzyn-Wolska Ecole Superieur d Ingenieurs

More information

Natural Language to Relational Query by Using Parsing Compiler

Natural Language to Relational Query by Using Parsing Compiler Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 4, Issue. 3, March 2015,

More information

Efficient Techniques for Improved Data Classification and POS Tagging by Monitoring Extraction, Pruning and Updating of Unknown Foreign Words

Efficient Techniques for Improved Data Classification and POS Tagging by Monitoring Extraction, Pruning and Updating of Unknown Foreign Words , pp.290-295 http://dx.doi.org/10.14257/astl.2015.111.55 Efficient Techniques for Improved Data Classification and POS Tagging by Monitoring Extraction, Pruning and Updating of Unknown Foreign Words Irfan

More information

Building a Question Classifier for a TREC-Style Question Answering System

Building a Question Classifier for a TREC-Style Question Answering System Building a Question Classifier for a TREC-Style Question Answering System Richard May & Ari Steinberg Topic: Question Classification We define Question Classification (QC) here to be the task that, given

More information

Text Mining - Scope and Applications

Text Mining - Scope and Applications Journal of Computer Science and Applications. ISSN 2231-1270 Volume 5, Number 2 (2013), pp. 51-55 International Research Publication House http://www.irphouse.com Text Mining - Scope and Applications Miss

More information

Twitter sentiment vs. Stock price!

Twitter sentiment vs. Stock price! Twitter sentiment vs. Stock price! Background! On April 24 th 2013, the Twitter account belonging to Associated Press was hacked. Fake posts about the Whitehouse being bombed and the President being injured

More information

The multilayer sentiment analysis model based on Random forest Wei Liu1, Jie Zhang2

The multilayer sentiment analysis model based on Random forest Wei Liu1, Jie Zhang2 2nd International Conference on Advances in Mechanical Engineering and Industrial Informatics (AMEII 2016) The multilayer sentiment analysis model based on Random forest Wei Liu1, Jie Zhang2 1 School of

More information

A Graph-Based Approach to Commonsense Concept Extraction and Semantic Similarity Detection

A Graph-Based Approach to Commonsense Concept Extraction and Semantic Similarity Detection A Graph-Based Approach to Commonsense Concept Extraction and Semantic Similarity Detection Dheeraj Rajagopal dheeraj@nus.edu.sg Erik Cambria cambria@nus.edu.sg Kenneth Kwok kenkwok@nus.edu.sg Daniel Olsher

More information

Sentiment Analysis and Topic Classification: Case study over Spanish tweets

Sentiment Analysis and Topic Classification: Case study over Spanish tweets Sentiment Analysis and Topic Classification: Case study over Spanish tweets Fernando Batista, Ricardo Ribeiro Laboratório de Sistemas de Língua Falada, INESC- ID Lisboa R. Alves Redol, 9, 1000-029 Lisboa,

More information

Web Mining. Margherita Berardi LACAM. Dipartimento di Informatica Università degli Studi di Bari berardi@di.uniba.it

Web Mining. Margherita Berardi LACAM. Dipartimento di Informatica Università degli Studi di Bari berardi@di.uniba.it Web Mining Margherita Berardi LACAM Dipartimento di Informatica Università degli Studi di Bari berardi@di.uniba.it Bari, 24 Aprile 2003 Overview Introduction Knowledge discovery from text (Web Content

More information

Sentiment Analysis on Hadoop with Hadoop Streaming

Sentiment Analysis on Hadoop with Hadoop Streaming Sentiment Analysis on Hadoop with Hadoop Streaming Piyush Gupta Research Scholar Pardeep Kumar Assistant Professor Girdhar Gopal Assistant Professor ABSTRACT Ideas and opinions of peoples are influenced

More information

Others opinions can be crucial when it s time to make a decision or

Others opinions can be crucial when it s time to make a decision or Knowledge-Based Approaches to Concept-Level New Avenues in Opinion Mining and Erik Cambria, National University of Singapore Bjo rn Schuller, Technical University of Munich Yunqing Xia, Tsinghua University

More information

A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1

A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1 A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1 Yannis Stavrakas Vassilis Plachouras IMIS / RC ATHENA Athens, Greece {yannis, vplachouras}@imis.athena-innovation.gr Abstract.

More information

dm106 TEXT MINING FOR CUSTOMER RELATIONSHIP MANAGEMENT: AN APPROACH BASED ON LATENT SEMANTIC ANALYSIS AND FUZZY CLUSTERING

dm106 TEXT MINING FOR CUSTOMER RELATIONSHIP MANAGEMENT: AN APPROACH BASED ON LATENT SEMANTIC ANALYSIS AND FUZZY CLUSTERING dm106 TEXT MINING FOR CUSTOMER RELATIONSHIP MANAGEMENT: AN APPROACH BASED ON LATENT SEMANTIC ANALYSIS AND FUZZY CLUSTERING ABSTRACT In most CRM (Customer Relationship Management) systems, information on

More information

Search and Data Mining: Techniques. Text Mining Anya Yarygina Boris Novikov

Search and Data Mining: Techniques. Text Mining Anya Yarygina Boris Novikov Search and Data Mining: Techniques Text Mining Anya Yarygina Boris Novikov Introduction Generally used to denote any system that analyzes large quantities of natural language text and detects lexical or

More information

Data Mining on Social Networks. Dionysios Sotiropoulos Ph.D.

Data Mining on Social Networks. Dionysios Sotiropoulos Ph.D. Data Mining on Social Networks Dionysios Sotiropoulos Ph.D. 1 Contents What are Social Media? Mathematical Representation of Social Networks Fundamental Data Mining Concepts Data Mining Tasks on Digital

More information

VCU-TSA at Semeval-2016 Task 4: Sentiment Analysis in Twitter

VCU-TSA at Semeval-2016 Task 4: Sentiment Analysis in Twitter VCU-TSA at Semeval-2016 Task 4: Sentiment Analysis in Twitter Gerard Briones and Kasun Amarasinghe and Bridget T. McInnes, PhD. Department of Computer Science Virginia Commonwealth University Richmond,

More information

Towards SoMEST Combining Social Media Monitoring with Event Extraction and Timeline Analysis

Towards SoMEST Combining Social Media Monitoring with Event Extraction and Timeline Analysis Towards SoMEST Combining Social Media Monitoring with Event Extraction and Timeline Analysis Yue Dai, Ernest Arendarenko, Tuomo Kakkonen, Ding Liao School of Computing University of Eastern Finland {yvedai,

More information

HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS.

HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS. HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS. ALTILIA turns Big Data into Smart Data and enables businesses to

More information

Sentiment Analysis: a case study. Giuseppe Castellucci castellucci@ing.uniroma2.it

Sentiment Analysis: a case study. Giuseppe Castellucci castellucci@ing.uniroma2.it Sentiment Analysis: a case study Giuseppe Castellucci castellucci@ing.uniroma2.it Web Mining & Retrieval a.a. 2013/2014 Outline Sentiment Analysis overview Brand Reputation Sentiment Analysis in Twitter

More information

Analyzing survey text: a brief overview

Analyzing survey text: a brief overview IBM SPSS Text Analytics for Surveys Analyzing survey text: a brief overview Learn how gives you greater insight Contents 1 Introduction 2 The role of text in survey research 2 Approaches to text mining

More information

International Journal of Scientific & Engineering Research, Volume 4, Issue 11, November-2013 5 ISSN 2229-5518

International Journal of Scientific & Engineering Research, Volume 4, Issue 11, November-2013 5 ISSN 2229-5518 International Journal of Scientific & Engineering Research, Volume 4, Issue 11, November-2013 5 INTELLIGENT MULTIDIMENSIONAL DATABASE INTERFACE Mona Gharib Mohamed Reda Zahraa E. Mohamed Faculty of Science,

More information

A GENERAL TAXONOMY FOR VISUALIZATION OF PREDICTIVE SOCIAL MEDIA ANALYTICS

A GENERAL TAXONOMY FOR VISUALIZATION OF PREDICTIVE SOCIAL MEDIA ANALYTICS A GENERAL TAXONOMY FOR VISUALIZATION OF PREDICTIVE SOCIAL MEDIA ANALYTICS Stacey Franklin Jones, D.Sc. ProTech Global Solutions Annapolis, MD Abstract The use of Social Media as a resource to characterize

More information

Sentic Web: A New Paradigm for Managing Social Media Affective Information

Sentic Web: A New Paradigm for Managing Social Media Affective Information Cogn Comput (2011) 3:480 489 DOI 10.1007/s12559-011-9101-8 Sentic Web: A New Paradigm for Managing Social Media Affective Information Marco Grassi Erik Cambria Amir Hussain Francesco Piazza Received: 3

More information

Survey Results: Requirements and Use Cases for Linguistic Linked Data

Survey Results: Requirements and Use Cases for Linguistic Linked Data Survey Results: Requirements and Use Cases for Linguistic Linked Data 1 Introduction This survey was conducted by the FP7 Project LIDER (http://www.lider-project.eu/) as input into the W3C Community Group

More information

Bagged Ensemble Classifiers for Sentiment Classification of Movie Reviews

Bagged Ensemble Classifiers for Sentiment Classification of Movie Reviews www.ijecs.in International Journal Of Engineering And Computer Science ISSN:2319-7242 Volume 3 Issue 2 February, 2014 Page No. 3951-3961 Bagged Ensemble Classifiers for Sentiment Classification of Movie

More information

Search and Information Retrieval

Search and Information Retrieval Search and Information Retrieval Search on the Web 1 is a daily activity for many people throughout the world Search and communication are most popular uses of the computer Applications involving search

More information

Machine Learning using MapReduce

Machine Learning using MapReduce Machine Learning using MapReduce What is Machine Learning Machine learning is a subfield of artificial intelligence concerned with techniques that allow computers to improve their outputs based on previous

More information

The Italian Hate Map:

The Italian Hate Map: I-CiTies 2015 2015 CINI Annual Workshop on ICT for Smart Cities and Communities Palermo (Italy) - October 29-30, 2015 The Italian Hate Map: semantic content analytics for social good (Università degli

More information

SENTIMENT ANALYSIS: A STUDY ON PRODUCT FEATURES

SENTIMENT ANALYSIS: A STUDY ON PRODUCT FEATURES University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Dissertations and Theses from the College of Business Administration Business Administration, College of 4-1-2012 SENTIMENT

More information

Clustering Technique in Data Mining for Text Documents

Clustering Technique in Data Mining for Text Documents Clustering Technique in Data Mining for Text Documents Ms.J.Sathya Priya Assistant Professor Dept Of Information Technology. Velammal Engineering College. Chennai. Ms.S.Priyadharshini Assistant Professor

More information

Robust Sentiment Detection on Twitter from Biased and Noisy Data

Robust Sentiment Detection on Twitter from Biased and Noisy Data Robust Sentiment Detection on Twitter from Biased and Noisy Data Luciano Barbosa AT&T Labs - Research lbarbosa@research.att.com Junlan Feng AT&T Labs - Research junlan@research.att.com Abstract In this

More information

News Sentiment Analysis Using R to Predict Stock Market Trends

News Sentiment Analysis Using R to Predict Stock Market Trends News Sentiment Analysis Using R to Predict Stock Market Trends Anurag Nagar and Michael Hahsler Computer Science Southern Methodist University Dallas, TX Topics Motivation Gathering News Creating News

More information

Knowledge Discovery from patents using KMX Text Analytics

Knowledge Discovery from patents using KMX Text Analytics Knowledge Discovery from patents using KMX Text Analytics Dr. Anton Heijs anton.heijs@treparel.com Treparel Abstract In this white paper we discuss how the KMX technology of Treparel can help searchers

More information

Interactive Dynamic Information Extraction

Interactive Dynamic Information Extraction Interactive Dynamic Information Extraction Kathrin Eichler, Holmer Hemsen, Markus Löckelt, Günter Neumann, and Norbert Reithinger Deutsches Forschungszentrum für Künstliche Intelligenz - DFKI, 66123 Saarbrücken

More information

Decision Making Using Sentiment Analysis from Twitter

Decision Making Using Sentiment Analysis from Twitter Decision Making Using Sentiment Analysis from Twitter M.Vasuki 1, J.Arthi 2, K.Kayalvizhi 3 Assistant Professor, Dept. of MCA, Sri Manakula Vinayagar Engineering College, Pondicherry, India 1 MCA Student,

More information

SENTIMENT ANALYSIS: TEXT PRE-PROCESSING, READER VIEWS AND CROSS DOMAINS EMMA HADDI BRUNEL UNIVERSITY LONDON

SENTIMENT ANALYSIS: TEXT PRE-PROCESSING, READER VIEWS AND CROSS DOMAINS EMMA HADDI BRUNEL UNIVERSITY LONDON BRUNEL UNIVERSITY LONDON COLLEGE OF ENGINEERING, DESIGN AND PHYSICAL SCIENCES DEPARTMENT OF COMPUTER SCIENCE DOCTOR OF PHILOSOPHY DISSERTATION SENTIMENT ANALYSIS: TEXT PRE-PROCESSING, READER VIEWS AND

More information

Bridging CAQDAS with text mining: Text analyst s toolbox for Big Data: Science in the Media Project

Bridging CAQDAS with text mining: Text analyst s toolbox for Big Data: Science in the Media Project Bridging CAQDAS with text mining: Text analyst s toolbox for Big Data: Science in the Media Project Ahmet Suerdem Istanbul Bilgi University; LSE Methodology Dept. Science in the media project is funded

More information

CIRGIRDISCO at RepLab2014 Reputation Dimension Task: Using Wikipedia Graph Structure for Classifying the Reputation Dimension of a Tweet

CIRGIRDISCO at RepLab2014 Reputation Dimension Task: Using Wikipedia Graph Structure for Classifying the Reputation Dimension of a Tweet CIRGIRDISCO at RepLab2014 Reputation Dimension Task: Using Wikipedia Graph Structure for Classifying the Reputation Dimension of a Tweet Muhammad Atif Qureshi 1,2, Arjumand Younus 1,2, Colm O Riordan 1,

More information

Approaches for Sentiment Analysis on Twitter: A State-of-Art study

Approaches for Sentiment Analysis on Twitter: A State-of-Art study Approaches for Sentiment Analysis on Twitter: A State-of-Art study Harsh Thakkar and Dhiren Patel Department of Computer Engineering, National Institute of Technology, Surat-395007, India {harsh9t,dhiren29p}@gmail.com

More information

Sanjeev Kumar. contribute

Sanjeev Kumar. contribute RESEARCH ISSUES IN DATAA MINING Sanjeev Kumar I.A.S.R.I., Library Avenue, Pusa, New Delhi-110012 sanjeevk@iasri.res.in 1. Introduction The field of data mining and knowledgee discovery is emerging as a

More information

Cloud Storage-based Intelligent Document Archiving for the Management of Big Data

Cloud Storage-based Intelligent Document Archiving for the Management of Big Data Cloud Storage-based Intelligent Document Archiving for the Management of Big Data Keedong Yoo Dept. of Management Information Systems Dankook University Cheonan, Republic of Korea Abstract : The cloud

More information

ONLINE RESUME PARSING SYSTEM USING TEXT ANALYTICS

ONLINE RESUME PARSING SYSTEM USING TEXT ANALYTICS ONLINE RESUME PARSING SYSTEM USING TEXT ANALYTICS Divyanshu Chandola 1, Aditya Garg 2, Ankit Maurya 3, Amit Kushwaha 4 1 Student, Department of Information Technology, ABES Engineering College, Uttar Pradesh,

More information

Sentiment Analysis for Movie Reviews

Sentiment Analysis for Movie Reviews Sentiment Analysis for Movie Reviews Ankit Goyal, a3goyal@ucsd.edu Amey Parulekar, aparulek@ucsd.edu Introduction: Movie reviews are an important way to gauge the performance of a movie. While providing

More information

Social Media Analytics Summit April 17-18, 2012 Hotel Kabuki, San Francisco WELCOME TO THE SOCIAL MEDIA ANALYTICS SUMMIT #SMAS12

Social Media Analytics Summit April 17-18, 2012 Hotel Kabuki, San Francisco WELCOME TO THE SOCIAL MEDIA ANALYTICS SUMMIT #SMAS12 Social Media Analytics Summit April 17-18, 2012 Hotel Kabuki, San Francisco WELCOME TO THE SOCIAL MEDIA ANALYTICS SUMMIT #SMAS12 www.textanalyticsnews.com www.usefulsocialmedia.com New Directions in Social

More information

Module Catalogue for the Bachelor Program in Computational Linguistics at the University of Heidelberg

Module Catalogue for the Bachelor Program in Computational Linguistics at the University of Heidelberg Module Catalogue for the Bachelor Program in Computational Linguistics at the University of Heidelberg March 1, 2007 The catalogue is organized into sections of (1) obligatory modules ( Basismodule ) that

More information

C o p yr i g ht 2015, S A S I nstitute Inc. A l l r i g hts r eser v ed. INTRODUCTION TO SAS TEXT MINER

C o p yr i g ht 2015, S A S I nstitute Inc. A l l r i g hts r eser v ed. INTRODUCTION TO SAS TEXT MINER INTRODUCTION TO SAS TEXT MINER TODAY S AGENDA INTRODUCTION TO SAS TEXT MINER Define data mining Overview of SAS Enterprise Miner Describe text analytics and define text data mining Text Mining Process

More information

Sentiment analysis: towards a tool for analysing real-time students feedback

Sentiment analysis: towards a tool for analysing real-time students feedback Sentiment analysis: towards a tool for analysing real-time students feedback Nabeela Altrabsheh Email: nabeela.altrabsheh@port.ac.uk Mihaela Cocea Email: mihaela.cocea@port.ac.uk Sanaz Fallahkhair Email:

More information

2014/02/13 Sphinx Lunch

2014/02/13 Sphinx Lunch 2014/02/13 Sphinx Lunch Best Student Paper Award @ 2013 IEEE Workshop on Automatic Speech Recognition and Understanding Dec. 9-12, 2013 Unsupervised Induction and Filling of Semantic Slot for Spoken Dialogue

More information

A Survey on Product Aspect Ranking

A Survey on Product Aspect Ranking A Survey on Product Aspect Ranking Charushila Patil 1, Prof. P. M. Chawan 2, Priyamvada Chauhan 3, Sonali Wankhede 4 M. Tech Student, Department of Computer Engineering and IT, VJTI College, Mumbai, Maharashtra,

More information

Spatio-Temporal Patterns of Passengers Interests at London Tube Stations

Spatio-Temporal Patterns of Passengers Interests at London Tube Stations Spatio-Temporal Patterns of Passengers Interests at London Tube Stations Juntao Lai *1, Tao Cheng 1, Guy Lansley 2 1 SpaceTimeLab for Big Data Analytics, Department of Civil, Environmental &Geomatic Engineering,

More information

Sentiment Analysis of Movie Reviews and Twitter Statuses. Introduction

Sentiment Analysis of Movie Reviews and Twitter Statuses. Introduction Sentiment Analysis of Movie Reviews and Twitter Statuses Introduction Sentiment analysis is the task of identifying whether the opinion expressed in a text is positive or negative in general, or about

More information

Information Visualization WS 2013/14 11 Visual Analytics

Information Visualization WS 2013/14 11 Visual Analytics 1 11.1 Definitions and Motivation Lot of research and papers in this emerging field: Visual Analytics: Scope and Challenges of Keim et al. Illuminating the path of Thomas and Cook 2 11.1 Definitions and

More information

Data Mining Yelp Data - Predicting rating stars from review text

Data Mining Yelp Data - Predicting rating stars from review text Data Mining Yelp Data - Predicting rating stars from review text Rakesh Chada Stony Brook University rchada@cs.stonybrook.edu Chetan Naik Stony Brook University cnaik@cs.stonybrook.edu ABSTRACT The majority

More information

An Open Platform for Collecting Domain Specific Web Pages and Extracting Information from Them

An Open Platform for Collecting Domain Specific Web Pages and Extracting Information from Them An Open Platform for Collecting Domain Specific Web Pages and Extracting Information from Them Vangelis Karkaletsis and Constantine D. Spyropoulos NCSR Demokritos, Institute of Informatics & Telecommunications,

More information

Learning to Identify Emotions in Text

Learning to Identify Emotions in Text Learning to Identify Emotions in Text Carlo Strapparava FBK-Irst, Italy strappa@itc.it Rada Mihalcea University of North Texas rada@cs.unt.edu ABSTRACT This paper describes experiments concerned with the

More information

Taxonomy learning factoring the structure of a taxonomy into a semantic classification decision

Taxonomy learning factoring the structure of a taxonomy into a semantic classification decision Taxonomy learning factoring the structure of a taxonomy into a semantic classification decision Viktor PEKAR Bashkir State University Ufa, Russia, 450000 vpekar@ufanet.ru Steffen STAAB Institute AIFB,

More information

Big Data Analytics and Healthcare

Big Data Analytics and Healthcare Big Data Analytics and Healthcare Anup Kumar, Professor and Director of MINDS Lab Computer Engineering and Computer Science Department University of Louisville Road Map Introduction Data Sources Structured

More information

Clustering Connectionist and Statistical Language Processing

Clustering Connectionist and Statistical Language Processing Clustering Connectionist and Statistical Language Processing Frank Keller keller@coli.uni-sb.de Computerlinguistik Universität des Saarlandes Clustering p.1/21 Overview clustering vs. classification supervised

More information

3 Paraphrase Acquisition. 3.1 Overview. 2 Prior Work

3 Paraphrase Acquisition. 3.1 Overview. 2 Prior Work Unsupervised Paraphrase Acquisition via Relation Discovery Takaaki Hasegawa Cyberspace Laboratories Nippon Telegraph and Telephone Corporation 1-1 Hikarinooka, Yokosuka, Kanagawa 239-0847, Japan hasegawa.takaaki@lab.ntt.co.jp

More information

Combining Social Data and Semantic Content Analysis for L Aquila Social Urban Network

Combining Social Data and Semantic Content Analysis for L Aquila Social Urban Network I-CiTies 2015 2015 CINI Annual Workshop on ICT for Smart Cities and Communities Palermo (Italy) - October 29-30, 2015 Combining Social Data and Semantic Content Analysis for L Aquila Social Urban Network

More information

Sentiment analysis of Twitter microblogging posts. Jasmina Smailović Jožef Stefan Institute Department of Knowledge Technologies

Sentiment analysis of Twitter microblogging posts. Jasmina Smailović Jožef Stefan Institute Department of Knowledge Technologies Sentiment analysis of Twitter microblogging posts Jasmina Smailović Jožef Stefan Institute Department of Knowledge Technologies Introduction Popularity of microblogging services Twitter microblogging posts

More information

Guest Editors Introduction: Machine Learning in Speech and Language Technologies

Guest Editors Introduction: Machine Learning in Speech and Language Technologies Guest Editors Introduction: Machine Learning in Speech and Language Technologies Pascale Fung (pascale@ee.ust.hk) Department of Electrical and Electronic Engineering Hong Kong University of Science and

More information

Data Mining Applications in Fund Raising

Data Mining Applications in Fund Raising Data Mining Applications in Fund Raising Nafisseh Heiat Data mining tools make it possible to apply mathematical models to the historical data to manipulate and discover new information. In this study,

More information

PRODUCT REVIEW RANKING SUMMARIZATION

PRODUCT REVIEW RANKING SUMMARIZATION PRODUCT REVIEW RANKING SUMMARIZATION N.P.Vadivukkarasi, Research Scholar, Department of Computer Science, Kongu Arts and Science College, Erode. Dr. B. Jayanthi M.C.A., M.Phil., Ph.D., Associate Professor,

More information

CS 229, Autumn 2011 Modeling the Stock Market Using Twitter Sentiment Analysis

CS 229, Autumn 2011 Modeling the Stock Market Using Twitter Sentiment Analysis CS 229, Autumn 2011 Modeling the Stock Market Using Twitter Sentiment Analysis Team members: Daniel Debbini, Philippe Estin, Maxime Goutagny Supervisor: Mihai Surdeanu (with John Bauer) 1 Introduction

More information

Active Learning SVM for Blogs recommendation

Active Learning SVM for Blogs recommendation Active Learning SVM for Blogs recommendation Xin Guan Computer Science, George Mason University Ⅰ.Introduction In the DH Now website, they try to review a big amount of blogs and articles and find the

More information

Customer Intentions Analysis of Twitter Based on Semantic Patterns

Customer Intentions Analysis of Twitter Based on Semantic Patterns Customer Intentions Analysis of Twitter Based on Semantic Patterns Mohamed Hamroun mohamed.hamrounn@gmail.com Mohamed Salah Gouider ms.gouider@yahoo.fr Lamjed Ben Said lamjed.bensaid@isg.rnu.tn ABSTRACT

More information

Prediction of Stock Market Shift using Sentiment Analysis of Twitter Feeds, Clustering and Ranking

Prediction of Stock Market Shift using Sentiment Analysis of Twitter Feeds, Clustering and Ranking 382 Prediction of Stock Market Shift using Sentiment Analysis of Twitter Feeds, Clustering and Ranking 1 Tejas Sathe, 2 Siddhartha Gupta, 3 Shreya Nair, 4 Sukhada Bhingarkar 1,2,3,4 Dept. of Computer Engineering

More information

POSBIOTM-NER: A Machine Learning Approach for. Bio-Named Entity Recognition

POSBIOTM-NER: A Machine Learning Approach for. Bio-Named Entity Recognition POSBIOTM-NER: A Machine Learning Approach for Bio-Named Entity Recognition Yu Song, Eunji Yi, Eunju Kim, Gary Geunbae Lee, Department of CSE, POSTECH, Pohang, Korea 790-784 Soo-Jun Park Bioinformatics

More information

Effective Data Retrieval Mechanism Using AML within the Web Based Join Framework

Effective Data Retrieval Mechanism Using AML within the Web Based Join Framework Effective Data Retrieval Mechanism Using AML within the Web Based Join Framework Usha Nandini D 1, Anish Gracias J 2 1 ushaduraisamy@yahoo.co.in 2 anishgracias@gmail.com Abstract A vast amount of assorted

More information

Domain Classification of Technical Terms Using the Web

Domain Classification of Technical Terms Using the Web Systems and Computers in Japan, Vol. 38, No. 14, 2007 Translated from Denshi Joho Tsushin Gakkai Ronbunshi, Vol. J89-D, No. 11, November 2006, pp. 2470 2482 Domain Classification of Technical Terms Using

More information

Stock Market Prediction Using Data Mining

Stock Market Prediction Using Data Mining Stock Market Prediction Using Data Mining 1 Ruchi Desai, 2 Prof.Snehal Gandhi 1 M.E., 2 M.Tech. 1 Computer Department 1 Sarvajanik College of Engineering and Technology, Surat, Gujarat, India Abstract

More information

Social Media Mining. Data Mining Essentials

Social Media Mining. Data Mining Essentials Introduction Data production rate has been increased dramatically (Big Data) and we are able store much more data than before E.g., purchase data, social media data, mobile phone data Businesses and customers

More information

NATURAL LANGUAGE QUERY PROCESSING USING PROBABILISTIC CONTEXT FREE GRAMMAR

NATURAL LANGUAGE QUERY PROCESSING USING PROBABILISTIC CONTEXT FREE GRAMMAR NATURAL LANGUAGE QUERY PROCESSING USING PROBABILISTIC CONTEXT FREE GRAMMAR Arati K. Deshpande 1 and Prakash. R. Devale 2 1 Student and 2 Professor & Head, Department of Information Technology, Bharati

More information

A Review of Data Mining Techniques

A Review of Data Mining Techniques Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 3, Issue. 4, April 2014,

More information

Visual Analytics: Combining Automated Discovery with Interactive Visualizations

Visual Analytics: Combining Automated Discovery with Interactive Visualizations Visual Analytics: Combining Automated Discovery with Interactive Visualizations Daniel A. Keim, Florian Mansmann, Daniela Oelke, and Hartmut Ziegler University of Konstanz, Germany first.lastname@uni-konstanz.de,

More information

Legal Informatics Final Paper Submission Creating a Legal-Focused Search Engine I. BACKGROUND II. PROBLEM AND SOLUTION

Legal Informatics Final Paper Submission Creating a Legal-Focused Search Engine I. BACKGROUND II. PROBLEM AND SOLUTION Brian Lao - bjlao Karthik Jagadeesh - kjag Legal Informatics Final Paper Submission Creating a Legal-Focused Search Engine I. BACKGROUND There is a large need for improved access to legal help. For example,

More information

RAI ACTIVE NEWS: INTEGRATING KNOWLEDGE IN NEWSROOMS

RAI ACTIVE NEWS: INTEGRATING KNOWLEDGE IN NEWSROOMS RAI ACTIVE NEWS: INTEGRATING KNOWLEDGE IN NEWSROOMS M. Montagnuolo and A. Messina RAI Radiotelevisione Italiana, Italy ABSTRACT In the modern digital age methodologies for professional Big Data analytics

More information

Big Data Text Mining and Visualization. Anton Heijs

Big Data Text Mining and Visualization. Anton Heijs Copyright 2007 by Treparel Information Solutions BV. This report nor any part of it may be copied, circulated, quoted without prior written approval from Treparel7 Treparel Information Solutions BV Delftechpark

More information

Keywords social media, internet, data, sentiment analysis, opinion mining, business

Keywords social media, internet, data, sentiment analysis, opinion mining, business Volume 5, Issue 8, August 2015 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Real time Extraction

More information

MLg. Big Data and Its Implication to Research Methodologies and Funding. Cornelia Caragea TARDIS 2014. November 7, 2014. Machine Learning Group

MLg. Big Data and Its Implication to Research Methodologies and Funding. Cornelia Caragea TARDIS 2014. November 7, 2014. Machine Learning Group Big Data and Its Implication to Research Methodologies and Funding Cornelia Caragea TARDIS 2014 November 7, 2014 UNT Computer Science and Engineering Data Everywhere Lots of data is being collected and

More information

Social Media Implementations

Social Media Implementations SEM Experience Analytics Social Media Implementations SEM Experience Analytics delivers real sentiment, meaning and trends within social media for many of the world s leading consumer brand companies.

More information

Impact of Financial News Headline and Content to Market Sentiment

Impact of Financial News Headline and Content to Market Sentiment International Journal of Machine Learning and Computing, Vol. 4, No. 3, June 2014 Impact of Financial News Headline and Content to Market Sentiment Tan Li Im, Phang Wai San, Chin Kim On, Rayner Alfred,

More information

Microblog Sentiment Analysis with Emoticon Space Model

Microblog Sentiment Analysis with Emoticon Space Model Microblog Sentiment Analysis with Emoticon Space Model Fei Jiang, Yiqun Liu, Huanbo Luan, Min Zhang, and Shaoping Ma State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory

More information

Direct-to-Company Feedback Implementations

Direct-to-Company Feedback Implementations SEM Experience Analytics Direct-to-Company Feedback Implementations SEM Experience Analytics Listening System for Direct-to-Company Feedback Implementations SEM Experience Analytics delivers real sentiment,

More information

BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON

BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON Overview * Introduction * Multiple faces of Big Data * Challenges of Big Data * Cloud Computing

More information

Taxonomies in Practice Welcome to the second decade of online taxonomy construction

Taxonomies in Practice Welcome to the second decade of online taxonomy construction Building a Taxonomy for Auto-classification by Wendi Pohs EDITOR S SUMMARY Taxonomies have expanded from browsing aids to the foundation for automatic classification. Early auto-classification methods

More information