Mining wisdom. Anders Søgaard

Transcription

1 Mining wisdom Anders Søgaard Center for Language Technology University of Copenhagen Njalsgade DK-2300 Copenhagen S soegaard@hum.ku.dk

2 Source Clinton Inaugural 92 Clinton Inaugural 97 PTB CoNLL07 test Europarl Europarl Europarl Quote Powerful people maneuver for position and worry endlessly about who is in and who is out, who is up and who is down, forgetting those people whose toil and sweat sends us here and paves our way. But let us never forget : The greatest progress we have made, and the greatest progress we have yet to make, is in the human heart. When the dollar is in a free-fall, even central banks can t stop it. Our citizens can not accept that the European Union takes decisions in a way that is, at least on the face of it, bureaucratic. If competition policy is to be made subordinate to the aims of social and environmental policy, real efficiency and economic growth will remain just a dream. For Europe to become the symbol of peace and fraternity, we need a bold and generous policy to come to the aid of the most disadvantaged.

3 Learning curves for unigram and bigram models without lower-casing and with stop words: F1 (positives) unigrams bigrams data points

4 Literary Authorship Attribution with Phrase-structure Fragments Andreas van Cranenburgh Huygens ING Royal Netherlands Academy of Arts and Sciences Institute for Logic, Language and Computation University of Amsterdam June 8th, 2012 Computational Linguistics for Literature workshop, 2012, Montreal

5 Overview Stylometry is usually done with... superficial features e.g., content-free function words sophisticated statistics / machine learning techniques This work... uses full syntactic parse trees and extracts arbitrary sized fragments texts have in common similarity is defined as number of matching content words works with small input sizes (20 sentences) part of project* on syntactic patterns in literature; evaluated on authorship attribution in this paper. *

6 A phrase-structure S S S VP NP VP NP ADJP ADJP ADJP PP NP JJ NNS VBP RB RB : DT JJ NN VBZ JJ IN PRP$ JJ NN Happy families are all alike ; every unhappy family is unhappy in its own way Conrad? Hemingway? Huxley? Salinger? Tolstoy?

7 A phrase-structure fragment S S S VP NP VP NP ADJP ADJP ADJP PP NP JJ NNS VBP RB RB : DT JJ NN VBZ JJ IN PRP$ JJ NN Happy families are all alike ; every unhappy family is unhappy in its own way Conrad? Hemingway? Huxley? Salinger? Tolstoy!

8 Evaluation 23 novels from 5 authors leave one out cross-validation. # sentences: 15,000 training, 20 test fragments + trigrams works better than either alone Conrad Hemingway Huxley Salinger Tolstoy Conrad Hemingway Huxley Salinger Tolstoy Federalist papers: 14 of 15 disputed papers correctly classified.

9 Digitizing 18th Century French Literature: Comparing transcription methods for a critical edition text Ann Irvine Laure Marcellesi Afra Zomorodian Johns Hopkins Dartmouth College DE Shaw Group

10 Lettres taïtiennes Joséphine de Monbart 1784

11 Transcription Methods OTS French OCR output Non-expert French speakers on Mechanical Turk Non-expert undergraduate students, closely supervised Professional transcription service Gold standard: early-modern French scholar

12 Interesting bits Difficulty of language modernization We picked the professional transcriber to finish the project.

13 A Dictionary of Wisdom and Wit: Learning to Extract Quotable Phrases Michael Bendersky David A. Smith University of Massachusetts Amherst

14 Quotable Phrase Definition A phrase that is likely to be quoted A meaningful, memorable, and succinct statement that can be quoted without its original context But, not necessarily an already famous quote

15 Motivation Generate quotable phrases that will serve as catchy and entertaining previews for book promotion and advertisement Re- discover forgotten authors and understand what makes a phrase quotable

16 Motivation Generate quotable phrases that will serve as catchy and entertaining previews for book promotion and advertisement Re- discover forgotten authors and understand what makes a phrase quotable

17 Motivation Generate quotable phrases that will serve as catchy and entertaining previews for book promotion and advertisement Re- discover forgotten authors and understand what makes a phrase quotable

18 Motivation Generate quotable phrases that will serve as catchy and entertaining previews for book promotion and advertisement Re- discover forgotten authors and understand what makes a phrase quotable There is life in a poet so long as he is quoted. (Alfred Comyn Lyall, Studies in Literature and History )

19 Extraction Process Project Gutenberg Collection 22,000 English books Sentence Segmentation Unsupervised Filtering Supervised Quotable Phrase Detection 700,000 phrases Extracted Quotable Phrases

20 700,000 quotes on all topics

21 700,000 quotes on all topics There is no such thing as progress in art, any more than there is progress in the course of the stars. (Jacob Wassermann, The Goose Man )

22 700,000 quotes on all topics There is no such thing as progress in art, any more than there is progress in the course of the stars. (Jacob Wassermann, The Goose Man ) Justice is great, but mercy is greater. (Eden Phillpotts, Children of the Mist )

23 700,000 quotes on all topics There is no such thing as progress in art, any more than there is progress in the course of the stars. (Jacob Wassermann, The Goose Man ) Justice is great, but mercy is greater. (Eden Phillpotts, Children of the Mist ) Why do papers send a funny book to an old fossil of a reviewer with no sense of humor? (A. S. Neill, A Dominie in Doubt )

24 700,000 quotes on all topics There is no such thing as progress in art, any more than there is progress in the course of the stars. (Jacob Wassermann, The Goose Man ) Justice is great, but mercy is greater. (Eden Phillpotts, Children of the Mist ) Why do papers send a funny book to an old fossil of a reviewer with no sense of humor? (A. S. Neill, A Dominie in Doubt ) Visit NoisyPearls.com for Quote- a- day

25 A Pilot PropBank Annotation for Quranic Arabic Wajdi Zaghouani University of Pennsylvania Philadelphia, PA USA Abdelati Hawwari and Mona Diab Center for Computational Learning Systems Columbia University, NYC, USA

26 PropBank?? A corpus in which the arguments of each verb predicate are annotated with their semantic roles. Each predicate is also annotated with its sense ID. Annotations are done over syntactic trees (Phrase structure or Dependency structure).

27 The Quranic Arabic dependency TreeBank

28 Current status and future goals We already annotated the semantic roles for the 50 most frequent verbs in the Quranic Arabic Dependency Treebank (QATB). Future Goals : Finish the annotation of the remaining verbal predicates. For questions or if you need more details, you are kindly invited to come and see my poster!!

29

30 DATA SOURCE & METHODS Harper s Bazaar magazine issues from were scraped from Articles entitled New York Fashions were extracted from every issue. The MALLET toolkit ( was used to perform topic modeling on the data. Three topic models were generated: 100-topic model with 4 topic keys each 20-topic model with 4 topic keys each 20-topic model with 20 topic keys each

31 RESULTS For every topic model topics were plotted by year to identify trends on an exploratory basis. Example topics for each topic-model: 100-topic 4 keys: dresses skirt plain wool 20-topic 4 keys: silk long made back 20-topic 20 keys: black yard silk wide dress price worn half gros sold fringe folds trimming grain cents inches yards trimmed centre amp. Grouping topic keys by category (e.g. items of clothing, fabrics, color) will help identify specific trends.

32 FREQUENCY OF SELECTED TOPICS IN 20-TOPIC MODEL WITH 20 KEYS, BY YEAR

33 HEAT MAP OF ALL TOPICS IN 20-TOPIC MODEL WITH 20 KEYS