An Exploration of Visual Indexing:

Size: px

Start display at page:

Download "An Exploration of Visual Indexing:"

Rosamund Reeves
8 years ago
Views:

1 An Exploration of Visual Indexing: Problems and Prospects Corinne Jörgensen Peter Jörgensen Florida State University School of Information Studies

10 Ascendancy of Images 1994 VCR Video Laser Disc 2004 Digital Camera DVD

11 Early Work Markey, 1984, Rorvig et al, 1987, Library Trends Beck & Jones, 1989, American Antiquity Hogan, M., Jörgensen, C., & Jörgensen, P., 1991., ICHIM 91 Jörgensen, C., Jörgensen, P., Hogan, M., 1993., ICHIM 93

12 Rorvig (1987) First, image description is a timeconsuming process, often requiring highlevel personnel for accurate results (Rorvig 1987) Second, individual differences in image perception give rise to extraordinary idiosyncrasy in the assignment of image terms. (Markey 1984)

13 Beck & Jones (1989) Variation in the explicitness with which attributes are described and definitions are applied; Differences among different analyst's perceptions; and Changes in an analyst's perceptions over time. Beck, C. and G. T. Jones. "Bias and archaeological classification." American Antiquity 54 (Apr. 1989): ,.

14 Hogan et al. (1991) Visual Thesaurus: collections of images in a hypermedia environment (vs. print) Thesaurus organization reveals pre-defined structures relationships among items

15 Features (Assumptions?) skirt hierarchical term associations lack of reliance on textual indexing independence from a particular taxonomy end-user orientation

16 Words are not enough Spatial relationships of objects Position Relative Size Colors Textures

17 Problems w/ Visual Thesauri Print visual dictionaries analysis Top level: facet or theme transportation Objects obtain meaning by context Difficulty grasping underlying structure of visual taxonomies Cultural biases

18 Relationships Part-Whole Similarity (limited) form function

19 Hogan, et al. (1991) the system must be able to identify the relevant semantic parts of an image At that time, methods for computing visual similarity in early stages of development

20 Current Implementations Visual Thesaurus As tool for displaying text relationships As interface for image browsing and retrieval

21 Visual Thesaurus for Text

22 Advantages of Text Easily processed ASCII Unicode Compact efficient high compression to a point Independent of object

23 Advantages of Images Richness Language (not culture) independence Right brain - Parallel processing Object differentiation Orientation independence Color/Texture/Space Easier to remember

24 Non-issues? Bandwidth Storage File Format

25 Primarily Text - Browsing Alexandria Digital Library UCSB Text Metadata

26 Text Browsing WebSEEK /

27 terrorism

28 User-Supplied Image (QBE) Amore

29 Shape Recogition MARS User identification of shape of interest

30 Shape Recognition MARS

31 Shape Recognition Blobworld Somewhere between stuff and things of Tang (1999) Automatic segmentation of images

32 Blobworld

33 Blobworld Images Corel

34 Shape Recognition eve Automatic Segmentation of image

35 Clustering/Browsing

36 Q/RBE

37 QBE - Vector CANDID public.lanl.gov/kelly/candid/

38 QBE -? ImageRETRO

39 QBE ImageRover

40 QBE + metadata LCPD

41 QBE user supplied image MetaSEEK

42 QBE Micro Plastics

43 QBE Micro Plastics

44 Search by Color FOCUS - UMass

45 Search by Color Histogram Tweak Tool WebSEEK

46 Color & Texture Texture Palettes

47 Color & Texture C-Bird

48 Color & Texture C-Bird

49 Color & Texture JACOB

50 Sketch DrawSearch

51 Sketch QBIC

52 Sketch QBIC

53 Assisted Query Construction Users can t draw especially using a mouse Users can t name colors Users can t describe textures

54 QBE Spatial Iconographic Palettes

55 Search by Color Color Palettes

56 Spatial Iconographic ImageScape

57 Multiple Access Methods VisualSEEK Color Texture Spatial/Icono Vectors

58 Multiple - Iconographical Percevia GIS Shape Color etc.

59 Multiple - Iconographical Percevia

60 Spatial Iconographic Scifinder info.cas.org/ SCIFINDER/ SCHOLAR/ optionssm.html

61 Direct Manipulation

62 Visual Thesauri for Image Browsing and Retrieval Many examples Limited implementations of similarity Visual similarity takes precedence over other types of relationships BUT what is order of precedence of visual primitives?

63 Visual Thesauri for Image Browsing and Retrieval Users cannot choose relationships Users cannot choose levels of similarity

64 Relationships are multivalent Apple - multiple syntactic, inferential relationships color (red), shape (round), texture (smooth, shiny, hard) basic object type: food > fruit > apple > Macintosh

65 Relationships are multivalent uses: juice, pie, applesauce activities: eating, cooking, bobbing for parts: skin, seeds, stem meaning: temptation, poison

66 Begin Cast Corinne Corinne Jörgensen Peter Peter Jörgensen Producers Corinne & Peter Jörgensen Florida State University School of Information Studies (soon to be College of Information) Tallahassee, FL Production took place on location in Tallahassee, FL Providence, RI 2004 Florida State University

NICE CLASSIFICATION - 10 th Edition, Version 2014. Class 41. Explanatory Note

NICE CLASSIFICATION - 10 th Edition, Version 2014. Class 41. Explanatory Note Class 41 Education; providing of training; entertainment; sporting and cultural activities. Explanatory Note Class 41 covers mainly services rendered by persons or institutions in the development of the