TII Team: Image Processing and Understanding

Transcription

1 TII Team: Image Processing and Understanding Télécom ParisTech - CNRS LTCI 2013 TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

2 The team 16 permanent faculty members PhD candidates 5-8 post-doc and research engineers 1-2 sabbatical professors TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

3 Main research domains Visual perception Natural images, computational photography, and film editing Mathematical methods for images Image understanding, learning and spatial reasoning Computer graphics Medical and biological imaging Games and interaction Remote sensing TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

4 Methodology Modeling, analyzing, transforming, representing, interpreting, synthesizing numerical images, volumes and objects. From original images to their interpretation... Strong links between theory, methods, algorithms, and applications. At the cross-road of applied mathematics, computer sciences and artificial intelligence, engineering central role in contemporary information processing. Numerous interfaces (physics, mathematics, computer science, signal, bio-medical sciences, environment...). Strong methodological bases even in applied projects. Numerous national and international collaborations. Website: Some results and demos: TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

5 Mathematical methods for images Texture and natural images modeling: generative models, scaling dead leaves model used by DxO to evaluate the ability of imaging devices to preserve textures in natural images. Image analysis and computer vision: optimal transport, a contrario methods, matching, graph-cuts and Markovian models. Restoration of images and image sequences: non local methods, TV-L1 models for regularization, film restoration. Tracking: particle filters including spatial relations, multiple hypotheses methods, for biological applications in cluttered environment, video-surveillance. Mathematical morphology: algebraic setting for imperfect information processing, preference modeling and spatial reasoning. ANR projects (CALLISTO, MATAIM, OTARIE, FREEDOM), FUI (9th call) CEDCA, Cifre and CNES PhD fundings, CNES research funding, DGA/REI MRIS and Tracking, ECOS Sud (U06E01), STIC AmSud (MMVPSCV). Collaborations with univ. Gran Canaria, univ. Barcelona (Spain), CMLA, Paris 5, Paris 6, UCLA, Technion (Israël), univ. Uruguay, Poncelet Lab Moscow... TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

6 LaboFnac : dossier technique - été 2011 TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

7 Impainting TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

8 Multiple geometrical transformations TII (Te le com ParisTech - CNRS LTCI) Image Processing and Understanding / 21

9 Texture retrieval (invariance under complex deformations) TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

10 Image understanding and spatial reasoning Knowledge representation (structure, imprecision). Fuzzy mathematical morphology and spatial reasoning (common algebraic framework in quantitative / qualitative (logical) / semi-quantitative settings). Graphs and ontologies: semantic gap issue, knowledge-based recognition of structures in images. Fusion of structural information. Collaborations: LRI, ECP, CNES, CESBIO, IGN, LIP6, univ. Sao Paolo (Brazil), IRIT, univ. Merida (Venezuela)... ANR DAFOE (interactive annotation) (with INSERM, Mondeca...), ANR DESCRIBE, ANR LOGIMA. TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

11 TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

12 PhD of Carolina Vanegas, with CNES TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

13 TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

14 Learning, indexing and retrieval A transversal topic... Image annotation in interconnected networks & activity recognition. Conditional random fields for Object Class Segmentation. 2D to 3D object retrieval. Context dependant kernels. Manifolds and efficient exploration of images bases. Applications in satellite images. ImageClef challenges, Princeton Shape Benchmark and Shrec benchmarking. Infomagic (Cap Digital). Collaborations with Imagine/Ponts ParisTech, Univ. Florence, LIAMA/NLPR Beijing... TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

15 TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

16 Computer graphics, digital geometry and rendering 3D geometrical modeling: surface simplification, filtering and reconstruction. Rendering: new algorithms for global illumination and for real time geometry synthesis. Perceptual aspects of rendering techniques. Visualization: interactive exploration of large scale simulations, based on topology. Interactive 2D and 3D design, to discover and create content from huge data bases. IP Reverie, NoE 3DLife, ANR Ispace&time, MediaGPU, CeCil, KidPocket, FETUS, CIFRE EDF, CIFRE Useful Progress, Chaire Modélisation des Imaginaires. TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

17 Sketch-Based Image Retrieval: Benchmark and Bag-of-Features Descriptors. M. Eitz, K. Hildebrand, T. Boubekeur, M. Alexa. IEEE Transaction on Visualization and Computer Graphics Un nouveau moteur de recherche d images et de vidéos à partir de croquis, passant à l échelle de grandes masses d images (architecture Bag-of-Features), construit sur un benchmark basé-utilisateur et introduisant plusieurs nouveaux descripteurs locaux, adaptés aux lignes 2D. Ce moteur représente le socle d un ensemble de projets en collaboration avec TU Berlin, parmi lesquels un moteur de recherche 3D (présenté à SIGGRAPH 2010). TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

18 Medical imaging Anatomical knowledge representation. Fusion with individual information. Model- and knowledge-based recognition and segmentation. Longitudinal follow-up. Validation and evaluation with medical collaborators. 3D modeling of the human body, meshes and deformations. Applications: brain, heart, vessels, oncology, mammography, retina, biology... Joint Lab with Orange Labs (WHIST). ANR (FETUS, Kidpocket, IPHOT, ReVeal), ANSES ACTE, Visiting Scientist fellowship at CSIRO (Australia), MINIARA, CIFRE PhD theses funding. Collaborations with Siemens, Philips, General Electric, Dosisoft, Fovea, Orange Labs (J. Wiart), Institut Pasteur (J.C. Olivo-Marin), ISEP (F. Rossant), U. Columbia (A. Laine), hospitals (Cochin - Saint Vincent de Paul, Bicêtre, XV-XX, Lariboisière...). TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

19 TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

20 Aerial and satellite imaging Processing of 3D point clouds, separation of building facade elements. Analysis of full-waveform lidar data for the automatic classification of urban areas and of littoral scenes. 3D models from multiple images. High precision stereovision. SAR imagery: Signal level: statistical models (Meijer distributions) and denoising using non-local methods. Region or object level: fusion of radar and optical imagery. Glacier monitoring. Joint CNES-DLR-Télécom ParisTech Competence Center (CoC): ended in June CNES PhD theses and research projects funding, ANR EFIDIR, REI-DGA, Magellium, CIFRE Thales, Terra Numerica. Collaborations with DLR (A. Reigber), U. Parthenope II Italy (G. Ferraioli), U. Sao Paulo Brazil (T. Perciano, M. Horta), CEA (R. Binet), U. UPEMLV, IGN. TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21

21 Production Journal papers Conference papers Books and book chapters HDR PhD theses Numerous contracts and grants. Software: Contributions to ITK/OTB, 3DSlicer, Magnicos... Platforms: Plato, Knowledge-centered Earth Observation, Massive MultiMedia. Large implication in the scientific community at national and international levels (CNRS, editorial boards, program committees...). TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding / 21