TII Team: Image Processing and Understanding Télécom ParisTech - CNRS LTCI 2013 TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 1 / 21
The team 16 permanent faculty members 30-35 PhD candidates 5-8 post-doc and research engineers 1-2 sabbatical professors TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 2 / 21
Main research domains Visual perception Natural images, computational photography, and film editing Mathematical methods for images Image understanding, learning and spatial reasoning Computer graphics Medical and biological imaging Games and interaction Remote sensing TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 3 / 21
Methodology Modeling, analyzing, transforming, representing, interpreting, synthesizing numerical images, volumes and objects. From original images to their interpretation... Strong links between theory, methods, algorithms, and applications. At the cross-road of applied mathematics, computer sciences and artificial intelligence, engineering central role in contemporary information processing. Numerous interfaces (physics, mathematics, computer science, signal, bio-medical sciences, environment...). Strong methodological bases even in applied projects. Numerous national and international collaborations. Website: http://perso.telecom-paristech.fr/~bloch/tii/staff.html Some results and demos: http://perso.telecom-paristech.fr/~bloch/tii/demosen.html TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 4 / 21
Mathematical methods for images Texture and natural images modeling: generative models, scaling dead leaves model used by DxO to evaluate the ability of imaging devices to preserve textures in natural images. Image analysis and computer vision: optimal transport, a contrario methods, matching, graph-cuts and Markovian models. Restoration of images and image sequences: non local methods, TV-L1 models for regularization, film restoration. Tracking: particle filters including spatial relations, multiple hypotheses methods, for biological applications in cluttered environment, video-surveillance. Mathematical morphology: algebraic setting for imperfect information processing, preference modeling and spatial reasoning. ANR projects (CALLISTO, MATAIM, OTARIE, FREEDOM), FUI (9th call) CEDCA, Cifre and CNES PhD fundings, CNES research funding, DGA/REI MRIS and Tracking, ECOS Sud (U06E01), STIC AmSud (MMVPSCV). Collaborations with univ. Gran Canaria, univ. Barcelona (Spain), CMLA, Paris 5, Paris 6, UCLA, Technion (Israël), univ. Uruguay, Poncelet Lab Moscow... TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 5 / 21
LaboFnac : dossier technique - été 2011 TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 6 / 21
Impainting TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 7 / 21
Multiple geometrical transformations TII (Te le com ParisTech - CNRS LTCI) Image Processing and Understanding 2013 8 / 21
Texture retrieval (invariance under complex deformations) TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 9 / 21
Image understanding and spatial reasoning Knowledge representation (structure, imprecision). Fuzzy mathematical morphology and spatial reasoning (common algebraic framework in quantitative / qualitative (logical) / semi-quantitative settings). Graphs and ontologies: semantic gap issue, knowledge-based recognition of structures in images. Fusion of structural information. Collaborations: LRI, ECP, CNES, CESBIO, IGN, LIP6, univ. Sao Paolo (Brazil), IRIT, univ. Merida (Venezuela)... ANR DAFOE (interactive annotation) (with INSERM, Mondeca...), ANR DESCRIBE, ANR LOGIMA. TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 10 / 21
TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 11 / 21
PhD of Carolina Vanegas, with CNES TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 12 / 21
TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 13 / 21
Learning, indexing and retrieval A transversal topic... Image annotation in interconnected networks & activity recognition. Conditional random fields for Object Class Segmentation. 2D to 3D object retrieval. Context dependant kernels. Manifolds and efficient exploration of images bases. Applications in satellite images. ImageClef challenges, Princeton Shape Benchmark and Shrec benchmarking. Infomagic (Cap Digital). Collaborations with Imagine/Ponts ParisTech, Univ. Florence, LIAMA/NLPR Beijing... TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 14 / 21
TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 15 / 21
Computer graphics, digital geometry and rendering 3D geometrical modeling: surface simplification, filtering and reconstruction. Rendering: new algorithms for global illumination and for real time geometry synthesis. Perceptual aspects of rendering techniques. Visualization: interactive exploration of large scale simulations, based on topology. Interactive 2D and 3D design, to discover and create content from huge data bases. IP Reverie, NoE 3DLife, ANR Ispace&time, MediaGPU, CeCil, KidPocket, FETUS, CIFRE EDF, CIFRE Useful Progress, Chaire Modélisation des Imaginaires. TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 16 / 21
Sketch-Based Image Retrieval: Benchmark and Bag-of-Features Descriptors. M. Eitz, K. Hildebrand, T. Boubekeur, M. Alexa. IEEE Transaction on Visualization and Computer Graphics 2011. Un nouveau moteur de recherche d images et de vidéos à partir de croquis, passant à l échelle de grandes masses d images (architecture Bag-of-Features), construit sur un benchmark basé-utilisateur et introduisant plusieurs nouveaux descripteurs locaux, adaptés aux lignes 2D. Ce moteur représente le socle d un ensemble de projets en collaboration avec TU Berlin, parmi lesquels un moteur de recherche 3D (présenté à SIGGRAPH 2010). TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 17 / 21
Medical imaging Anatomical knowledge representation. Fusion with individual information. Model- and knowledge-based recognition and segmentation. Longitudinal follow-up. Validation and evaluation with medical collaborators. 3D modeling of the human body, meshes and deformations. Applications: brain, heart, vessels, oncology, mammography, retina, biology... Joint Lab with Orange Labs (WHIST). ANR (FETUS, Kidpocket, IPHOT, ReVeal), ANSES ACTE, Visiting Scientist fellowship at CSIRO (Australia), MINIARA, CIFRE PhD theses funding. Collaborations with Siemens, Philips, General Electric, Dosisoft, Fovea, Orange Labs (J. Wiart), Institut Pasteur (J.C. Olivo-Marin), ISEP (F. Rossant), U. Columbia (A. Laine), hospitals (Cochin - Saint Vincent de Paul, Bicêtre, XV-XX, Lariboisière...). TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 18 / 21
TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 19 / 21
Aerial and satellite imaging Processing of 3D point clouds, separation of building facade elements. Analysis of full-waveform lidar data for the automatic classification of urban areas and of littoral scenes. 3D models from multiple images. High precision stereovision. SAR imagery: Signal level: statistical models (Meijer distributions) and denoising using non-local methods. Region or object level: fusion of radar and optical imagery. Glacier monitoring. Joint CNES-DLR-Télécom ParisTech Competence Center (CoC): ended in June 2010. CNES PhD theses and research projects funding, ANR EFIDIR, REI-DGA, Magellium, CIFRE Thales, Terra Numerica. Collaborations with DLR (A. Reigber), U. Parthenope II Italy (G. Ferraioli), U. Sao Paulo Brazil (T. Perciano, M. Horta), CEA (R. Binet), U. UPEMLV, IGN. TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 20 / 21
Production 2009 2010 2011 2012 Journal papers 29 41 46 36 Conference papers 66 66 44 38 Books and book chapters 4 14 7 3 HDR 1 3 1 PhD theses 13 17 15 8 Numerous contracts and grants. Software: Contributions to ITK/OTB, 3DSlicer, Magnicos... Platforms: Plato, Knowledge-centered Earth Observation, Massive MultiMedia. Large implication in the scientific community at national and international levels (CNRS, editorial boards, program committees...). TII (Télécom ParisTech - CNRS LTCI) Image Processing and Understanding 2013 21 / 21