Outline Motivation The Whole Brain Catalog INCF Digital Atlasing Infrastructure API Use case of multi-scale data integration: Ghosh et al. 2011 Open object models for neuroscience Contributions
Reverse-engineering? System whose mechanisms are obscured
What is reverse-engineering? Individual components and an explanation of how they fit together System whose mechanisms are obscured
What is reverse-engineering? Provide a framework of parts ready to be snapped together
Putting the parts back together
A multi-scale data problem Whole brain data (20 um microscopic MRI) Mosiac LM images (1 GB+) Conventional LM images Scale Individual cell morphologies EM volumes & reconstructions Solved molecular structures
A multi-scale synthesis problem
A multi-scale synthesis problem From: Solari, S., A unified anatomical theory and computational model of cognitive information processing in the mammalian brain and the introduction of DNA reco codes, Ph.D Dissertation, Engineering Sciences, UCSD, 2009
A multi-scale synthesis problem Shepherd GM, The Synaptic Organization of the Brain, 4 th Edition, 2004.
Confocal image stacks Masako Terada, Eric Bushong, Fred Gage, Mark Ellisman http://ncmir.ucsd.edu Amira
A multi-scale synthesis problem
The Whole Brain Catalog Drew Berry http://wehi.tv Maya
Allen mouse atlas brain regions
Allen mouse atlas brain regions
Opening the Mouse Brain Regions 1. Took binary geometry files from Allen Brain Explorer 2. Received contribution of C code from Allen Institute that read the binary format 3. Rewrote C code in Java 4. Converted brain regions into.obj files 5. Could import.obj files into other Open Source tools
3D Atlas Surfaces: HW Dong, Allen Institute for Brain Science Dentate Gyrus Network: Aimone et al, Neuron 2009, Gage Lab CA3 Neuron: Carnevale NT et al., J. Neurosci, 1997 CA3 dendritic branch & granule cell axon terminals: Scott Wilke & Anirvan Ghosh (unpublished) Data sharing across scales
Whole Brain Catalog integrated with image registration workflow
Whole Brain Catalog integrated with image registration workflow Images served by MapServer (Geospatial image server) Client-server system allows for distributed access Very large size images (multi GB) can be viewed Preserves atlas coordinates
Integration of a Neuron Simulation Animation
Network simulations can be incorporated Maex, R and De Schutter, E. Synchronization of Golgi and Granule Cell Firing in a Detailed Network Model of the Cerebellar Granule Cell Layer J Neurophysiol, Nov 1998; 80: 2521-2537. NeuroLex id in next NeuroML 2.0!
Aimone et al 2009, Gage lab simulation
Technologies Maven2 Restlet HyperJAXB3 JMonkeyEngine Vaadin
Whole Brain Catalog Client Architecture overview Wbc-client-interface Wbc-core Wbc-tangible Wbc-view-3d Wbc-io Wbc-io Wbc-client Wbc-view Wbc-listeners The internet Wbc-server
Modular design allows two different client views to operate on a shared codebase Wbcview-3d Wbc-io Wbc-client-interface Wbc-view (Swing & Webstart) Wbc-io Wbccore Wbctangible Wbc-client View OR Wbc-listeners Jme-Vaadin-Applet Wbc-web-view (Vaadin) Wbcview-3d Wbc-io
User positions orange probe tool within the 3D environment on the pattern of expression of interest CCDB Protein Expression image within the Whole Brain Catalog Right clicking probe brings up Allen Gene Expression search in web browser
INCF Digital Atlasing Infrastructure: Purpose To develop scientific and technical foundations and development principles and prototypes for a distributed system of neuroscience resources that can be published, shared and integrated based on spatial characteristics of their content.
INCF Digital Atlasing Infrastructure
INCF Digital Atlasing Infrastructure: Vs. Allen API DAI: General, standards-based (OGC/WPS) web services to access spatial neuroscience across heterogeneous sources such as Allen Brain Atlas (ABA) Edinburgh Mouse Atlas Project (EMAP) University of California, San Diego, Cell- Centered Database (UCSD CCDB) Waxholm (WHS) Allen API: The means by which the DAI ABA hub accesses ABA data
An XML format for.sva Schema: http://wholebrain.googlecode.com/svn/wbccore /trunk/src/main/resources/sparsevaluevolume.xsd <SparseValueVolume> <Comment>... free-form metadata...</comment> <MaxDimension x="40" y="2" z="1"/> <SparseVolumeData> <Datum x="39" y="2" z="1" value="3.40352e-06"/> <Datum x="40" y="2" z="1" value="5.58613e-06"/>... </SparseVolumeData> </SparseValueVolume>
Rendering XML-based.SVA
Multi-scale data integration use case
Manipulating content
Interaction with multiple data sets simultaneously
Multiple neurons
Convert traced neuron into machine processable structure for analysis
Behind the scenes we are converting Neurolucida -> MorphML -> JUNG forest representation
Using reference brain, we bring different cells into near alignment
End point distance analysis
End point distance analysis
End point distance analysis
Open Object Models for Neuroinformatics NeuroML Network model Polygonal mesh segmentations Image Stacks Volumetric data sets (NIFTI, CFF) CARMEN NDTF Electrophys time series
Open Object Models for Neuroinformatics NeuroML Network model Polygonal mesh segmentations Image Stacks Volumetric data sets (NIFTI, CFF) CARMEN NDTF Electrophys time series
Open Object Models for Neuroinformatics NeuroML Network model Polygonal mesh segmentations Image Stacks Volumetric data sets (NIFTI, CFF) CARMEN NDTF Electrophys time series
Open Object Models for Neuroinformatics NeuroML Network model Polygonal mesh segmentations Image Stacks Volumetric data sets (NIFTI, CFF) CARMEN NDTF Electrophys time series
Multi-modal data overlap within a common atlas space (Waxholm) NineML / NeuroML model Polygonal mesh segmentations Image Stacks Volumetric data sets (NIFTI, CFF) CARMEN NDTF Electrophys time series
Tangibles NineML / NeuroML model Polygonal mesh segmentations Image Stacks Volumetric data sets (NIFTI, CFF) CARMEN NDTF Electrophys time series
Data Wrappers NineML / NeuroML model Polygonal mesh segmentations Image Stacks Volumetric data sets (NIFTI, CFF) CARMEN NDTF Electrophys time series
A common data wrapper envelope description allows different kinds of content to be mapped into the same space Tangible Data Wrapper Data Content
Precise naming should occur optionally at both the data wrapper level and at the tangible level Names / metadata about the context of the use of the data Names / metadata about the data files themselves Tangible Data Wrapper Data Content
Building a Python layer on top of Whole Brain Catalog Python scripts Java to Python glue Java libraries Wbc-io Python layer Jython layer Wbccore Wbc-clientinterface Wbctangible Wbc-client Volume Server Cellular Knowledge Base Servers NIF / NeuroLex The internet Cell Centered Database Simulation Server Main Server 2D Image Server
Hook different systems together via the python layer PyNN Python layer WBC Python layer DAI Python layer simulation visualization & interaction atlasing
Contributions Described a motivation for integrating data of the nervous system into digital forms Described building an open source google earth for the brain framework on top of Allen Institute data and APIs Described work of the INCF to create a common API across multiple sources Gave an example use case of data integration Described ongoing work to build common python APIs on top of existing open source libraries