Invited Speakers


Title: Computer Vision Opportunities for Shape Analysis from EM Connectomics Data
Start Time: 9:15 AM PDT
Speaker: Sharmishtaa Seshamani, Ph.D., Allen Institute for Brain Science
Abstract: The field of connectomics aims to map the morphology and synaptic connectivity of all neurons in a brain region. Understanding the detailed wiring patterns of the brain is of fundamental interest not only in neurobiology, but also for novel biological-inspired architectures in artificial intelligence. Electron Microscopy (EM) makes it possible to densely label diverse biological objects across more than five orders of magnitude in size, from synapses and cellular organelles tens or hundreds of nanometers wide to neuronal arbors more than a millimeter long in datasets containing tens of thousands of neurons. The current largest EM image datasets are on the petabyte scale, including the entire fruit fly brain and a cubic millimeter of a mouse visual cortex.
    The ability to assemble and analyze such large scale image data relies heavily on advances in computer vision, such as image registration to assemble 3D image volumes, segmentation to extract neuronal morphology and shape analysis to describe neurons of different cell types. We present our efforts towards building such a dataset which includes tissue processing, volume assembly and information extraction. We have recently released a public dataset of the mouse visual cortex (layer 2/3) and are currently actively pursuing several types of analysis of this data for studying connectivity and morphological cell typing.

Bio: Dr. Sharmishtaa Seshamani is part of the Cell Types team at the Allen Institute for Brain Science. Her current research focuses on building a data processing pipeline to image cells in mouse and human brain, to elucidate the structural complexity of cell morphology and ultrastructural connectivity of neural circuits. She received her Ph.D. in Computer Science from Johns Hopkins University, where she focused on developing meta-registration and mosaicking techniques for endoscopic imaging. Prior to joining the Allen Institute, Dr. Seshamani was a Senior Fellow in the Biomedical Image Computing Group at the University of Washington. There, she developed a pipeline for fetal fMRI analysis which included algorithms for MRI artifact correction, motion estimation and reconstruction. Currently Dr. Sheshamani develops tools for linear and elastic registration and 3D image reconstruction optimized for large datasets, including electron microscopy (EM) data as part of the MICrONS project: https://microns-explorer.org/. Her interests include applications of machine learning techniques for automatic parameter selection and connectivity data analysis.

Title:Immunological Synapse Quality Predicts the Efficacy/Toxicity of CAR Immunotherapy
Start Time:10 AM PDT
Speaker: Dongfang Liu, Associate Professor, Rutgers University- New Jersey Medical School.
Abstract: Human immune system consists of a network of billions of independent, self-organized cells that interact with each other to form a highest intelligence. Artificial intelligence (AI) is being used in immunological research. Machine learning (ML) is an AI tool that can process huge data and generate models for immune system and immunological research. One of the most exciting, recent breakthroughs in immunological research is cancer immunotherapy. Specifically, one such therapy involves engineering immune cells to express chimeric antigen receptors (CAR), which combine tumor antigen specificity with immune cell activation in a single receptor. Recent clinical trials testing cancer immunotherapies have shown promising results for treating various cancers. The adoptive transfer of these CAR-modified immune cells (especially T-cells, CAR T) into patients has shown remarkable success in treating multiple refractory blood cancers. To improve their efficacy and to expand their applicability to other cancer types, scientists are optimizing different CARs with different modifications. However, predicting and ranking the efficacy of different CAR T cell products with identical antigen specificity, selection of responders with an identical CAR T construct, and identification of the optimal CAR for a translation researcher to further develop potential clinical application are limited by the current, time-consuming, costly, and labor-intensive conventional tools used to evaluate efficacy. Particularly, T cell efficacy is not only controlled by the specificity and avidity of the tumor antigen and T cell interaction, but also it depends on a collective process, involving multiple adhesion and regulatory molecules, spatially organized at the T cell immunological synapse (IS). Optimal function of cytotoxic lymphocytes depends on IS quality. Recognizing the inadequacy of conventional tools and importance of IS in T cell functions, we investigate a new strategy for assessing CAR T efficacy. Previous studies in our lab show evidence that: 1) CAR T-cell immunological synapse (IS) quality (structure, function, and signaling) varies between CAR T-cells, 2) CAR co-stimulatory endodomains influence IS quality, 3) CAR T IS quality correlates with antitumor activity both in vitro and in vivo, and 4) CAR IS quality assay developed here can distinguish a responder from non-responders. However, current IS quality image data analysis was quantified manually, which is time-consuming and labor-intensive with low accuracy. Here we develop a machine learning method to quantify thousands of synapse images with enhanced accuracy. The ML-based, automated algorithms to quantify CAR T IS can develop fast and easy tools to predict CAR T cell efficacy, which provides guidelines for designing and optimizing CARs for clinical cell therapy.
Bio: Dongfang Liu, PhD recently joined the Department of Pathology, Immunology & Laboratory Medicine and the Center for Immunity and Inflammation as an Associate Professor. In 2012, Dr. Liu was recruited to Baylor College of Medicine as a tenure-track Assistant Professor in the Department of Pediatrics and Department of Pathology & Immunology, before joining Houston Methodist Hospital (a teaching hospital affiliated with Weill Cornell Medical College) as an assistant professor in 2015. In 2018, Dr. Liu was promoted to an Associate Professor in Houston Methodist Research Institute. Dr. Liu did his postdoctoral training on natural killer (NK) cells at the National Institute of Allergy and Infectious Diseases (NIAID) in National Institutes of Health (NIH) from 2005 to 2011. After completing the postdoctoral training, he joined Ragon Institute of MGH, MIT and Harvard in 2011 as a senior research scientist, where he worked on HIV-specific CTL dysfunction with a focus on PD-1 in HIV- specific CTLs. His current research is primarily focused on the immunobiology of chimeric antigen receptor (CAR) T and NK cells, immunoreceptors, CAR immunotherapy, and HIV-specific CTLs in chronic HIV and its related malignancies, with a focus on immunological synapse biology and its clinical applications. His research is supported by several NIH grants, including an R01 and three R21 grants.

Title:Algorithms and Tools to Analyze Multi-Modal Brain Imaging Data
Start Time:1:15 PM PDT
Speaker: Kunal Ghosh, Ph.D., Inscopix.
Abstract: Decoding the brain is a grand challenge that will require innovations in both brain recording tools and in algorithms for extraction of signals from brain data. Traditional electrode-based recording tools do not have the cell type-specificity or the scale to capture the individual activity of a large number of genetically-targeted neurons, key to mapping the patterns of neural activity that give rise to behavior. Fluorescence microscopy, a workhorse tool for the life sciences, has emerged as a powerful modality to record brain activity with cellular resolution, cell-type specificity and at scale. Recent advances in head-mounted miniaturized fluorescence microscopes, or "miniscopes", now enable imaging activity from thousands of neurons during behavior and longitudinally over time, providing neuroscientists with unprecedented data sets of the brain circuits implicated in learning, memory formation, sensory processes, and in brain disease.
    These new data sets are rich in information about how the brain works, and how it does not, but are of little use if the information cannot be efficiently, reliably and accurately extracted. In this talk we will present methods to extract electricity from pixels, and methods and tools to analyze large brain imaging data. In the first part of the talk we will show how individual time traces of the activity of each neuron imaged can be extracted from terabytes of miniscope brain data, and in the second part of the talk we will present MIRA, a Multimodality Image Registration and Analysis toolbox, that enables integrating and co-registering functional miniscope neural imaging data with high-resolution microscopy data to help researchers map the brain.

Bio: Kunal Ghosh is founder and CEO of Inscopix, Inc., a Palo Alto-based startup developing a platform for mapping brain circuits. Kunal founded Inscopix out of a research project at Stanford University that resulted in the invention of a miniature, integrated microscope for in vivo brain imaging. The invention is the centerpiece of Inscopix's core brain circuit mapping products which today have already advanced fundamental knowledge of the brain circuits underpinning brain function and behavior. Inscopix's platform also has the potential of shaping the future of neuro-therapeutic discovery, enabling the development of entirely new in vivo circuit-based assays for diseases such as Parkinson's, epilepsy, and depression. Kunal is a passionate advocate of the role of business as a force for good in society, and especially the role of entrepreneurial ventures in catalyzing a technologyfueled revolution in brain science and mental health. He is a frequent speaker on these themes at scientific meetings, industry conferences, and top Business schools, and serves on the World Economic Forum's Council on Neurotechnologies and Brain Science. Kunal holds a BSE in Electrical Engineering from the University of Pennsylvania, a BS from the Wharton School at the University of Pennsylvania, and an MS and PhD in Electrical Engineering from Stanford University.

Title:Creating a Landscape of Cellular Signatures through Quantitative Live Cell Imaging
Start Time:3:15 PM PDT
Speaker: Winfried Wiegraebe, Ph.D., Director of Microscopy, Allen Institute for Cell Science.
Abstract: To build predictive models of the human cell, we develop tools to create quantitative and reproducible data sets. Human induced pluripotent stem cells (hiPSC) are healthy diploid cells which can differentiate into almost any cell type of the human body. They have a normal karyotype unlike many currently used cell lines. We created stable cell lines that express green fluorescence protein (eGFP) fused to proteins at their endogenous locus. The fluorescence intensity of these fusion proteins is proportional to their abundance.
    We established specialized imaging pipelines based on spinning disk microscopes optimized for throughput and point-scanning confocal microscopes with detectors that achieve an optical resolution beyond the classical diffraction limit. We are adding lattice light sheet microscopy to our toolbox for fast and long-term time lapse imaging. To ensure reproducibility, we developed software to automate imaging pipelines.
    We will present a workflow to calibrate the intensity between different microscope modalities and to estimate the absolute concentration of a given protein. We created a dilution series of eGFP solutions in the physiological relevant range from nM to M. We measured the concentrations with fluorescence correlation spectroscopy (FCS). Then we imaged the eGFP solutions with the same microscopes under identical settings as used for cell imaging. We created a concentration/intensity calibration curve that we applied to microscope images of cells to obtain the concentration of eGFP labeled protein. For most cell lines we inserted eGFP only into one allele. Quantitative Western Blots allowed us to estimate the ratio between labeled and unlabeled proteins in the cells. Using this ratio, we could estimate the total concentration of a given protein within life cells (labeled and un-labeled protein).
    We developed a toolbox to segment cellular structures. The extracted features create a landscape of cellular signatures that can be explored through our Cell Feature Explorer and are used as input for quantitative modelling. We believe in open science, and thus all of our cell lines, data sets, and tools are available at https://www.allencell.org.

Bio: Dr. Wiegrabe is the Director of Microscopy & Image Analysis at the Allen Institute. All his professional life, Winfried has used, programmed, and built microscopes. He worked in industry and academia, in Germany and the US. Winfried received his diploma in Biophysics and Machine Tools and Industrial Management from the Technical University in Munich, Germany. For his diploma and Ph.D. thesis he joined the Department of Molecular Structural Biology headed by Wolfgang Baumeister at the Max-Planck Institute for Biochemistry in Martinsried, Germany. Under the mentorship of Reinhard ‘Guckus’ Guckenberger, Winfried investigated hydrated bacterial surface proteins with scanning tunneling microscopy (STM). He developed an atomic force microscope (AFM) to measure their conductivity. He complemented this data with measurements of their local elasticity and friction. For a short post-doc, he joined the group of Eberhard Unger at the Institute for Molecular Biology in Jena, Germany. He applied low current STM to hydrated microtubules. Being in Jena, where Carl Zeiss founded his microscopy company and Ernst Abbe worked out the theory of the light microscope and its resolution limit, Winfried headed a R&D team at Carl Zeiss to develop a product based on the discoveries of Eric Betzig, the scanning near field optical microscope (SNOM) to overcome this limit. Later, he became world-wide product manager for fluorescence correlation microscopy (FCS), a method that can measure the concentration, diffusion properties, and molecular interactions of proteins within living cells. In 2001, Winfried joined the Carl Zeiss group in the USA and helped customers to be successful users of confocal and two-photon microscopes (NLO), as well as FCS. In 2005, Winfried moved back to academia and joined the Stowers Institute for Medical Research in Kansas City, Missouri, USA. He created the group for Advanced Instrumentation and Physics and became later the Head of the Stowers Microscopy Center. In this capacity he supported and built with his team a large variety of microscope techniques, from laser micro-dissection to super-resolution techniques and light sheet microscopy. He developed technology to automatically perform FCS measurements on 4000 different proteins in yeast.