Hollings researcher receives funding to harness power of imaging

March 20, 2019
Thierry Pecot in imaging laboratory
Thierry Pécot, researcher at the Medical University of South Carolina, works in his laboratory in the Hollings Cancer Center. Photo by Emma Vought

The Chan Zuckerberg Initiative (CZI) announced $17 million in funding and its selection of 17 CZI Imaging Scientists — engineers, physicists, mathematicians, computer scientists, and biologists with expertise in technology development.

One of the recipients, Thierry Pécot, Ph.D., a researcher at Hollings Cancer Center at the Medical University of South Carolina, says the $1.1 million, five-year grant will support his current research project to enable biologists to apply deep learning tools to their images.

“This is not possible for now as it requires skills most biologists do not have,” says Pécot, who will be providing deep learning segmentation to researchers as part of Hollings Cancer Center’s Translational Science Laboratory. He’ll work closely with biologists to identify their needs to customize the development of a deep learning suite for segmentation at a large scale. This suite will then be extended to design software that biologists can run by themselves.

“I believe that biologists should be able to analyze their images as they are the subject experts. Bringing the best analysis tools to biologists, particularly deep learning tools, is a major challenge” Pécot says. “Like any other analysis application, once it has been developed to answer a biological question, it is important to design software with a simple interface that does not require expertise in applied mathematics so that biologists can take advantage of it.”

Technology in the imaging field has evolved very rapidly, he says. In the last decade, three Nobel prizes in chemistry have been attributed to advances in imaging. Technical advances in imaging dramatically increased the resolution of light microscopy and electron microscopy, yet many of these new microscopes have not been commercialized, and software for analyzing these new kinds of data lags behind the advances made in hardware. Improved technological tools and increased interaction between technology experts and biologists will allow biomedical science to push forward even more quickly to cure disease.

“Since its appearance in 2012, deep learning has changed the conversation about artificial intelligence for image-based decision making. The application of deep learning to biological images is very promising and the range of applications is vast.”

Pécot, who will be teaching a bimonthly tutorial about free software used to process biomedical images, is an engineer and applied mathematician, with expertise in bioimage informatics.

Lung imaging
Left: multiplexed images from lung cancer biopsies acquired with the Vectra Polaris imaging system. Right: nuclei segmentation (blue) and biomarker characterization for each cell (colors correspond to identified biomarkers). Imaging provided by John Wrangle and Mark Rubinstein

He has developed algorithms and analysis pipelines in the Icy suite of microscopy software, which is an open community platform for bioimage informatics for a variety of biological applications. Since he joined Hollings Cancer Center in 2016, he has been developing a deep learning framework for segmenting cell nuclei in microscopic images, which is used, among other applications, in a pipeline designed to profile tumor immune status.

Pécot wants to harness the power of discovery that imaging offers.

“Good health affects everyone. The amount of information contained in biological images is enormous,” he says. “So far, we have only been using a very small portion of useful data that we can extract from images. It is consequently not a surprise to see that more and more studies coupling images and machine learning are used to answer clinical questions: patient screening, cancerous tissue detection and diagnosis.”

Pécot is thrilled to have been selected as a CZI Imaging scientist and applauds the group’s mission. CZI supports imaging scientists at centers across the nation, who are working at the interface among biology, microscopy hardware and imaging software to accelerate progress in the imaging field and enable biologists to leverage modern technology for microscopy data. This post explains more about the Imaging Scientists and their work.

CZI co-founder Priscilla Chan says microscopy is a critical tool that allows researchers to actually see biology and life happen instead of just inferring from disparate data points.

“Our hope is that microscopy will help scientists identify the causes and effects of diseases. We need to keep advancing these tools to make big breakthroughs in understanding disease,” she says. “One of the ways we’re helping to accelerate scientific progress is by creating connections that otherwise wouldn’t have existed. It’s our hope that by bringing together biologists, clinicians, and engineers, we can drive important advances in the field.”

The recipients represent 17 imaging centers across the United States, including five medical imaging centers. Selected Imaging Scientists bring interdisciplinary expertise from fields such as engineering, computer science, physics, chemistry, and biology.

CZI Head of Science Cori Bargmann says to move the imaging field forward, scientists need better tools to view living systems and analyze the large amounts of data that result.

“That’s why we’re thrilled to support these expert Imaging Scientists. They innovate to develop new technologies, collaborate to bring those methods to a wide audience, and educate other scientists in new methods and best practices.”