Searching across hundreds of databases

Our searching services are busy right now. Your search will reload in five seconds.

X
Forgot Password

If you have forgotten your password you can enter your email here and get a temporary password sent to your email.

X
Forgot Password

If you have forgotten your password you can enter your email here and get a temporary password sent to your email.

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets.

Linus Manubens-Gil | Zhi Zhou | Hanbo Chen | Arvind Ramanathan | Xiaoxiao Liu | Yufeng Liu | Alessandro Bria | Todd Gillette | Zongcai Ruan | Jian Yang | Miroslav Radojević | Ting Zhao | Li Cheng | Lei Qu | Siqi Liu | Kristofer E Bouchard | Lin Gu | Weidong Cai | Shuiwang Ji | Badrinath Roysam | Ching-Wei Wang | Hongchuan Yu | Amos Sironi | Daniel Maxim Iascone | Jie Zhou | Erhan Bas | Eduardo Conde-Sousa | Paulo Aguiar | Xiang Li | Yujie Li | Sumit Nanda | Yuan Wang | Leila Muresan | Pascal Fua | Bing Ye | Hai-Yan He | Jochen F Staiger | Manuel Peter | Daniel N Cox | Michel Simonneau | Marcel Oberlaender | Gregory Jefferis | Kei Ito | Paloma Gonzalez-Bellido | Jinhyun Kim | Edwin Rubel | Hollis T Cline | Hongkui Zeng | Aljoscha Nern | Ann-Shyn Chiang | Jianhua Yao | Jane Roskams | Rick Livesey | Janine Stevens | Tianming Liu | Chinh Dang | Yike Guo | Ning Zhong | Georgia Tourassi | Sean Hill | Michael Hawrylycz | Christof Koch | Erik Meijering | Giorgio A Ascoli | Hanchuan Peng
Nature methods | 2023

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in many neuroscience laboratories interested in neuron tracing. Here, we report generated gold standard manual annotations for a subset of the available imaging datasets and quantified tracing quality for 35 automatic tracing algorithms. The goal of generating such a hand-curated diverse dataset is to advance the development of tracing algorithms and enable generalizable benchmarking. Together with image quality features, we pooled the data in an interactive web application that enables users and developers to perform principal component analysis, t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and tracing data, and benchmarking of automatic tracing algorithms in user-defined data subsets. The image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. We observed that diverse algorithms can provide complementary information to obtain accurate results and developed a method to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms in noisy datasets. However, specific algorithms may outperform the consensus tree strategy in specific imaging conditions. Finally, to aid users in predicting the most accurate automatic tracing results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic tracings.

Pubmed ID: 37069271 RIS Download

Additional research tools detected in this publication

None found

Antibodies used in this publication

None found

Associated grants

  • Agency: NIBIB NIH HHS, United States
    Id: R01 EB028159
  • Agency: NIMH NIH HHS, United States
    Id: RF1 MH128693

Publication data is provided by the National Library of Medicine ® and PubMed ®. Data is retrieved from PubMed ® on a weekly schedule. For terms and conditions see the National Library of Medicine Terms and Conditions.

This is a list of tools and resources that we have found mentioned in this publication.


BICCN (data or information resource)

RRID:SCR_015820

Consortium for the cell census in the brain. Integrated network of data generating centers, data archives, and data standards developers, with the goal of systematic multimodal brain cell type profiling and characterization. Emphasis of the BICCN is on the whole mouse brain with demonstration of prototype feasibility for human and nonhuman primate brains.

View all literature mentions

Vaa3D (software resource)

RRID:SCR_002609

A handy, fast, and versatile 3D/4D/5D Image Visualization & Analysis System for Bioimages & Surface Objects. Vaa3D is a cross-platform (Mac, Linux, and Windows) tool for visualizing large-scale (gigabytes, and 64-bit data) 3D/4D/5D image stacks and various surface data. It is also a container of powerful modules for 3D image analysis (cell segmentation, neuron tracing, brain registration, annotation, quantitative measurement and statistics, etc) and data management. Vaa3D is very easy to be extended via a powerful plugin interface. For example, many ITK tools are being converted to Vaa3D Plugins. Vaa3D-Neuron is built upon Vaa3D to make 3D neuron reconstruction much easier. In a recent Nature Biotechnology paper (2010, 28(4), pp.348-353) about Vaa3D and Vaa3D-Neuron, an order of magnitude of performance improvement (both reconstruction accuracy and speed) was achieved compared to other tools.

View all literature mentions