Cebra

Understanding complex neural and behavioral data requires sophisticated analytical tools that can effectively integrate multiple types of information. Cebra, a Python library developed by Steffen Schneider, Célia Benquet, and Mackenzie Mathis, addresses this need through advanced embedding techniques that incorporate auxiliary variables. By combining self-supervised learning algorithms with flexible API designs, Cebra enables researchers to extract meaningful patterns from high-dimensional recordings across various biological contexts.

Overview of CEBRA

CEBRA is a Python library developed for estimating consistent embeddings of high-dimensional neural and behavioral recordings using auxiliary variables. It leverages self-supervised learning algorithms implemented in PyTorch and supports diverse datasets common in biology and neuroscience.

The library offers two main APIs: a high-level Scikit-learn-like interface for standard machine learning workflows and a low-level PyTorch API that provides direct access to model components for advanced customization. This dual-API design enables researchers to choose the level of abstraction that best fits their specific use case.

The development team, consisting of Steffen Schneider, Célia Benquet, and Mackenzie Mathis, maintains active development with regular updates to the API. As an open-source project under the Apache 2.0 license since version 0.4.0, the library builds on academic releases from versions 0.1.0 to 0.3.1. To support reproducibility, the library provides Docker support for both analysis and experiment code.

Performance and Applications

CEBRA has demonstrated robust performance across multiple experimental paradigms. In one application, the method achieved a median absolute error of 5cm in estimating rat hippocampal positions over a 160cm track length (Grosmark and Buzsáki, 2016). For decoding visual stimuli, CEBRA processes 2-photon and Neuropixels recordings, using DINO frame features as labels to decode video frames via kNN decoding on the CEBRA-Behavior embedding.

The technique consistently generates high-quality latent spaces across various recording modalities, including calcium imaging and electrophysiology. These embeddings enable accurate decoding of natural movies from primary visual cortex while capturing complex kinematic features. The method supports both single-session and multi-session datasets, making it adaptable for different experimental designs and hypothesis testing frameworks.

Cebra's Core Components

The high-level API of CEBRA is designed to work seamlessly with Scikit-learn, providing a familiar interface for machine learning practitioners. This implementation allows users to employ standard Scikit-learn functions while leveraging CEBRA's specialized capabilities for neural and behavioral data processing. The API is versatile enough to accommodate custom dataset structures, complete with built-in decoder functionality that enables straightforward validation and analysis.

In terms of implementation, the high-level API currently restricts access to a single estimator class named CEBRA, providing a comprehensive interface for its main functionalities. The API is particularly helpful for users who prefer a more streamlined workflow and less need for custom model components.

The low-level API, built on PyTorch, offers researchers greater flexibility through direct access to model components. This implementation provides comprehensive exposure to core CEBRA functions while enabling fine-tuning of algorithm parameters and integration with other research contexts. Developers can utilize this API to implement custom sampling mechanisms or experiment with alternative loss functions, offering a powerful toolkit for advanced applications.

Both APIs support the library's primary function of estimating consistent embeddings from high-dimensional recordings while incorporating auxiliary variables. This dual-approach design allows users to select the level of abstraction that best meets their specific analytical needs. Together, these API implementations support CEBRA's diverse application across rat hippocampus and mouse primary visual cortex data, as well as other neural and behavioral recordings commonly found in biological and neurological research.

Usage and Integration

CEBRA's integration capabilities significantly expand its utility beyond core functionality. The library seamlessly interfaces with multiple ecosystem components, enhancing researcher flexibility and workflow efficiency.

Integration with Other Tools

As a primary feature, CEBRA can operate directly within scikit-learn workflows through its high-level API. This integration allows users to maintain familiar machine learning pipelines while leveraging CEBRA's specialized capabilities. The API enables straightforward extension of existing pipelines, with complete compatibility demonstrated across custom dataset structures.

Visualization capabilities are enhanced via matplotlib plotting functions, facilitating rapid exploration and interpretation of CEBRA-generated embeddings. Together with these visualization tools, CEBRA returns consistent and high-performance latent spaces, enabling powerful decoding of neural and behavioral data across various recording modalities.

DeepLabCut Integration

The library also provides direct integration with DeepLabCut (DLc) outputs, expanding its application scope beyond traditional machine learning contexts. Users can seamlessly incorporate CEBRA embeddings into existing DLc workflows, enabling more sophisticated analysis of animal behavior through combined neural and anatomical data.

Docker Support

Dockerization supports reproducible analysis and experimental setup across different computing environments. This feature ensures consistent results regardless of local system configurations, a critical aspect for multi-site collaborations and computational reproducibility. Current implementation allows users to run both analysis and experiment code reliably across diverse computing environments.

Technical Implementation

Developed using PyTorch, CEBRA implements self-supervised learning algorithms specifically tailored for analyzing high-dimensional neural and behavioral recordings. This implementation choice allows for efficient processing of complex data while maintaining flexibility through direct access to model components.

Algorithm Implementation

The core of CEBRA's functionality resides in its PyTorch implementation, which focuses on estimating consistent embeddings of high-dimensional recordings that incorporate auxiliary variables. This approach enables the tool to uncover hidden structures within the data that traditional methods might miss.

Dual-Api Design

To facilitate broad accessibility and application across different research contexts, CEBRA implements its functionality through two primary APIs: a high-level interface aligned with Scikit-learn estimators and a lower-level PyTorch API that provides direct access to model components.

The high-level API allows researchers to employ familiar machine learning workflows while enabling them to work with custom datasets through scikit-learn-compatible functionality. The current implementation restricts this API to a single estimator class (named CEBRA), which provides comprehensive coverage of the library's primary functionalities.

For developers and researchers requiring more fine-grained control over algorithm components, CEBRA offers a low-level PyTorch API. This implementation exposes fundamental model components, including layers, loss functions, and other core functions, while also supporting advanced features like custom sampling mechanisms and alternative loss function variations.

Data Handling

CEBRA processes diverse datasets common in biology and neuroscience, including calcium imaging, electrophysiology recordings, and multi-session data. This compatibility spans multiple experimental paradigms, from rat hippocampus studies to mouse primary visual cortex analyses.

The tool's success across varied recording modalities demonstrates its effectiveness for both simple and complex behaviors across different species. Its ability to handle single-session and multi-session datasets makes it adaptable for multiple experimental designs and hypothesis testing frameworks.

Performance and Applications

The method's versatility has been demonstrated across multiple experimental paradigms. In rat hippocampus research (Grosmark and Buzsáki, 2016), CEBRA achieved remarkable accuracy, with a median absolute position error of 5cm across a 160cm track length - a significant improvement over previous approaches.

For more complex visual data analysis, CEBRA processes simultaneous 2-photon and Neuropixels recordings from mouse primary visual cortex. The tool employs DINO frame features as labels for video frame decoding using a k-nearest neighbors (kNN) approach applied to the CEBRA-Behavior embedding. This setup has proven effective for rapidly decoding natural movies in visual cortex with high accuracy.

The technique consistently generates both high-quality latent spaces and decoding capabilities across various recording modalities. While demonstrating particularly strong performance with calcium imaging and electrophysiology data, CEBRA has also been validated on multiple species and behaviors. Its ability to handle both single-session and multi-session datasets makes it suitable for a wide range of experimental designs and hypothesis testing frameworks.

A key strength of the method lies in its dual API implementation. The high-level API, aligned with Scikit-learn estimators, enables seamless integration with existing machine learning workflows while supporting custom dataset structures and decoder functionality. The low-level PyTorch API provides comprehensive access to core model components, allowing researchers to implement custom sampling mechanisms or explore alternative loss functions. Together, these features support the method's application across diverse biological and neurological data.