Note: This project is in the very early stages of planning and development. There is currently no functional code.
This library aims to robustly package a diverse set of AI models and frameworks within a unified Python environment, enabling seamless deployment and management of multiple models with different dependencies.
- Project requirements for dependencies resolution, Nexus package definition, testing and benchmarking
- Protocol and tools for cross package dependency resolution in place, supporting with/without vLLM with latest and pinned scenarios
- Benchmarking and testing protocols defined
- Nexus package and model owner responsibilities defined
- Rules for contributing a new Nexus Package defined
- Initial CI in place, supporting Nexus package structure validation (without vLLM validation), dependency resolution and models inference testing.
- Nexus package for TerraTorch integrated
- Requirements for models integration with vLLM defined
- CI workflows extended with validation of vLLM integration requirements and benchmarking tasks
- Agentic skills implemented for generation of a Nexus package and PR
- Agentic functionalities implemented for supporting the implementation of the vLLM plugins required for a model
- Integration of Tokamind Fusion models
- Agentic functionalities extended to supporting the deployment of the integrated models
- Integration of additional algorithm packages from beta-test phase
- Models scoreboard implemented to track the performance of the integrated models
Algorithm Nexus provides the nexus CLI tool for managing Nexus packages. This
tool allows the validation of the structure of a Nexus Package.
To use the CLI for package configuration validation, clone the repository and install with uv:
git clone https://github.com/IBM/algorithm-nexus.git
cd algorithm-nexus
uv sync --extra cliThe validation tool checks:
- Package structure: Verifies required files (
nexus.yaml,model.yaml) and directories (tests/) exist - YAML syntax: Ensures all configuration files are valid YAML
- Schema validation: Validates configuration against Pydantic models for correct field types and required fields
- Cross-validation: Checks dependencies between configurations (e.g., vLLM enabled requires vLLM testing)
- Model declarations: Ensures all models in
nexus.yamlhave corresponding directories
Example usage:
nexus validate /path/to/packageIn case of validation errors a detailed report guides the user to fix the issues.
This project is currently in closed beta. We are not accepting external contributions at this time.
For IBM contributors:
- Please, see our Contributing Guide for development setup and guidelines.
- Read the guide for step-by-step instructions for contributing a Nexus Package.
This project is licensed under the Apache License 2.0 - see the LICENSE file for details.
See MAINTAINERS.md for the list of project maintainers.
- Issues: GitHub Issues
- Discussions: GitHub Discussions
This project is part of IBM's commitment to open-source AI infrastructure and collaboration with Red Hat.