Run Models on Nebius Token Factory using APIs

This guide shows how to run models using various python APIs.

References and Acknowledgements

• API documentation

Prerequisites

• NEBIUS_API_KEY

Setup Python Env

• Be sure to finish the setup
• And install the requirements

# follow the seutp-dev-env.md guide above to set up your python env.

# activate the python env
source  .venv/bin/activate
pip install -r  requirements.txt

OpenAI Compatible API

This is the default API. OpenAI API comptable.

Example code: api_native.ipynb

API reference

Thirdparty APIs

Nebius Token Factory also supports third party APIs. Here are some examples

AISuite

aisuite is a simple, unified interface to multiple Generative AI providers.

Example code: api_native.ipynb

LiteLLM

LiteLLM is a popular API that provides consistent API for calling multiple providers.

Example code: api_litellm.ipynb

Llama-Index

llama-index is a library for building LLM / AI applications.

Example code: api_llamaindex.ipynb

More Thirdparty APIs

See Nebius third party API documentation for complete list.