Skip to main content

2 docs tagged with "ai"

View All Tags

Model Svc

The model service can start, stop AI models across multiple runtimes (eg. Docker) and maintains a database of available models on the platform.

Prompt Svc

The prompt service provides an easy to use interface to prompt LLMs and use AI models. Aims to serve humans and machines alike with its resilient queue based architecture.