Skip to content

Composable Prompts for

Hugging Face

We support Hugging Face Inference Endpoints. Developers can easily deploy Transformers, Diffusers or any model on dedicated, fully managed infrastructure.

Hugging Face Integration

The integration with Hugging Face offers unique benefits to Composable Prompts users

  • Easily deploy any Hugging Face Transformers, Sentence-Transformers and Diffusion models
  • Support all of the Hugging Face Transformers, Sentence-Transformers and Diffusion tasks as well as custom tasks not supported by Hugging Face Transformers

Features of the environment

Environments are the execution runtime environment for the generative model
  • Portable Task Model

    Execute a task on any model and inference provider with zero changes

  • Single Execution Interface

    For all models and providers, including streaming

  • Virtualization Layer

    Integrate different models and providers into a single virtualized environment

  • Fine-Tuning

  • Storage, Indexing & Search

  • Load- Balancing

Get started with a free trial of Composable Prompts