Composable Prompts for
Together AI
Together AI is a fully integrated inference provider and execution environment in which language models run. Together AI allows developers to run open-source models like Llama2 on one of the fastest inference stacks available.
Together AI Integration
The integration with Together AI offers unique benefits for Composable Prompts users
-
Supports JSON constraints
-
Fine-tune models with your data
Features of the environment
Environments are the execution runtime environment for the generative model
-
Portable Task Model
Execute a task on any model and inference provider with zero changes
-
Single Execution Interface
For all models and providers, including streaming
-
Virtualization Layer
Integrate different models and providers into a single virtualized environment
-
Fine-Tuning
-
Storage, Indexing & Search
-
Load- Balancing