Composable Prompts for
Vertex AI
Google's Vertex AI is a fully integrated inference provider and execution environment in which language models run. Vertex AI is a machine learning (ML) platform that enables developers to customize large language models (LLMs) for use in AI-powered applications.
Vertex AI Integration
The integration with Google's Vertex AI offers unique benefits to Composable Prompts users
-
Single API for all of Google’s models
instead of the 3 different APIs for PaLM, Bison, and Gemini
-
Easy to use prompt studio
-
Access to Google's Gemini multimodal models
Features of the environment
Environments are the execution runtime environment for the generative model
-
Portable Task Model
Execute a task on any model and inference provider with zero changes
-
Single Execution Interface
For all models and providers, including streaming
-
Virtualization Layer
Integrate different models and providers into a single virtualized environment
-
Fine-Tuning
-
Storage, Indexing & Search
-
Load- Balancing