Skip to content

Commit 551424a

Browse files
committed
Update index.md
1 parent 5f18a0c commit 551424a

File tree

1 file changed

+28
-24
lines changed

1 file changed

+28
-24
lines changed

MyApp/_pages/ai-server/index.md

Lines changed: 28 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -3,9 +3,9 @@ title: Overview
33
description: Introduction to AI Server and its key features
44
---
55

6-
AI Server is a way to orchestrate your AI requests through a single self-hosted application to control what AI Providers you use without impacting your client integrations. It serves as a private gateway to process LLM, AI, and image transformation requests, dynamically delegating tasks across multiple providers including Ollama, OpenRouter, Replicate, Comfy UI, utilizing models like Whisper, SDXL, Flux, and tools like ffmpeg.
6+
AI Server allows you to orchestrate your systems AI requests through a single self-hosted application to control what AI Providers App's should use without impacting their client integrations. It serves as a private gateway to process LLM, AI, and image transformation requests, dynamically delegating tasks across multiple providers including Ollama, OpenAI, Anthropic, Mistral AI, Google Cloud, OpenRouter, GroqCloud, Replicate, Comfy UI, utilizing models like Whisper, SDXL, Flux, and tools like FFmpeg.
77

8-
```mermaid
8+
```mermaid{.not-prose}
99
flowchart TB
1010
A[AI Server]
1111
A --> D{LLM APIs}
@@ -14,37 +14,41 @@ flowchart TB
1414
A --> F{Comfy UI
1515
+
1616
FFmpeg}
17-
D --> D1[OpenRouter / OpenAI / Mistral / Anthropic / Google Cloud / Groq]
18-
E --> E1[Replicate / dall-e-3 / Text to speech]
19-
F --> F1[Diffusion / Whisper / TTS]
17+
D --> D1[OpenAI, Anthropic, Mistral, Google, OpenRouter, Groq]
18+
E --> E1[Replicate, dall-e-3, Text to speech]
19+
F --> F1[Diffusion, Whisper, TTS]
2020
```
2121

22-
## Key Features
23-
24-
- **Unified AI Gateway**: Centralize all your AI requests through a single self-hosted service.
25-
- **Multi-Provider Support**: Seamlessly integrate with Ollama, Open AI, Comfy UI, and more.
26-
- **Type-Safe Integrations**: Native end-to-end typed integrations for 11 popular languages.
27-
- **Secure Access**: API key authentication to protect your AI resources.
28-
- **Managed File Storage**: Built-in cached storage for AI-generated assets.
29-
- **Background Job Processing**: Efficient handling of long-running AI tasks, capable of distributing workloads.
30-
- **Custom Deployment**: Run as a single Docker container, with optional GPU-equipped agents for advanced tasks.
31-
3222
## Why Use AI Server?
3323

3424
AI Server simplifies the integration and management of AI capabilities in your applications:
3525

36-
1. **Centralized Management**: Manage all your AI providers and requests from a single interface.
37-
2. **Cost Control**: Monitor and control usage across your organization with detailed request history.
38-
3. **Flexibility**: Easy to scale and adapt as your AI needs evolve.
39-
4. **Security**: Keep your AI operations behind your firewall with a private, managed gateway.
40-
5. **Developer-Friendly**: Type-safe APIs and integrations for a smooth development experience.
26+
- **Centralized Management**: Manage your LLM, AI and Media Providers, API Keys and usage from a single App
27+
- **Flexibility**: Easily switch 3rd party providers without impacting your client integrations
28+
- **Scalability**: Distribute workloads across multiple providers to handle high volumes of requests efficiently
29+
- **Security**: Self-hosted private gateway to keep AI operations behind firewalls, limit access with API Keys
30+
- **Developer-Friendly**: Simple development experience utilizing a single client and endpoint and Type-safe APIs
31+
- **Manage Costs**: Monitor and control usage across your organization with detailed request history
32+
33+
## Key Features
34+
35+
- **Unified AI Gateway**: Centralize all your AI requests & API Key management through a single self-hosted service
36+
- **Multi-Provider Support**: Seamlessly integrate with Leading LLMs, Ollama, Comfy UI, FFmpeg, and more
37+
- **Type-Safe Integrations**: Native end-to-end typed integrations for 11 popular programming languages
38+
- **Secure Access**: Use simple API key authentication to control which AI resources Apps can use
39+
- **Managed File Storage**: Built-in cached asset storage for AI-generated assets, isolated per API Key
40+
- **Background Job Processing**: Efficient handling of long-running AI tasks, capable of distributing workloads
41+
- **Monitoring and Analytics**: Real-time monitoring performance and statistics of executing AI Requests
42+
- **Recorded**: Auto archival of completed AI Requests into monthly rolling databases
43+
- **Custom Deployment**: Run as a single Docker container, with optional GPU-equipped agents for advanced tasks
4144

4245
## Supported AI Capabilities
4346

44-
- **Large Language Models**: Integrate with Open AI Chat, Ollama, and various API gateways including OpenRouter.
45-
- **Image Generation & Transformations**: Leverages ComfyUI Agent self-hosted, and SaaS providers like Replicate.
46-
- **Audio Processing**: Text-to-speech, and speech-to-text with Whisper integration.
47-
- **Video Processing**: Format conversions, scaling, cropping, and more with via ffmpeg.
47+
- **Large Language Models**: Integrates with Ollama, OpenAI, Anthropic, Mistral, Google, OpenRouter and Groq
48+
- **Image Generation**: Leverage self-hosted ComfyUI Agents and SaaS providers like Replicate, DALL-E 3
49+
- **Image Transformations**: Dynamically transform and cache Image Variations for stored assets
50+
- **Audio Processing**: Text-to-speech, and speech-to-text with Whisper integration
51+
- **Video Processing**: Format conversions, scaling, cropping, and more with via FFmpeg
4852

4953
## Getting Started for Developers
5054

0 commit comments

Comments
 (0)