You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: MyApp/_pages/ai-server/index.md
+28-24Lines changed: 28 additions & 24 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,9 +3,9 @@ title: Overview
3
3
description: Introduction to AI Server and its key features
4
4
---
5
5
6
-
AI Server is a way to orchestrate your AI requests through a single self-hosted application to control what AI Providers you use without impacting your client integrations. It serves as a private gateway to process LLM, AI, and image transformation requests, dynamically delegating tasks across multiple providers including Ollama, OpenRouter, Replicate, Comfy UI, utilizing models like Whisper, SDXL, Flux, and tools like ffmpeg.
6
+
AI Server allows you to orchestrate your systems AI requests through a single self-hosted application to control what AI Providers App's should use without impacting their client integrations. It serves as a private gateway to process LLM, AI, and image transformation requests, dynamically delegating tasks across multiple providers including Ollama, OpenAI, Anthropic, Mistral AI, Google Cloud, OpenRouter, GroqCloud, Replicate, Comfy UI, utilizing models like Whisper, SDXL, Flux, and tools like FFmpeg.
7
7
8
-
```mermaid
8
+
```mermaid{.not-prose}
9
9
flowchart TB
10
10
A[AI Server]
11
11
A --> D{LLM APIs}
@@ -14,37 +14,41 @@ flowchart TB
14
14
A --> F{Comfy UI
15
15
+
16
16
FFmpeg}
17
-
D --> D1[OpenRouter / OpenAI / Mistral / Anthropic / Google Cloud / Groq]
18
-
E --> E1[Replicate / dall-e-3 / Text to speech]
19
-
F --> F1[Diffusion / Whisper / TTS]
17
+
D --> D1[OpenAI, Anthropic, Mistral, Google, OpenRouter, Groq]
18
+
E --> E1[Replicate, dall-e-3, Text to speech]
19
+
F --> F1[Diffusion, Whisper, TTS]
20
20
```
21
21
22
-
## Key Features
23
-
24
-
-**Unified AI Gateway**: Centralize all your AI requests through a single self-hosted service.
25
-
-**Multi-Provider Support**: Seamlessly integrate with Ollama, Open AI, Comfy UI, and more.
26
-
-**Type-Safe Integrations**: Native end-to-end typed integrations for 11 popular languages.
27
-
-**Secure Access**: API key authentication to protect your AI resources.
28
-
-**Managed File Storage**: Built-in cached storage for AI-generated assets.
29
-
-**Background Job Processing**: Efficient handling of long-running AI tasks, capable of distributing workloads.
30
-
-**Custom Deployment**: Run as a single Docker container, with optional GPU-equipped agents for advanced tasks.
31
-
32
22
## Why Use AI Server?
33
23
34
24
AI Server simplifies the integration and management of AI capabilities in your applications:
35
25
36
-
1.**Centralized Management**: Manage all your AI providers and requests from a single interface.
37
-
2.**Cost Control**: Monitor and control usage across your organization with detailed request history.
38
-
3.**Flexibility**: Easy to scale and adapt as your AI needs evolve.
39
-
4.**Security**: Keep your AI operations behind your firewall with a private, managed gateway.
40
-
5.**Developer-Friendly**: Type-safe APIs and integrations for a smooth development experience.
26
+
-**Centralized Management**: Manage your LLM, AI and Media Providers, API Keys and usage from a single App
27
+
-**Flexibility**: Easily switch 3rd party providers without impacting your client integrations
28
+
-**Scalability**: Distribute workloads across multiple providers to handle high volumes of requests efficiently
29
+
-**Security**: Self-hosted private gateway to keep AI operations behind firewalls, limit access with API Keys
30
+
-**Developer-Friendly**: Simple development experience utilizing a single client and endpoint and Type-safe APIs
31
+
-**Manage Costs**: Monitor and control usage across your organization with detailed request history
32
+
33
+
## Key Features
34
+
35
+
-**Unified AI Gateway**: Centralize all your AI requests & API Key management through a single self-hosted service
36
+
-**Multi-Provider Support**: Seamlessly integrate with Leading LLMs, Ollama, Comfy UI, FFmpeg, and more
37
+
-**Type-Safe Integrations**: Native end-to-end typed integrations for 11 popular programming languages
38
+
-**Secure Access**: Use simple API key authentication to control which AI resources Apps can use
39
+
-**Managed File Storage**: Built-in cached asset storage for AI-generated assets, isolated per API Key
40
+
-**Background Job Processing**: Efficient handling of long-running AI tasks, capable of distributing workloads
41
+
-**Monitoring and Analytics**: Real-time monitoring performance and statistics of executing AI Requests
42
+
-**Recorded**: Auto archival of completed AI Requests into monthly rolling databases
43
+
-**Custom Deployment**: Run as a single Docker container, with optional GPU-equipped agents for advanced tasks
41
44
42
45
## Supported AI Capabilities
43
46
44
-
-**Large Language Models**: Integrate with Open AI Chat, Ollama, and various API gateways including OpenRouter.
45
-
-**Image Generation & Transformations**: Leverages ComfyUI Agent self-hosted, and SaaS providers like Replicate.
46
-
-**Audio Processing**: Text-to-speech, and speech-to-text with Whisper integration.
47
-
-**Video Processing**: Format conversions, scaling, cropping, and more with via ffmpeg.
47
+
-**Large Language Models**: Integrates with Ollama, OpenAI, Anthropic, Mistral, Google, OpenRouter and Groq
48
+
-**Image Generation**: Leverage self-hosted ComfyUI Agents and SaaS providers like Replicate, DALL-E 3
49
+
-**Image Transformations**: Dynamically transform and cache Image Variations for stored assets
50
+
-**Audio Processing**: Text-to-speech, and speech-to-text with Whisper integration
51
+
-**Video Processing**: Format conversions, scaling, cropping, and more with via FFmpeg
0 commit comments