Key Features
🚀 Easy to Use
Simple installation with pip, npm, or your preferred package manager. Get started in minutes with intuitive APIs.
⚡ High Performance
Built-in connection pooling, retry logic, and async support for optimal performance.
🔄 Streaming Support
Server-sent events for real-time streaming responses with proper context management.
🛠️ Tool Calling
Native support for function calling and parallel tool execution.
📊 Structured Output
JSON schema validation and structured data extraction capabilities.
🖼️ Multimodal
Support for images, audio, and other modalities beyond text.
Quick Start
TypeScript
Documentation Sections
Installation & Setup
Get started with installation, authentication, and basic configuration.
System Endpoints
Health checks and model information endpoints.
Chat Completion
Basic AI responses with various models and parameters.
Streaming
Real-time streaming responses with server-sent events.
Tool Calling
Function calling and tool execution capabilities.
Structured Output
JSON schema validation and structured data extraction.
Image Input
Working with images and multimodal inputs.
Image Generation
Generate images with multiple providers and formats.
Audio Chat Completions
Add audio input and output to Chat Completions.
Reasoning
Advanced reasoning capabilities with o1 models.
CRUD Operations
Managing stored Chat Completions (OpenAI only).
SDK Benefits
Type Safety
Both SDKs are fully typed - Python with Pydantic models and TypeScript with native types, providing excellent IDE support and compile-time error checking.Error Handling
Comprehensive error handling with specific error types and detailed error information in both languages.Resource Management
Automatic connection pooling and resource cleanup with context manager support (Python) and proper resource management (TypeScript).Performance
Built-in retry logic, connection reuse, and async support for high-performance applications in both languages.Next Steps
- Install the SDK - Get started with installation and setup
- Try Chat Completion - Create your first AI response
- Explore Streaming - Add real-time capabilities
- Advanced Features - Tool calling, structured output, and more