# Orq.ai # Scale LLM Apps from Prototype to Production **Built for serious software teams, Orq.ai is the #1 platform to operate agentic AI systems at scale.** Optimize prompts, deploy use cases, and monitor performance – no blind spots, no vibe checks. --- ## Introduction Welcome to **Orq.ai**, the comprehensive Generative AI Collaboration Platform. Orq.ai enables both technical and non-technical teams to work together seamlessly in building, deploying, and scaling reliable LLM applications. - **For developers**: Debug agents, manage prompts as code, run A/B tests, and integrate with one line of code - **For product managers**: Experiment with prompts, evaluate outputs, and optimize performance without touching code - **For domain experts**: Annotate outputs, create datasets, and collaborate on prompt improvements - **For the business**: Track costs, monitor performance, ensure compliance, and scale AI safely **Trusted by 100+ Engineering Teams Building Production AI** --- ## LLM Experimentation ### Test LLMs & Prompts at Scale - Built-in support for **220+ AI models** - Experiment before production deployment - Evaluate agentic AI systems offline #### Core Features - **Prompt optimization** with version control - **A/B testing** across models and prompts - **Dataset management** from production data - **Regression testing** to prevent quality degradation - **Evaluators** for quality assurance ### Experimentation Capabilities - **Model comparison**: Test across 220+ models - **Prompt versioning**: Track every iteration - **Offline evaluation**: Test before deployment - **Collaborative workspace**: Domain experts and developers together - **Performance benchmarking**: Compare latency, cost, quality --- ## Orchestration ### Control the Release of AI Updates - Roll out to specific user groups - Built-in guardrails and safety measures - Advanced RAG pipelines - Zero-downtime deployments ### Deployment Features - **Version control** for prompts and configurations - **Routing engine** with business rules - **Advanced RAG** with custom knowledge bases - **Fallbacks & retries** for reliability - **Canary releases** for safe rollouts #### RAG Capabilities - **Custom knowledge bases** - **Intelligent chunking strategies** - **Multi-modal document support** - **Real-time index updates** - **Semantic search optimization** --- ## LLM Observability ### Monitor & Debug Agents - Visualize all agent-triggered events - Granular cost and performance control - Real-time debugging capabilities ### Observability Features - **Distributed tracing** across complex workflows - **Cost management** per model, user, feature - **Advanced logging** with full context - **Anomaly detection** for quality issues - **Performance dashboards** with custom metrics #### Debugging Tools - **Request replay** for troubleshooting - **Token-level analysis** - **Latency profiling** - **Error tracking & alerts** - **User journey mapping** --- ## Developer Experience ### Built for Modern AI Development - **One-line integration** with SDK - **Framework agnostic** design - **API-first architecture** - **Local development support** ### SDKs & Integrations - **Node.js SDK**: `npm install @orq-ai/node` - **Python SDK**: `pip install orq-ai-sdk` - **REST API** for any language - **Webhooks** for event streaming - **CI/CD integration** ready ### Supported Frameworks - LangChain - Langgraph - OpenAI Agent SDK - Google Agent Development Kit - Direct API calls --- ## AI Gateway ### Unified Access to 220+ Models - Single API for all providers - Automatic failover - Load balancing - Custom model support ### Supported Providers - **OpenAI** (GPT-4, GPT-3.5) - **Anthropic** (Claude 3) - **Google** (Gemini, PaLM) - **AWS Bedrock** - **Azure OpenAI** - **Cohere** - **Custom models** and fine-tunes --- ## Enterprise Security & Compliance ### Built for Regulated Industries - **SOC2 certified** platform - **GDPR compliant** data handling - **EU AI Act** aligned - **HIPAA ready** infrastructure ### Security Features - **Data residency**: US or EU hosting - **Encryption**: At rest (AES-256) and in transit (TLS 1.2+) - **Access control**: Role-based permissions - **PII protection**: Automatic masking - **Audit trails**: Complete activity logs ### Deployment Options - **Cloud**: Fully managed SaaS - **VPC**: Within your infrastructure - **On-premise**: Complete control - **Hybrid**: Best of both worlds --- ## Collaboration Features ### Cross-functional AI Development - **Real-time collaboration** on prompts - **Shared workspaces** for teams - **Annotation workflows** - **Feedback loops** from production - **Knowledge sharing** across teams ### Team Capabilities - Engineers work in code - Product managers use the UI - Domain experts provide feedback - Everyone sees the same data ## Platform Features - [Platform Overview](https://orq.ai/platform/overview): Comprehensive LLMOps solution for scaling from prototype to production. - [Experimentation](https://orq.ai/platform/experimentation): Test LLMs and prompts at scale with evaluators and dataset management. - [Deployment](https://orq.ai/solutions/run): Control AI releases with guardrails, privacy safeguards, and advanced RAG pipelines. - [Observability](https://orq.ai/blog/logging-monitoring-llm): Real-time monitoring, debugging, and cost management for AI agents. - [Prompt Management](https://orq.ai/platform/prompt-management): Version control and collaborative prompt engineering workflows. - [Model Garden](https://docs.orq.ai/docs/model-garden): Access and manage 220+ LLM models through a unified interface. - [AI Proxy](https://docs.orq.ai/docs/proxy): Unified API for accessing models from OpenAI, Anthropic, Google, AWS, and third-party providers. ## Documentation - [Getting Started](https://docs.orq.ai/docs/introduction): Complete onboarding guide for building your first LLM application. - [API Reference](https://docs.orq.ai/api): Comprehensive API documentation for all platform features. - [Node.js SDK](https://docs.orq.ai/sdk/nodejs): Install with npm install @orq-ai/node for seamless integration. - [Python SDK](https://docs.orq.ai/sdk/python): pip install orq-ai-sdk for Python applications. - [Model Garden Guide](https://docs.orq.ai/docs/using-the-model-garden): How to enable and use different AI models. - [Analytics](https://docs.orq.ai/docs/analytics): Track performance metrics, usage patterns, and anomalies. - [LLM Evaluator](https://docs.orq.ai/docs/llm-evaluator): Harness LLMs to evaluate text quality and appropriateness. - [Changelog](https://docs.orq.ai/changelog/log-and-metrics-enhacements): Latest product updates and enhancements. ## Solutions - [Enterprise](https://orq.ai/solutions/enterprise): SOC2 certified platform with custom deployment options and dedicated support. - [SaaS](https://orq.ai/solutions/saas): End-to-end platform for product teams to scale GenAI in software products. - [Agencies](https://orq.ai/agencies): Partner program for software development agencies building AI solutions. - [Pricing](https://orq.ai/pricing): Free tier with 1K logs, Pro at €250/month, and custom Enterprise pricing. ## Resources - [Blog](https://orq.ai/blog): Latest insights on LLMOps best practices and AI development. - [LLM Agents Guide](https://orq.ai/blog/llm-agents): Comprehensive guide to building and scaling agentic AI systems. - [AI Agent Architecture](https://orq.ai/blog/ai-agent-architecture): Core principles and tools for building scalable autonomous systems. - [Multi-Agent Evaluation](https://orq.ai/blog/multi-agent-llm-eval-system): Key metrics and frameworks for evaluating multi-agent systems. - [LLM Use Cases](https://orq.ai/blog/llm-use-cases): 32 top use cases companies are investing in for 2025. - [LLM Orchestration](https://orq.ai/blog/llm-orchestration): Frameworks and best practices for orchestrating LLM applications. - [Agent Evaluation](https://orq.ai/blog/agent-evaluation): Complete guide to evaluating AI agents effectively. - [AI Agentic Workflows](https://orq.ai/blog/ai-agentic-workflows): Combining intelligent agents, LLMs, and automation patterns. - [Generative AI App Builders](https://orq.ai/blog/generative-ai-app-builders): Comparison of the 7 best platforms for 2025. - [Langchain Integration](https://orq.ai/blog/integrate-orqai-with-langchain): How to integrate Orq.ai with Langchain using Python SDK. ## Company - [About Us](https://orq.ai/about-us): Learn about Orq.ai's mission to democratize Generative AI development. - [Partners](https://orq.ai/partners): Technology and implementation partners enabling AI transformation. - [Status](https://status.orq.ai/): Real-time and historical data on system performance. - [Security & Compliance](https://orq.ai/security): SOC2, GDPR, and EU AI Act compliance documentation. ## Getting Started - [Sign Up](https://my.orq.ai/): Create a free account and start building LLM applications today. - [Book a Demo](https://orq.ai/demo): Schedule a personalized demo with our team. - [Contact Support](https://orq.ai/support): Get help from our dedicated support team. - [Join Waitlist](https://orq.ai/waitlist): Early access to new AI agent features and capabilities.