Orq.ai Product Updates

Evaluate features

Evaluator Library: The new Evaluator Library provides over 50 preconfigured templates to streamline quality checks, compliance, and contextual alignment. With customizable evaluators and seamless integration into experiments and deployments, this update ensures consistent quality control throughout the AI product development lifecycle.

Evals & Guardrails (HTTP and JSON): New HTTP and JSON evaluators and guardrails allow you to perform custom checks using external APIs and predefined JSON schemas. These tools help enforce compliance and validate inputs and outputs during experiments and deployments, enhancing control and precision.

RAGAS Evaluators: RAGAS Evaluators offer specialized tools to evaluate retrieval-augmented generation (RAG) workflows. These evaluators ensure the accuracy, relevance, and safety of responses by assessing factors like context precision, response relevancy, and faithfulness in both experiments and deployments.