Toolkit - Developer Utilities¶
The Toolkit section under Dev Tools in Search AI provides a collection of utilities and SDKs to extend, integrate, and optimize your search experience. The toolkit offers a range of utilities for various activities, including content processing, data extraction, performance tuning, and connector development, enabling advanced customization and intelligent search workflows. These are developer-friendly tools that aim to reduce implementation time and enable fast adoption.
Tools and Utilities¶
RAG Evaluator¶
Use this SDK to evaluate RAG system performance by measuring search quality metrics using RAGAS and CEQA frameworks with options for API integration and flexible results storage. It can help evaluate search quality, score answer accuracy, and test chunk relevance.
Custom Connector SDK¶
The Custom SDK Connector is a flexible integration tool that enables seamless data ingestion from various sources into SearchAI. This SDK provides a standardized way to connect and ingest data from external sources while maintaining data structure and metadata integrity, optimized for enterprise RAG (Retrieval-Augmented Generation) applications.
Learn More: Custom Connector SDK
HTML to Structured Data Extractor¶
Extract and organize content from HTML sources by identifying tables of contents and preserving heading-content relationships. It takes an input directory containing HTML files, processes the content, and saves the extracted structured data in JSON format to an output directory.
Learn More:HTML to Structured Data Extractor
Fine-Tune Embedding Utility¶
Fine-tune your embedding models using domain-specific documents. Use this utility to compare model performance before and after fine-tuning.
Learn More: Fine-Tune Embedding Utility
Adobe Extraction Utility¶
Extract structured content from PDF files while preserving the original layout and structure of the files. This tool simplifies the parsing of documents for intelligent ingestion and processing.
Learn More: Adobe Extraction Utility
Azure Extraction Utility¶
Use this utility to extract and structure data from Azure-hosted documents. It uses Azure AI Document Intelligence service to extract content from documents automatically and accurately and prepare it for ingestion into Search AI.
Learn More: Azure Extraction Utility
Google Document AI¶
Process documents in batch from cloud storage, extract structured content from within AI processors, and automatically ingest the parsed data. It uses Document AI, which is a platform designed to automate document processing and extract structured data from unstructured or semi-structured documents.
Learn More: Google Document AI
Salesforce Custom Extraction Utility¶
Extract and structure content from Salesforce Knowledge Base or documents, retaining hierarchy and relationship structure for ingestion in Search AI applications.