Databricks

Databricks Model Serving

Databricks Model Serving provides unified deployment and governance for classical ML models, generative AI models and AI agents, supporting proprietary models (Azure OpenAI, AWS Bedrock, Anthropic) and open-source models (Llama, Mistral) as low-latency, serverless API endpoints with built-in governance, lineage and monitoring.

Official product page
6published use cases
6industries
3countries on record
Generative AI
top AI capability

Evidence mix: High 6 · Medium 0 · Low 0 — bands are computed from each record's evidence signals.

Industry
Country

6 use cases

TelecommunicationsGenerative AIAgentic AIConversational AI

LG U+ Reduced LLM Vendor Dependency and Cut Costs 36% with Databricks Model Serving

LG U+, one of Korea's leading telecom carriers, migrated its U+one AI Search service to Databricks Model Serving to reduce dependence on a single external LLM vendor. Databricks hosts Gemini 2.5 Flash in a dedicated availability zone through a partnership with Google, letting LG U+ keep its existing LangChain interfaces and model while removing its direct reliance on Google's own infrastructure. The company also rebuilt its search architecture with an AI Gateway, Query Orchestration, a Semantic Elastic Cache, Hybrid Reasoning Retrieval, and Agentic Self-Correction Loops running within an LLMOps framework. In controlled tests, Gemini calls routed through Databricks showed 48% higher throughput, 22% faster average response times, and a 90% lower failure rate versus direct calls; in production, operating costs fell 36% and response speed improved 64% even as system complexity grew 107%. LG U+ is extending the same infrastructure to its ixi-O Voice AI services.

LG U+· South KoreaDatabricks Model Serving · LangChain · Gemini 2.5 Flash +3
Financial ServicesPredictive AnalyticsConversational AIAgentic AI

Delivering One Highstreet Experience Through Connected Data and Intelligence

Highstreet Insurance Partners, an insurance brokerage that has grown through partnerships with more than 200 independent agencies, built Ora, a proprietary unified digital intelligence platform on Databricks that combines trusted data, analytics, intelligent automation and AI. Ora manages more than 49 billion data points spanning client, policy and carrier history for roughly 500,000 active client relationships. Highstreet built a knowledge graph connecting clients, policies, coverages, documents, and communications to ground AI agent recommendations, uses Unity Catalog for governance across data and ML assets, and Databricks Model Serving to run machine learning models that surface renewal-likelihood scores and cross-sell opportunities. Highstreet reduced the time to onboard a new agency partner's data into Ora from as much as six months to less than two weeks, and increased daily data refresh success from 35% to more than 95% after re-engineering Ora's data foundation with Lakeflow pipelines and Delta Lake.

Highstreet Insurance Partners· United StatesUnity Catalog · Delta Lake · Lakeflow Jobs +2
EnergyGenerative AIRetrieval-Augmented GenerationConversational AIDocument Intelligence

Axpo boosts operational efficiency across the energy value chain

Axpo Group, a major player in the Swiss energy sector, built a GenAI knowledge platform on the Databricks Data + AI Platform to give employees secure, permission-aware search across internal data sources including technical standards, specifications and best practices. The architecture uses a medallion pattern (Bronze/Silver/Gold layers), Lakeflow Jobs for orchestration, RAG-based AI Search, GPT-4o for conversational responses, and Mistral OCR for scanned documents. The tool achieved a 90% approval rating and delivered 30% time savings for power users, with a 3x increase in user adoption as it expanded beyond engineering.

Axpo Group· SwitzerlandDatabricks Data + AI Platform · Databricks Lakeflow Jobs · GPT-4o +2
EducationMachine LearningFraud & Anomaly DetectionAI Model Development & MLOps

GoGuardian: Safer schools, empowered teachers, thriving students

GoGuardian, which powers safe, focused learning for half of U.S. K-12 students, migrated its ML infrastructure to Databricks to manage billions of daily inferences for web filtering, classroom management and harm prevention while maintaining a PII-free, COPPA/FERPA-compliant data environment. Using Delta Lake, Lakeflow, Unity Catalog, MLflow and Databricks Model Serving, GoGuardian achieved up to 50% reduction in machine learning operational costs, 90% operational cost savings with its Delphi website classification model, and a 62% reduction in inappropriate device use among students. AI-driven prioritization also cut the volume of records requiring human review for high-risk content by over 95%, from 1 million to 35,000-45,000.

GoGuardian· United StatesDelta Lake · Databricks Lakeflow · Unity Catalog +6
Consumer GoodsRetrieval-Augmented GenerationGenerative AIRecommendation & PersonalizationAgentic AI

Empowering Marketing Teams to Drive Greater Impact at Reckitt

Reckitt built an AI system called the Insight Engine on the Databricks Data + AI Platform, unifying consumer research, product reviews and social listening signals to give marketing teams faster, actionable insights. The system uses Databricks Model Serving to deploy multiple LLMs including OpenAI's ChatGPT-4 and Google's Gemini, AI Search for retrieval-augmented generation, and Agent Bricks AI Gateway for governance. Reckitt's marketing teams achieved a 40% improvement in task execution, a 40-60% reduction in time to develop campaign concepts, 60% faster concept development, and 30% faster ad adaptation and localization, with hundreds of marketers using the AI tools across the organization by the end of 2025.

ReckittDatabricks Data + AI Platform · Databricks Model Serving · OpenAI ChatGPT-4 +3