A Journey Towards Unified Data Governance at bp
bp implemented Databricks Unity Catalog to unify data governance across data previously spread across disparate systems, migrating over 270 Databricks workspaces from two separate data hub platforms and 15 standalone instances, serving 10,000+ users across Finance ERP, Customer and Products, Production and Operations, and Enterprise business entities. The migration, run in four phased quarters, delivered centralized governance, granular row/column-level access control, and automated column-level data lineage and audit logs. bp expects the consolidation to save nearly $1 million annually plus roughly $4,000 weekly by eliminating manual Overwatch job management, and the migration unlocked Delta Sharing, SQL Serverless Warehouses, and further AI features like model serving and fine-tuning.
Overview
bp implemented Databricks Unity Catalog to unify data governance across data previously spread across disparate systems, migrating over 270 Databricks workspaces from two separate data hub platforms and 15 standalone instances, serving 10,000+ users across Finance ERP, Customer and Products, Production and Operations, and Enterprise business entities. The migration, run in four phased quarters, delivered centralized governance, granular row/column-level access control, and automated column-level data lineage and audit logs. bp expects the consolidation to save nearly $1 million annually plus roughly $4,000 weekly by eliminating manual Overwatch job management, and the migration unlocked Delta Sharing, SQL Serverless Warehouses, and further AI features like model serving and fine-tuning.
The challenge
bp faced challenges typical of large enterprises dealing with vast amounts of data spread across various systems and platforms: lack of centralized oversight made it difficult to enforce consistent data governance policies, discoverability and visibility of dataset ownership took time and led to concerns about data provenance accuracy, and ensuring compliance with stringent data protection laws such as GDPR and industry-specific regulations was complex.
The solution
bp implemented Databricks Unity Catalog to unify data governance, migrating over 270 Databricks workspaces from two separate data hub platforms and 15 standalone instances, serving over 10,000 users across Finance ERP, Customer and Products, Production and Operations, and Enterprise business entities. The migration ran in four phased quarters (pilot migrations, early adopters, first majority, remaining workspaces), prioritizing business-critical tables, using a flexible data integration approach aligning data with bronze, silver and gold layers over time, and an automation-first approach to manage the long tail of data consumers.
Reported business value
The migration delivered centralized governance, granular row/column-level access control, and automated column-level data lineage and audit logs. bp expects the consolidation to save nearly $1 million annually, plus roughly $4,000 weekly by eliminating manual Overwatch job management, and it unlocked Delta Sharing, SQL Serverless Warehouses, and further AI features like model serving, fine-tuning and vector databases.
Sources
Open any source and check the claim yourself — that is the point of the register.
This record was researched and written with AI assistance, and its claims were checked against the sources above. (EU AI Act art. 50 transparency notice.)
Other energy entries in the register.
Building a clean energy future with natural language analytics
Williams, a large-scale natural gas infrastructure operator, deployed Databricks AI/BI Genie to give commercial, regulatory, accounting and technical staff natural-language, self-serve access to analytics. The team flattened 27 disparate tables into SQL models that Genie Spaces reason over, encoding internal acronyms and business logic into Genie's instructions, powered by Databricks Unity Catalog. A data request that previously took an analyst five days now completes in seconds with validated accuracy, and the weekly backlog of data requests dropped from up to ten to one or two, freeing analysts for predictive modeling and enterprise projects.
WilliamsDatabricks AI/BI Genie · Databricks Unity CatalogPlenitude builds machine learning models on Databricks to forecast energy demand and renewable production
Eni-owned energy company Plenitude, which serves 10 million households and businesses across Europe, uses statistical models and machine learning on the Databricks Data + AI Platform to forecast customer energy consumption at hourly and daily granularity, forecast wind and solar generation from its renewable asset portfolio, and run customer segmentation and propensity models across 60 implemented use cases.
PlenitudeDatabricks Data + AI Platform · Delta Lake · Unity Catalog +2Using data to power-fuel the transition to a carbon-neutral world
Helen, Helsinki's energy utility, built a centralized data and AI platform on Databricks to power forecasting and optimization models for its district heating system serving about 90% of Helsinki's population, processing real-time streaming sensor and IoT data to optimize distributed energy resources and EV charging placement as part of a plan to cut carbon emissions over 80% by decommissioning coal plants.
Helen· FinlandDatabricks Data + AI Platform · Delta Lake · Spark Declarative Pipelines +3Foresea modernizes base yard logistics with Oracle Autonomous AI Database
Foresea, a Brazilian offshore oil and gas drilling company, migrated its dock scheduling application to Oracle Autonomous AI Database 26ai with Oracle AI Database Private Agent Factory on OCI. The company replaced an unpredictable dock receiving process with a self-service booking application giving suppliers visibility into delivery status, check-in/check-out, dwell time, and document readiness, reducing wait times and overtime hours at its base yards.
Was this helpful?
Your feedback helps us improve our use case database