Government & Public SectorConversational AIPublic Cloud

German Federal Employment Agency deploys cloud-based AI with Privatemode

German Federal Employment Agency (Bundesagentur für Arbeit)· GermanyPrivatemode · Llama 3.3 70B

The German Federal Employment Agency (Bundesagentur für Arbeit, BA), with over 110,000 employees and one of the largest public authorities in Germany, needed an internal knowledge management AI chatbot but a local AI deployment would have been very time-consuming. It tested Privatemode, the confidential AI service from Edgeless Systems, which encrypts data during storage, transmission and processing. Using the Privatemode API, the BA set up a chatbot that answers questions from internal databases of its Cloud Center of Excellence, accessing the open-source Llama 3.3 70B model and scaling without owning GPU infrastructure, while keeping user data such as AI prompts protected against access by cloud, model, or service providers.

Overview

The German Federal Employment Agency (Bundesagentur für Arbeit, BA), with over 110,000 employees and one of the largest public authorities in Germany, needed an internal knowledge management AI chatbot but a local AI deployment would have been very time-consuming. It tested Privatemode, the confidential AI service from Edgeless Systems, which encrypts data during storage, transmission and processing. Using the Privatemode API, the BA set up a chatbot that answers questions from internal databases of its Cloud Center of Excellence, accessing the open-source Llama 3.3 70B model and scaling without owning GPU infrastructure, while keeping user data such as AI prompts protected against access by cloud, model, or service providers.

The challenge

The BA operates one of the largest IT landscapes in Germany, with over 100 IT systems and around 15,000 applications for unemployment or child benefits submitted daily. At the same time, the BA faces a significant shortage of skilled workers, as around 38% of its workforce will retire within the next decade. An AI service for internal knowledge management needed to be implemented and tested quickly, but a local AI deployment would have been very time-consuming, so a secure cloud-based LLM solution was to be used, while ensuring sensitive personally identifiable information is processed securely and in compliance with data protection regulations.

The solution

As part of its AI and multi-cloud strategy, the BA evaluated the use of confidential computing and tested Privatemode, the confidential AI service from Edgeless Systems, for its desired knowledge management solution. Privatemode ensures data is encrypted not only during storage and transmission but also during processing. Using the Privatemode API, the BA set up a chatbot capable of answering questions using information from internal databases of its Cloud Center of Excellence, accessing the open-source Llama 3.3 70B model and scaling without needing its own GPU infrastructure, while keeping user data such as AI prompts protected against access by cloud, model, or service providers.

Conversational AILarge Language Models

Reported business value

With Privatemode AI, the BA very quickly set up a secure, scalable AI chatbot capable of answering questions using information from internal databases of its Cloud Center of Excellence, scaling without the need for its own GPU infrastructure while ensuring maximum data protection.

Sources

Open any source and check the claim yourself — that is the point of the register.

This record was researched and written with AI assistance, and its claims were checked against the sources above. (EU AI Act art. 50 transparency notice.)

Related entries

Other government & public sector entries in the register.

All entries
Government & Public SectorIntelligent AutomationPublic Cloud

GovTech unlocks data insights to improve nationwide services with Databricks

Singapore's Government Technology Agency (GovTech) migrated from an on-premises dashboarding system to the Databricks Data + AI Platform on AWS with Unity Catalog and Delta Lake, cutting dashboard creation time from 90 to 30 days, democratizing data across 50% of corporate divisions in the first year, and saving 8,000 labor hours annually.

96/100HighPrimary source
GovTech· SingaporeDelta Lake · Lakeflow Connect · Lakeflow Jobs +1
Government & Public SectorConversational AIPublic Cloud

Estonia rolls out Bürokratt, an AI-guided virtual assistant network for public services

Bürokratt is a network of chatbots deployed on Estonian public sector institutions' websites, letting people obtain information from institutions and use public and information services via virtual assistants. It is a state-created, AI-based digital assistant that helps institutions deliver modern, efficient, around-the-clock customer service using large language models.

96/100HighPrimary source
Estonian Government (RIA - State Information System Authority)· EstoniaLarge Language Models (LLM) · Retrieval-Augmented Generation (RAG)
Government & Public SectorGenerative AIPublic Cloud

VA Advances Healthcare Insights With AI

The U.S. Department of Veterans Affairs leverages Databricks Data Intelligence to modernize healthcare analytics for millions of veterans, unifying massive distributed datasets into a single secure environment and streaming petabytes of health data in real time, reducing processes that once took hours to seconds. Databricks enables AI and large language models to detect risk early and enhance governance.

96/100HighPrimary source
U.S. Department of Veterans AffairsDatabricks
Government & Public SectorNatural Language ProcessingUnknown

Austrian Academy of Sciences unlocks Ancient Greek with Mistral

The Austrian Academy of Sciences (OeAW), together with its Austrian Archaeological Institute, partnered with Mistral and services partner Reply to build Apollo, described as the first advanced large language model for Ancient Greek. Apollo is trained on a specialized corpus of 600 million words of historical Greek text plus tens of thousands of published inscriptions and papyri, helping researchers reconstruct damaged texts and identify thematic connections across collections. The OeAW reports Apollo turns work that once took years into hours, addressing over one million unread Greek papyri worldwide, with future phases planned for semantic search and handwritten inscription decipherment.

92/100HighPrimary source
Austrian Academy of Sciences· AustriaMistral

Was this helpful?

Your feedback helps us improve our use case database