Sovereign AI and enterprise deployment

Microsoft Sovereign AI: What Runs Locally and What's Still in Preview

•Make Better Editorial

Microsoft is expanding sovereign AI options across Azure and Azure Local. Here is what can run on-premises, what is still preview, and how to plan a controlled rollout.

Microsoft's October 20, 2026 Sovereign Cloud update is relevant to teams deploying AI around regulated data, disconnected sites and sensitive development work. The important change is a broader set of public-cloud controls and customer-operated options, not a promise that every Microsoft AI product can suddenly run offline. Availability differs by component, and several capabilities are still in preview or scheduled for Microsoft Ignite.

What Microsoft announced

Microsoft describes three deployment paths: Sovereign Public Cloud for organizations that want Azure scale with stronger visibility and access controls; Sovereign Private Cloud for customer-operated environments, including connected and disconnected operations; and a partner ecosystem for independently operated or specialized local offerings. Teams can combine paths rather than choosing one deployment model for every workload.

  • Sovereign Control Panel is planned for public preview at Ignite, bringing residency, confidentiality, operator-access and continuity signals into a unified Azure portal experience.
  • Foundry Local on Azure Local is scheduled to become generally available at Ignite for connected and disconnected operations, with an expanded model catalog and local inference capabilities.
  • Agentic retrieval is intended to support natural-language access to enterprise data within customer-controlled environments; its own rollout status and prerequisites must be checked separately.
  • GitHub Enterprise Local is scheduled for general availability at Ignite as a validated appliance on Azure Local, alongside locally hosted-model options for development.

What runs locally—and what still needs checking

Microsoft's Azure Local documentation says Foundry Local can process inference requests on-premises, and its agentic retrieval stack can keep ingestion, search, orchestration and generation within network boundaries. That is meaningful for teams that cannot send sensitive prompts or documents to hosted inference endpoints. But local processing does not automatically mean an installation is completely self-sufficient: Azure subscription registration, Arc-enabled Kubernetes, model availability, deployment prerequisites and management connectivity all matter.

There is a timing distinction worth preserving. The October 20 announcement describes Foundry Local's general availability as an upcoming Ignite milestone, while the currently accessible Azure Local technical overview still labels Foundry Local and agentic retrieval as preview. Treat the announcement as a roadmap for availability, not proof that every feature is generally available in every region or tenant today.

A workload-first decision framework

Choose control by operational requirement

Workload requirementLikely starting point
Standard business AI with Azure governance and evidence requirementsSovereign Public Cloud plus Sovereign Control Panel evaluation
Sensitive inference that must execute on customer-operated hardwareFoundry Local on Azure Local, subject to hardware and feature readiness
Essential service that must continue through network disconnectionSovereign Private Cloud with tested disconnected operating procedures
Local ownership, national operator or sector-specific contractual requirementsEvaluate Sovereign Partner Ecosystem and country-specific service matrices

For example, a public agency might keep a citizen-facing application in Azure while moving a confidential document-search assistant to Azure Local. That split can preserve cloud scalability for the public workflow while reducing data exposure for the private one. The right design depends on actual data flows, identity boundaries, audit obligations, latency, failure modes and the organization's legal interpretation—not the product name alone.

The practical checklist before a pilot

  1. Map each AI workload's data residency, operator-access, continuity and model-serving requirements.
  2. Verify the exact feature status and regional eligibility against current Microsoft documentation and your account team.
  3. Test whether prompts, embeddings, retrieval indexes, logs and administrative telemetry stay inside the required boundary.
  4. Run a controlled connectivity-loss test instead of assuming that a local deployment means fully offline operation.
  5. Document who maintains the hardware, model updates, security patches, key custody and recovery procedures.

A separate example is coding assistance: GitHub documents a Copilot CLI offline mode with a locally configured model, but that does not establish that all Copilot interfaces or cloud-agent features run offline. Likewise, a sovereign deployment option does not by itself certify a workload for every jurisdiction. Evaluate the precise service and operating model before making a compliance claim.

Questions people ask

FAQ

Questions people ask

Can Microsoft Foundry Local keep AI prompts and enterprise documents on-premises?

Yes, Foundry Local on Azure Local is designed to run model inference on customer-operated infrastructure, and its agentic retrieval components can process and search local enterprise data within network boundaries. That does not automatically mean every supporting operation is offline: verify Azure Arc, registration, management connectivity, model delivery and logging requirements for the exact deployment. Microsoft Learn still describes some components as preview.

Is Foundry Local on Azure Local generally available after Microsoft's October 20 announcement?

Not necessarily. Microsoft's October 20, 2026 announcement says Foundry Local on Azure Local will become generally available at Microsoft Ignite, rather than stating it is universally available immediately. The current Azure Local technical overview still marks Foundry Local and agentic retrieval as preview. Check the service's updated release notes, your region and subscription eligibility before committing a production timeline.

What is the difference between Sovereign Public Cloud and Sovereign Private Cloud for AI?

Sovereign Public Cloud uses Microsoft-operated Azure infrastructure with additional controls for residency, confidentiality, operator access and governance visibility. Sovereign Private Cloud runs selected cloud and AI capabilities in customer-controlled or partner-operated environments, including disconnected scenarios. Neither model automatically satisfies every legal requirement. Choose by workload sensitivity, required operational independence, jurisdiction, available services and who must control the underlying systems.

Can GitHub Copilot work without an internet connection using a local model?

GitHub documents an offline mode for Copilot CLI when configured with a compatible local model: setting COPILOT_OFFLINE=true prevents the CLI from contacting GitHub servers, and the CLI communicates with the configured provider. This is a specific Copilot CLI capability, not evidence that every GitHub Copilot interface works offline. Microsoft separately plans GitHub Enterprise Local availability at Ignite; check that product's scope independently.

Bottom line

Microsoft's sovereign AI story is about choosing where AI runs and who controls operations, not declaring the entire AI stack offline or generally available. Start with the workload boundary, verify each component's release status, and test the real operational failure modes before rollout.

Explore related Make Better resources

Sources & useful resources