Incident sheet · /enterprise-ai

Filed
Read
2 min · 342 words
Severity
Routine

Windows Server 2028 previews enterprise AI inference on local servers

Microsoft brings AI inference closer to enterprise data with Windows Server 2028
FeedMicrosoft brings AI inference closer to enterprise data with Windows Server 2028 — lecreusois / pixabay

By Daniel Okafor

Windows Server 2028 entered public preview as Microsoft’s largest server-platform update since Windows Server 2025. Microsoft announced the prerelease platform at Microsoft Ignite. The company said the release spans automation, management, identity, security, recovery, storage and virtualization.

Its commercial center is hybrid inference, bringing model execution closer to enterprise-controlled data. Microsoft said the update adds local AI accelerators, accelerated storage transfers, stronger controls and simpler administration.

Features carry different availability and maturity levels. Infotech associate vice president John Annand said much of the roadmap remained a promise.

What changes in Windows Server 2028?

Microsoft positions the release as a foundation for enterprise hybrid intelligence. The company says customers can place inference close to physical operations inside controlled environments.

Windows Server product team leader Neil Hinnant said that design can spare customers the cost of operating a separate AI stack at every location.

  • Microsoft plans an AMD Instinct MI350P preview for the first half of 2027. The card targets supported Windows Server systems, including Server 2028.
  • For each inference environment, Microsoft plans tools that manage AMD hardware, deploy and configure the environment, and route model requests to the appropriate local destination.
  • Microsoft said long-term work will extend Microsoft Foundry into fleets of local token factories. The plan covers open-weight and custom models across Foundry Local, Windows ML, vLLM and Llama.cpp.

“As AI-accelerated workloads diffuse across the enterprise, different workloads have different needs,” Hinnant wrote. “Cost, latency, IP protection, data residency, and regulatory requirements all shape that decision.”

What does the hardened baseline change?

Microsoft said Server Core starts with hundreds of security settings enabled on first boot. The settings align with industry benchmarks.

The hardened configuration reduces the exposure window before administrators secure a newly deployed server, while requiring teams to relax settings only when workloads need them.

  • A containment layer provides isolation. Agent 365 handles agent identity and governance. VM protection builds a chain of trust.
  • Microsoft is investing in automatic certificate management to verify human and machine identities. The company says

via networkworld.com (Original)

Filed under

  • windows-server
  • hybrid-ai
  • local-ai-inference
  • microsoft-foundry
  • ai-security
Share this article:

More from Daniel Okafor

Daniel Okafor

Show full bio

Staff writer covering technology and product news in enterprise information technology and the leaders who run at CIO Monitor.

209 articles

The newsroom digest

One email a day with the stories that matter. No noise.

By subscribing you agree to the privacy policy.

Cross-references

‹ Previous articleNext article ›