Microsoft Traces Global 365 Outage to Dormant July Code Defect
Microsoft revealed that a latent software bug deployed in July caused the recent global Microsoft 365 outage, which was triggered by a combination of high traffic load and reduced server capacity.
🏢Big TechPhoto: thenextweb.com
Key points
- July update defect caused lock contention in internal Windows processes
- Standard load testing missed the bug because it was run on weaker hardware
- Over 80 percent of affected servers became unresponsive at the peak of the outage
Microsoft has traced a major global disruption affecting Microsoft 365 services to a network gateway server update introduced back in July. According to a preliminary post-incident report shared by the company, a hidden code defect remained dormant for over three months before high traffic volume and reduced server capacity caused it to fail.
Executive Vice President Charles Lamanna explained that the July update created lock contention within an internal Windows process under specific load conditions, completely exhausting server CPU and memory. Pre-release testing failed to catch the issue because trials utilized weaker hardware with fewer cores, whereas the flaw manifested more severely on newer, multi-core machines.
The situation escalated when traffic failed over to gateways supporting Exchange Online, compounding a prior capacity drop that had removed nearly 14 percent of the system's servers from service. As individual servers crashed, traffic shifted to remaining healthy units, which quickly succumbed to the same bug and left over 80 percent of servers unresponsive at its peak.
More than 1,000 engineers and staff participated in emergency remediation calls led by Lamanna and cloud chief Scott Guthrie. Microsoft confirmed the incident was unrelated to any cyberattack or artificial intelligence agents, issuing an apology to affected customers, governments, and businesses spanning 74 countries and territories.
What to watch next: Microsoft has stated it will publish its final, comprehensive post-incident report on November 20.
Source thenextweb.com — thenextweb.com/news/microsoft-365-outage-july-defect-post-incident-repo… ↗
Read next
🚀Startups & FundingHarvard Study Reveals US Hyperscale Data Centers Consume Power Rivaling Entire States
A new Harvard study reveals that America's 403 hyperscale data centers consumed between 68 and 99 terawatt-hours of electricity during the 2024-25 study period, rivaling …
🚀Startups & FundingCalifornia Files Lawsuit Against OpenAI Over Autonomous AI Incidents
California Attorney General Rob Bonta has filed a lawsuit against OpenAI, alleging the company failed to control its autonomous AI agents and misled the public about safe…
🧠AI AnalysisPedestal AI Secures Seed Funding to Automate Logistics With Intelligent Agents
Pedestal AI has launched publicly with $4.7 million in seed backing to deploy agentic artificial intelligence aimed at streamlining logistics and supply chain operations.
🌐Work & SocietyUS Southwest Hydropower Output Hits Record Lows Amid Persistent Drought
Hydropower generation in the US Southwest dropped 28% below the 10-year average this summer as record-low water levels in the Colorado River Basin threaten regional energ…
⚖️Regulation & PolicyOpenAI Partners with Chilean Ministry to Advance Public Sector AI
OpenAI has signed a non-binding agreement with Chile's science ministry to integrate artificial intelligence into public administration and support local startups.
🌐Work & SocietyAmbience Healthcare Expands Clinical AI Suite for Hospital Operations
Ambience Healthcare has launched new AI tools designed to assist hospital staff with patient rounding and discharge planning, aiming to improve both clinical efficiency a…