Telstra outage caused by system reset to 2006
Translated from English, summarized and contextualized by DistantNews.
At a glance
- A national Telstra outage was caused by a maintenance error that reset system clocks back two decades, to 2006.
- The telco's submission to a Senate inquiry revealed the error stemmed from an undocumented design change and a missed software update.
- Telstra acknowledged accountability for the failure, which disrupted emergency services and business, and is facing potential fines and compensation claims.
A critical national Telstra outage last week, which disrupted emergency services and businesses, was triggered by a maintenance procedure that inadvertently sent system clocks back two decades. Telstra revealed in a submission to a Senate inquiry that the incident occurred after a team followed documented procedures, but an underlying software configuration caused a key device's date to reset to 2006 upon restart.
The NTP server in Exhibition St had an underlying software configuration, such that when the device restarted, it reset the date to 2006.
The telco explained that this happened because of an intentional design change made to fix an earlier fault, which had not been properly documented. Consequently, the maintenance team was unaware of how the device would behave when restarted, and a crucial software update had also not been applied. Telstra stated that if the software update had been completed or the design change properly documented, the outage might have been avoided.
We take trust in Triple Zero extremely seriously.
Telstra's submission acknowledged the severity of the incident, admitting that if maintenance work can cause such widespread disruption, their controls were insufficient. Chief executive Vicki Brady has apologized for the failure to ensure calls to Triple Zero (000) were immediately answered and transferred. The company is now facing potential millions in fines and hundreds of millions in compensation claims as it reviews the incident to improve its controls and prevent future occurrences.
If maintenance work can trigger this kind of outage, it suggests our controls were not good enough.
Originally published by ABC Australia in English. Translated, summarized, and contextualized by our editorial team with added local perspective. Read our editorial standards.