Resolved - All services at our Frankfurt location have remained stable overnight, with no further disruption observed.

The facility operator has confirmed that cooling has now been fully restored across all affected areas, with temperatures remaining stable and within normal operating thresholds. Cooling redundancy has also been restored.

We are therefore marking this incident as resolved.

Monitoring - All infrastructure at our Frankfurt location has now been restored and services are operating normally.

Cloud Servers are back online and our network infrastructure has been fully restored. We are continuing to closely monitor the environment and our systems to ensure stability following the earlier cooling incident.

We apologise for the disruption this incident has caused and would like to thank everyone affected for their patience and understanding while recovery work was carried out.

We will be requesting a full Root Cause Analysis (RFO) from the facility operator to understand the circumstances surrounding the incident and the actions being taken to prevent a recurrence (and will be provided to affected customers upon request).

We will continue monitoring this for around 24 hours before marking this incident as resolved.

Identified - Recovery work has made significant progress at our Frankfurt location. Cloud Servers at this location remain unavailable, while CDN traffic continues to be rerouted to alternative locations.

The facility operator has confirmed that cooling has now been restored across the majority of the data centre, with temperatures returning to normal operational ranges. Additionally cooling redundancy has returned to normal operating levels.

Our equipment remains powered down while we confirm that environmental conditions are suitable for it to be safely brought back online. We are closely monitoring the recovery and will provide a further update as progress is made.

Identified - Three of the facility’s chillers have now been brought back online and temperatures within parts of the data centre have started to decrease. Temporary cooling equipment has also been deployed, with additional units being delivered to assist the recovery.

Engineers continue to investigate the chilled-water system affecting other areas of the facility. Cooling will be restored incrementally as sections of the system are confirmed to be free from further leaks.

Identified - The facility operator is still making progress on this incident with regards to restoring cooling systems at our Frankfurt location. Cloud Servers at this location remain unavailable and CDN traffic continues to be rerouted to alternative locations.

The water leak that occurred in the early hours of this morning has now been fully repaired, however during this original repair, a second leak was identified and has since been isolated while its cause is investigated. Refilling of the chilled-water system is progressing, with one buffer tank now full and the second currently being refilled.

Specialist cooling engineers are onsite and, once the water systems have been refilled, the facility operator plans to restart and test each chiller individually before returning the cooling systems to service. Work to remove water and reduce humidity within affected areas is also continuing.

We are closely monitoring recovery efforts and will provide a further update as progress is made.

Identified - For full transparency, earlier this morning our DC in Frankfurt, Germany had a water leak which affected the cooling systems where our hardware is located. As a precautionary measure of the rising temperatures in the facility, all cloud servers were powered down to protect hardware and equipment from overheating.

The facility operator has identified and isolated the source of the leak and is currently refilling the chilled-water system. Additional equipment has been deployed to accelerate this process, reduce temperature and humidity levels, and remove water from affected areas. Specialist engineers, including the facility's fire protection vendor, are attending the site. We are closely monitoring recovery efforts and will provide further updates as more information becomes available.