On November 4, between approximately 15:02 and 15:13 UTC (10:02–10:13 a.m. EST), a network outage at our infrastructure provider, Hetzner, disrupted Crowdcast’s live streaming service for approximately 11 minutes.
The outage interrupted five active broadcasts, causing viewers to lose audio and video. It also prevented the affected broadcasts’ recordings from uploading normally. Although the network recovered after approximately 11 minutes, interrupted broadcasts did not automatically resume, and some hosts needed to restart their sessions.
Our investigation identified a failure in the provider’s private network, which connects our streaming infrastructure. We are still investigating the underlying cause. Our team is also working to recover recordings from backup footage; recovery and recording quality are not yet confirmed.
We are reviewing the incident and the infrastructure changes needed to reduce the impact of similar failures.
We’re sorry for the disruption this caused hosts, speakers, and attendees. We know how much preparation goes into a live event and how disruptive an interruption can be.
No components marked as affected
Resolved
On November 4, between approximately 15:02 and 15:13 UTC (10:02–10:13 a.m. EST), a network outage at our infrastructure provider, Hetzner, disrupted Crowdcast’s live streaming service for approximately 11 minutes.
The outage interrupted five active broadcasts, causing viewers to lose audio and video. It also prevented the affected broadcasts’ recordings from uploading normally. Although the network recovered after approximately 11 minutes, interrupted broadcasts did not automatically resume, and some hosts needed to restart their sessions.
Our investigation identified a failure in the provider’s private network, which connects our streaming infrastructure. We are still investigating the underlying cause. Our team is also working to recover recordings from backup footage; recovery and recording quality are not yet confirmed.
We are reviewing the incident and the infrastructure changes needed to reduce the impact of similar failures.
We’re sorry for the disruption this caused hosts, speakers, and attendees. We know how much preparation goes into a live event and how disruptive an interruption can be.
