Scala Studios - Path-Routed Services - Packet Loss – Incident details

Path-Routed Services - Packet Loss

Resolved
Major outage
Started 3 months agoLasted about 19 hours

Affected

Website

Major outage from 10:12 PM to 5:16 PM

Jetbrains Hub Service

Major outage from 10:12 PM to 5:16 PM

Jetbrains TeamCity Service

Major outage from 10:12 PM to 5:16 PM

Jetbrains YouTrack Service

Major outage from 10:12 PM to 5:16 PM

jFrog Artifactory Service

Major outage from 10:12 PM to 5:16 PM

Grafana

Major outage from 10:12 PM to 5:16 PM

Updates
  • Resolved
    Resolved

    Path's Frankfurt is now fully online.

  • Update
    Update

    Path will be pushing Frankfurt back online soon. Traffic will rebalance once this PoP is placed into production.

  • Monitoring
    Monitoring

    We are currently moving over a Prefix in our London location to another provider, you may notice a slight drop

  • Update
    Update

    We are currently moving over a Prefix in our London location to another provider, you may notice a slight drop.

  • Identified
    Identified

    Path is about to bring up their Miami PoP, they are waiting for their ISP. This will add extra capacity which is very much needed. We are also going to be load balancing our traffic between both providers shortly.

  • Monitoring
    Monitoring

    We will be re-routing traffic to a more stable upstream very soon. Within the next 10 to 20 minutes you may notice a drop as we migrate live traffic onto a more reliable provider.Apologies once again for the issues, we are working swiftly to resolve all of this.

  • Identified
    Identified

    We have confirmed that our upstream provider is experiencing heavy packet loss and they are investigating.