Scala Studios - Path-Routed Services - Packet Loss – Incident details

All systems operational

Path-Routed Services - Packet Loss

Resolved
Major outage
Started over 1 year agoLasted about 19 hours

Affected

Website

Major outage from 10:12 PM to 5:16 PM

Jetbrains Hub Service

Major outage from 10:12 PM to 5:16 PM

Jetbrains TeamCity Service

Major outage from 10:12 PM to 5:16 PM

Jetbrains YouTrack Service

Major outage from 10:12 PM to 5:16 PM

jFrog Artifactory Service

Major outage from 10:12 PM to 5:16 PM

Grafana

Major outage from 10:12 PM to 5:16 PM

Updates
  • Resolved
    UTC
    Resolved

    Path's Frankfurt is now fully online.

  • Update
    UTC
    Update

    Path will be pushing Frankfurt back online soon. Traffic will rebalance once this PoP is placed into production.

  • Monitoring
    UTC
    Monitoring

    We are currently moving over a Prefix in our London location to another provider, you may notice a slight drop

  • Update
    UTC
    Update

    We are currently moving over a Prefix in our London location to another provider, you may notice a slight drop.

  • Identified
    UTC
    Identified

    Path is about to bring up their Miami PoP, they are waiting for their ISP. This will add extra capacity which is very much needed. We are also going to be load balancing our traffic between both providers shortly.

  • Monitoring
    UTC
    Monitoring

    We will be re-routing traffic to a more stable upstream very soon. Within the next 10 to 20 minutes you may notice a drop as we migrate live traffic onto a more reliable provider.Apologies once again for the issues, we are working swiftly to resolve all of this.

  • Identified
    UTC
    Identified

    We have confirmed that our upstream provider is experiencing heavy packet loss and they are investigating.