Scala Studios - Notice history

All systems operational

Website - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

Jetbrains Hub Service - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

Jetbrains TeamCity Service - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

Jetbrains YouTrack Service - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

jFrog Artifactory Service - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

Grafana - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

Sentry Services - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

Pterodactyl Panel - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

CHI-D-01 - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

CH-VM-01 - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

CH-VM-02 - Operational

99% - uptime
Feb 2025 · 97.16%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 202597.16% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

NC-VM-01 - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025100.0% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

NC-VM-02 - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025100.0% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

CH-NODE-1 - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025100.0% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

CH-NODE-2 - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025100.0% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

NC-NODE-1 - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025100.0% uptime
Mar 2025100.0% uptime
Apr 2025100.0% uptime

Third Party: Discord → API - Operational

Third Party: Path → North America → Chicago, United States - Operational

Third Party: Path → API - Operational

Third Party: Path → Remote DDOS Protection - Operational

Third Party: Path → WAF - Operational

Notice history

Apr 2025

No notices reported this month

Mar 2025

No notices reported this month

Feb 2025

Onsite DDoS Protection Development - More Progress
Scheduled for February 25, 2025 at 3:00 PM – 7:00 PM about 4 hours
  • Update
    February 25, 2025 at 10:46 PM
    In progress
    February 25, 2025 at 10:46 PM

    We have completed maintenance for today, this extension saw no external loss to production switches. We have made a lot of real, meaningful progress today. We are around the home stretch now, simply a few things to tidy up before we push more live traffic to onsite!

    We will be continuing our work again tomorrow at 9:00 AM Central to avoid any potential interruptions during peak hours.

  • In progress
    February 25, 2025 at 9:07 PM
    In progress
    February 25, 2025 at 9:07 PM

    Hello everyone, apologies for the short notice but we will be extending the previous maintenance for a few more hours.

    Why? Because today we’ve made some crazy good progress, and we think onsite can realistically be done very soon. We everything is online we even have some live traffic being pushed to it.

    To iterate again, this will be the solution for us to attempt to seamlessly move traffic from the global upstream to our localized mitigation stack when they have issues. Effectively keeping uptime with as little to no drops as possible.Thank you for bearing with us, we will send out some cool pictures soon

  • Completed
    February 25, 2025 at 7:00 PM
    Completed
    February 25, 2025 at 7:00 PM
    Maintenance has completed successfully
  • In progress
    February 25, 2025 at 3:00 PM
    In progress
    February 25, 2025 at 3:00 PM
    Maintenance is now in progress
  • Planned
    February 25, 2025 at 3:00 PM
    Planned
    February 25, 2025 at 3:00 PM

    At specifically 9AM Central Time we will be continuing development with our onsite network. We apologize for any interruptions this may cause, we are doing this early in the AM to ensure we impact as little traffic as possible.

    We understand the frequent issues from upstream isn't making this an easy pill to swallow, but we must continue work on this to ensure we are independent from future network issues once Onsite goes live.

    To give context on what onsite will bring for those who may have missed it:

    Onsite DDoS Protection will allow us to have a localized Path environment that will be isolated from the global network. This will allow us to attempt to seamlessly, without dropping traffic move between the global network and local network when needed.

    Take for example the issues that we have been facing now, these are all from the global network with Onsite we would be-able to push traffic onto our local mitigation stack, effectively isolating us from global network issues, ensuring full uptime. This also works in reverse, if the local network was to go offline for some reason, we would route back onto the global network, while again attempting to not drop any traffic.

    This system is extremely complex, and has been under development for a while now, we are speeding up progress but also doing so at the least impactful times, we understand no downtime is ideal, however this must be done in order to ensure we have a fully redundant network. I am sure everyone is tired of these upstream issues, we are too, and we truly believe onsite is the solution we are all looking for.

Path-Routed Services - Packet Loss
  • Resolved
    Resolved

    Path's Frankfurt is now fully online.

  • Update
    Update

    Path will be pushing Frankfurt back online soon. Traffic will rebalance once this PoP is placed into production.

  • Monitoring
    Monitoring

    We are currently moving over a Prefix in our London location to another provider, you may notice a slight drop

  • Update
    Update

    We are currently moving over a Prefix in our London location to another provider, you may notice a slight drop.

  • Identified
    Identified

    Path is about to bring up their Miami PoP, they are waiting for their ISP. This will add extra capacity which is very much needed. We are also going to be load balancing our traffic between both providers shortly.

  • Monitoring
    Monitoring

    We will be re-routing traffic to a more stable upstream very soon. Within the next 10 to 20 minutes you may notice a drop as we migrate live traffic onto a more reliable provider.Apologies once again for the issues, we are working swiftly to resolve all of this.

  • Identified
    Identified

    We have confirmed that our upstream provider is experiencing heavy packet loss and they are investigating.

Partial Deployment of On-Site DDoS Protection
  • Completed
    February 19, 2025 at 10:02 PM
    Completed
    February 19, 2025 at 10:02 PM

    Maintenance has completed successfully

  • Update
    February 19, 2025 at 8:16 PM
    In progress
    February 19, 2025 at 8:16 PM

    We are moving some internal traffic within the next 10 minutes. Please note that there is a possibility for disruptions to occur.

  • In progress
    February 19, 2025 at 8:16 PM
    In progress
    February 19, 2025 at 8:16 PM

    Maintenance is now in progress

  • Planned
    February 19, 2025 at 8:14 PM
    Planned
    February 19, 2025 at 8:14 PM

    After the successful testing of our on-site DDoS protection into our network core in the last maintenance, we are moving onto stage 3, which is the beginning of moving production traffic to the protection appliances. We are keeping production traffic to a minimum to ensure no adverse effects in the initial rollout. Over the next few days, we will be shifting more traffic over the appliances. Later communications will be provided when this occurs.


    To minimize disruptions, we’ve scheduled the partial deployment during non-peak hours. While brief traffic blips are possible, we’re taking all necessary precautions to limit such disruptions.

Path-Routed Services - Chicago PoP Migration
Scheduled for February 18, 2025 at 8:27 PM – February 21, 2025 at 7:27 PM 3 days
  • Planned
    February 18, 2025 at 8:27 PM
    Planned
    February 18, 2025 at 8:27 PM

    One of our upstream providers, Path, is actively restoring their Chicago PoP, and we expect minimal disruptions throughout the process. The only potential brief interruption will occur during the final activation phase when traffic is routed back through Chicago.

    We are expecting updates as work continues, this will be the last PoP that needs to be migrated in the US until Phoenix, however Phoenix is TBD and is not expected to be migrated for a while.

    Once live, we will transition away from Kansas City (KC), and latency should begin to normalize.

Path-Routed Services - Infrequent TCP Issues
  • Update
    Update

    Path-routed services have completed their maintenance. Our team is actively monitoring for any latency issues and ensuring system stability. We remain hopeful for smooth performance and will provide further updates as needed. Thank you for your patience.

  • Resolved
    Resolved

    Our monitoring systems have detected TCP issues on Path-routed services. We have been in contact with them regarding the ongoing issues. Our team is continuing to monitor and will provide updates as needed. We apologize for the inconvenience.

Feb 2025 to Apr 2025

Next