This issue has been resolved.
Our engineering team has been working closely with the datacenter provider to correct this routing issue as quickly as possible. At this time, the issue is resolved, and all sites should be available from all locations.
This was a limited routing issue that affected a small subset of customers. We do apologize for the inconvenience.
Again, all sites were broadcasting as normal throughout the routing issue. However, whether you were able to see a site as up or not may have depended on your physical location, your “internet distance,” and who your Internet Service Provider is. All sites are safe, and at no time was any data compromised.
The engineering team will analyze the information and logs from this event, and we will publish a full incident report on Monday.
If you are still having any issues inconsistent with this information, please contact our support team, and we will be happy to assist you.
Original post below:
We are aware of a networking issue that began in the early morning hours of Saturday, June 7, that is affecting some customers. We apologize for the inconvenience.
Our monitoring software alerted us to a routing issue in the system, and our support engineers quickly dove into the problem. The engineering team has been assessing the situation, and are working closely with our datacenter provider to resolve this issue in a timely manner.
The datacenter provider at one of our datacenters was installing new next generation network equipment in the middle of the night. This was a scheduled maintenance upgrade, as the datacenter is in the process of installing new core networking infrastructure upgrades. This is a normal part of the hardware refresh cycle for routine datacenter maintenance.
We have determined that during this upgrade process, a routing issue occurred on the back-end which is impacting in
bound navigation; particularly if you got up this morning and wanted to work on your site, do a little development work, or maybe post some new content. But this is only on the inbound routing.
Whether you see a site as up or not may depend on your physical location, your “internet distance,” and who your Internet Service Provider is.
All websites are still broadcasting as normal. Your customers are still able to access your site as normal. All sites are up, and no data has been compromised.
We apologize for the inconvenience. Redundancies in our network architecture are keeping the issue impact to a minimum. Again, your site is still broadcasting, and all data is secure.
Our engineering team was immediately on top of the problem as soon as it occurred, and they are working closely with the datacenter provider to correct this routing issue as quickly as possible.