Hi everyone,
We had a slowdown of the widget gallery and widget serving this morning, PST.
The trouble started due to record traffic (which is good of
course) causing us to move traffic to a backup database. This would be fine but for some (as yet unknown) reason an employee at our hosting provider, Rackspace, restarted that database. This caused traffic to
back up and we exceeded the capacity of our network hardware. The result was traffic slowed down and
lots of your web pages with widgets were affected.
We are taking the following
actions:
- Quadrupling the capacity of our network hardware.
- Moving synchronously loaded dynamic content to the edge of our deployment, to reduce mid-server latency that causes traffic to back up.
- Investigate the issue further with Rackspace.
- Begin an investigation of using other hosting providers.
We're very sorry for this -- we aim for a much higher standard of service. We know many of you live and die by your web pages and the functionality your widgets bring.
Please let us know if you have any questions or comments.
Comments