Thursday, January 14th, 23:30 - Friday, January 14th, 06:00 PST
During the time period above, some files uploaded to Sauce Storage became corrupted, making them unusable for testing.
A version update to a third party library used by our app storage service introduced a race condition where under some circumstances files were not uploaded properly even after returning a success message.
The App Storage Service deployment was reverted to an earlier version containing the older snapshot of the third party library component. Any affected files uploaded during the time period above need to be re-uploaded.
We improved the alerting notifications to expose more warnings to be able to detect potential problems faster in our staging environment before hitting production.