This incident has been resolved. No logs were lost.
Posted Mar 23, 2023 - 20:58 IST
Update
We are continuing to monitor the final lag decreases.
Posted Mar 23, 2023 - 20:20 IST
Monitoring
All lags are reducing, app is fully restored on the final cluster. We are monitoring, and adding resources to help lags decrease more quickly.
Posted Mar 23, 2023 - 19:42 IST
Update
We are continuing to work on the final two clusters, AWS continues to experience issues, we are in communication with them. Most clusters are stable and have their lags resolved.
Posted Mar 23, 2023 - 19:18 IST
Update
Clusters are recovering & lags decreasing, we are working speeding up recovery for the final two clusters. Most customers should be seeing improvements.
Posted Mar 23, 2023 - 18:42 IST
Identified
We have identified the issue stemming from AWS issues and our recovery mechanisms are in progress. Data collection is not impacted, no logs are being lost. We will continue to update.
Posted Mar 23, 2023 - 18:17 IST
Investigating
We are investigating issues some of our logging cluster availability, due to AWS issues. We are working on stability and recovery for the clusters, and will continue to update.
Posted Mar 23, 2023 - 18:05 IST
This incident affected: AWS N. Virginia (us-east-1) (Logs Visualizations and Dashboards).