Fivetran: Delay in MAR populating on usage tab on the dashboard
Incident Report for Fivetran
Resolved
This incident has been resolved. We have observed that MAR is populating correctly again in the Usage Dashboard and the "INCREMENTAL_MAR" table of the Fivetran Platform Connector.

Incident Summary
Description:
We identified an issue for MAR that resulted in MAR not correctly populating the usage Dashboard and the "INCREMENTAL_MAR" table of the Fivetran Platform Connector.

Timeline:
This issue began on Oct 29th at 2024-10-29 05:26 UTC and was resolved on Nov 1st at 15:05 UTC.

Cause:
Queries related to our internal MAR calculations began to sporadically time out. This became more frequent over time, and by October 30, these timeouts were consistent, impacting performance of MAR updating in the Dashboard and Fivetran Platform connector.

Resolution:
A script was used to process the specific queries that were timing out, ensuring all backdated queries were completed by Nov 1st and the MAR that had not been updated had caught up.
Posted Nov 01, 2024 - 17:09 UTC
Monitoring
A fix has been implemented and we are monitoring the results.
Posted Nov 01, 2024 - 16:10 UTC
Update
We are continuing to populate MAR data in the Usage Dashboard. So far, MAR consumed up to 2024-10-31 02:27:30 (UTC) has now been populated.

The Fivetran Platform Connector's "INCREMENTAL_MAR" table will sync the latest available MAR data on subsequent syncs.
Posted Nov 01, 2024 - 10:44 UTC
Update
We are continuing to work on a fix for this issue.
Posted Nov 01, 2024 - 04:59 UTC
Update
We are continuing to work to update MAR up on the usage tab and will provide further updates as we have them.
Posted Oct 31, 2024 - 22:49 UTC
Identified
The issue has been identified and we are working to resolve it.
Posted Oct 31, 2024 - 17:45 UTC
This incident affected: Systems (General Services).