Fivetran: Netsuite syncs are delayed
Incident
Report for Fivetran
Resolved
This incident has been resolved. We have observed that instance rates are returning to normal levels and affected connectors are syncing successfully.
Monitoring
After further discussions and investigations with Netsuite's team, we were able to narrow down the issue to the cloud provider on which the jobs were hosted. We have implemented a fix for the same and started a new sync for it to take effect. We are actively monitoring the affected connectors to understand if it has helped.
Update
We are continuing to work closely with Netsuite via defect #736104 related to this issue. The root cause has not been identified yet, but they have assured us that they are continuing their investigation.
Update
Netsuite has not been able to identify the root cause of the long-running queries but was finally able to reproduce the behavior internally. They informed us that they have a team of people who have been working on this specific issue over the last two weeks and will continue to do so until resolution.
We are continuing to work with their team.
We are continuing to work with their team.
Update
Netsuite is continuing to work on defect #736104 related to this issue. We will continue to follow up until the issue is resolved.
Update
Netsuite is continuing to work on this issue. We have requested another update from them.
Update
Netsuite is continuing to work on this issue. We have requested another update from them.
Update
Netsuite is continuing to work on this issue and we have followed up for an update with them.
Update
The query timeouts for the affected connectors as a temporary workaround have been deployed as of 7 AM UTC this morning.
Netsuite has assured us that they are still working on this defect #736104.
Netsuite has assured us that they are still working on this defect #736104.
Update
We are continuing to work on a fix for this issue.
Update
We have implemented query timeouts for the affected connectors as a temporary workaround. This timeout will throw a task if a specific SQL query does not receive a response from Netsuite on the Fivetran dashboard and will terminate the ongoing sync instead of running continuously for 24 hours.
Netsuite is still working on this defect #736104 and we are continuing to share the requested information with them in order for them to resolve this on their side ASAP.
Netsuite is still working on this defect #736104 and we are continuing to share the requested information with them in order for them to resolve this on their side ASAP.
Update
We are actively monitoring for updates from the Netsuite Support Ticket #736104.
To implement an interim solution from the Fivetran side, we are trying different mechanisms to add timeouts for the queries from our side to stop the syncs from getting stuck.
To implement an interim solution from the Fivetran side, we are trying different mechanisms to add timeouts for the queries from our side to stop the syncs from getting stuck.
Update
Netsuite's QA engineering team is continuing to investigate defect #736104 with a high priority and we will continue to provide regular updates shared by their team.
Update
We are continuing to work with Netsuite on this issue and have their QA team looking into this. We have also requested this to be further escalated with Netsuite and will regularly share updates.
Update
On September 12th, we identified that some Netsuite syncs were getting stuck and terminating after 24 hours. We raised an issue with Netsuite. Netsuite conducted an investigation and filed an internal defect with an urgency level of U3. We will continue to liaise with them and do what we can to assist with getting this issue resolved.
Identified
The issue has been identified and we are working to resolve it.
This incident affected: Finance connectors (NetSuite SuiteAnalytics).