Postmortem -
Read details
Dec 5, 09:20 CET
Resolved -
This incident has been resolved.
Dec 3, 10:46 CET
Update -
The system has returned to normal, and downloads are being processed at regular speeds. Backfill jobs are expected to run later today.
Dec 3, 10:27 CET
Update -
The key status indicators and quota levels for Facebook Ads continue to look very strong. As a result, we’ve now restored the full two-year lookback window for new data sources. This means any newly connected source will receive the full two years of historical data, just like before, rather than the limited lookback windows (30 to 180 days) we had in place last week.
Additionally, data refresh intervals have returned to normal. While backfills are not yet enabled as we continue to monitor the situation closely, we are confident they will be allowed soon. We will update you here on the Status page as soon as backfills become available. Thank you for your patience and understanding.
Dec 2, 10:59 CET
Update -
We’re happy to report continued progress in stabilizing the Facebook connector. Gradual improvements are being made, allowing us to refresh more historical data for more customers.
Throughout the day, we will carefully expand access to additional data while closely monitoring system performance.
Thank you for your patience as we work toward fully resolving this issue. Your understanding means a lot to us.
Nov 29, 09:23 CET
Update -
The positive trends in Facebook quota usage continue, allowing us to refresh more data for longer periods across an increasing number of customers. We’re proceeding cautiously to ensure stability as we scale up.
If the system remains stable tomorrow, we plan to further increase the lookback period. Thank you for your patience as we work to fully restore and optimize the service.
Nov 28, 16:20 CET
Update -
We’re pleased to share that significant improvements were implemented yesterday, and we’ve observed that quota levels have returned to normal. This progress allows us to gradually start resuming normal operations.
Here’s what to expect:
• Historical Data Recovery: We’ll begin gradually recovering historical data. However, please note that backfills are not
yet possible at this stage.
• Data Source Creation: Creating new data sources should now take the usual amount of time.
We’ll continue monitoring the situation and keep you updated on any further developments. Thank you for your patience as we work to restore full functionality!
Nov 28, 09:56 CET
Update -
We are seeing progress:
• The number of active jobs is decreasing.
• The volume of rescheduled jobs is also declining.
While these trends are positive, we acknowledge that there is more work to be done. We understand the importance of having the tool fully operational during this critical time of year and are conducting around-the-clock testing to resolve the issue as quickly as possible.
We appreciate your patience and will provide further updates as developments occur.
Nov 27, 15:54 CET
Update -
We are closely monitoring the situation and working towards a resolution.
Currently, customers may experience longer wait times when connecting a new data source. Additionally, the data refresh function is temporarily limited to 30 days, and updates may take longer than usual to process.
Please note that backfills are temporarily unavailable for Meta products at this time. We appreciate your understanding and patience.
Nov 27, 09:19 CET
Update -
We are seeing positive progress, with some sources beginning to complete downloads again, indicating that the situation is improving. To support recovery, we have temporarily limited historical data downloads, which has already led to a noticeable reduction in impacted sources. While we cannot provide a clear timeline yet, we are closely monitoring the situation and remain focused on resolving the issue. Thank you for your understanding.
Nov 26, 15:38 CET
Update -
We are making progress on resolving the Facebook Quota issues and are seeing positive trends; however, it will take some additional time for the situation to fully stabilize.
Nov 26, 09:43 CET
Update -
Unfortunately we're still experiencing delays due to our quota from Facebook.
Things are trending in the right direction but it will take a few more days to reach normal levels.
Nov 25, 10:53 CET
Update -
See previous message.
Nov 22, 18:00 CET
Update -
We are still seeing some delays but with a continued trend in the right direction. We expect things to get better throughout the day and to fully recover when things calm down during the weekend. By Monday we expect things to be back to normal. We will post another update on Monday to confirm.
Next week we will also start testing a solution in our underlying infrastructure that we hope will prevent this issue from happening again.
Nov 22, 17:59 CET
Update -
It looks like our change has started to take effect, but we expect the delays to continue throughout at least today as well.
Nov 21, 08:49 CET
Monitoring -
We have released a change that we hope will start to remediate this issue.
Unfortunately it will take some time to start showing results and we expect the job delays to continue throughout the day.
We are monitoring the effects of our change and will update as soon as we have news.
Nov 20, 10:20 CET
Identified -
We are currently encountering limitations due to Facebook API quotas. This may result in temporary delays or reduced functionality as we approach or exceed usage thresholds.
Our team is actively monitoring usage and working to minimize disruptions. We appreciate your understanding and patience as we work within these limits.
We will provide daily updates as we work to resolve this issue.
Nov 20, 09:14 CET
