Portal and API Service Degradation

Incident Report for emnify

Resolved

This incident has been resolved.
Posted May 13, 2025 - 17:01 UTC

Monitoring

A fix has been implemented and we are monitoring the results.
Posted May 13, 2025 - 16:26 UTC

Update

Dear Customers,

This is to inform you that a fix has been implemented and we are monitoring the results.

Thanks a lot
Emnify Support Team
Posted May 13, 2025 - 16:26 UTC

Update

We are continuing to work on a fix for this issue.
Posted May 13, 2025 - 14:28 UTC

Update

Dear Customers,

We were facing severe performance degradation on our data warehouse, which impacted the Stats API. Today, we executed our disaster recovery procedure and re-created the database cluster. We have started backfilling the data, which will take several hours.

We will continue monitoring the situation closely and will update you once the issue is fully resolved.

We appreciate your understanding and patience.

Best regards
Emnify Support Team
Posted May 13, 2025 - 14:16 UTC

Update

In order to facilitate remediation of the issue, we had to pause processing of data used for reporting.
As a result, devices will not show any recent data consumption, and the Reports section in the Portal might display no data.
Posted May 12, 2025 - 23:07 UTC

Update

Dear Customers,

We are still actively working on resolving the issue impacting the Stats API and we will keep you updated as soon as progress is made.

Thank you for your patience.

Best regards,
Emnify Support Team
Posted May 12, 2025 - 16:26 UTC

Update

Dear Customers,

As we continue to investigate the issue, we are temporarily excluding the data for Cellular usage from the Connected Devices page to ensure the rest of the page remains accessible. This functionality will be restored once the situation is stabilized.

We appreciate your patience and will keep you informed of further updates.

Best regards,
Posted May 12, 2025 - 09:30 UTC

Update

Dear Customers,

We are reaching out to inform you of an ongoing issue with our Stats API, which has been impacting the viewing of device status on the portal. We have identified the cause of the issue, and our engineering team is actively working to resolve it.

Further updates will follow shortly.

Best regards
Emnify Support Team
Posted May 12, 2025 - 08:43 UTC

Identified

Dear Customers,

We have identified the cause of the issue, and our engineering team is actively working to resolve it.

We will continue to keep you updated and notify you as soon as the issue is fully resolved.

Best regards
Emnify Support Team
Posted May 12, 2025 - 08:23 UTC

Investigating

Dear Customers,

We are investigating an increase in errors in our Stats API, which is impacting the viewing of device status on the portal.

Our engineering team is actively working to resolve the issue.

Further updates will follow shortly.

Thank you for your understanding and patience.

Best regards
Emnify Support Team
Posted May 12, 2025 - 08:17 UTC
This incident affected: Portal, API & Data Analytics (API, Data Analytics).