Status
All systems are operational
Planned maintenance
Past incidents and maintenance
-
Nov. 27, 2024
HSM signing interruptions
Temporary HSM network performance degradation led to automatic service restart escalation.
- Delayed signing request processing.
- Possible client-side timeouts concerning hash signing.
- DPoD Cloud HSM and software certificates were not affected.
-
Nov. 6, 2024
GitHub.com integration unavailable
Using the SignPath GitHub Actions submit-signing-request action did not work. (A globally scoped ID value has passed the max-int boundary at GitHub.com.)
-
Oct. 13, 2024
HTTPS gateway maintenance
Planned maintenance for the gateway that handles incoming network traffic.
- During this time range inbound requests may fail, including REST API, Web UI, connectors and and crypto providers.
- Processing of accepted signing requests will not be affected.
-
Sep. 11, 2024
DPoD services unavailable
For customers using Thales DPoD Cloud HSM, completion of signing requests was delayed until after the outage and synchronous hash-based signing failed. (Read more)
-
Aug. 07, 2024
HSM infrastructure maintenance
Planned maintenance for SignPath HSM cluster’s infrastructure.
- Slightly longer processing times for signing requests including hash signing
- Software certificates and Thales DPoD Cloud HSM certificates were not affected
-
Jun. 19, 2024
HSM maintenance
Planned maintenance for SignPath’s HSM cluster.
- Disabled Creating/importing certificates
- Slightly longer processing times for signing requests including hash signing
- Software certificates and Thales DPoD Cloud HSM certificates were not affected
-
Jun. 5, 2024
HSM maintenance
Planned maintenance for SignPath’s HSM cluster.
- Limited certificate management (disabled certificate creation/import), expect slightly longer signing request processing times and hash signing response times.
- Software certificates and Thales DPoD Cloud HSM certificates were not affected.
-
Apr. 23, 2024
DPoD services unavailable
For customers using Thales DPoD Cloud HSM, completion of signing requests was delayed until after the outage and synchronous hash-based signing failed. (Read more)
-
Apr. 18, 2024
DPoD services unavailable
For customers using Thales DPoD Cloud HSM, completion of signing requests was delayed until after the outage and synchronous hash-based signing failed. (Read more)
-
Feb. 24, 2024
Infrastructure problems
One node dealing with certificates on the software key store experienced network problems for signing operations. Signing requests with HSM-based keys were not affected.
-
Feb. 22, 2024
DPoD services unavailable
For customers using Thales DPoD Cloud HSM, completion of signing requests was delayed until after the outage. (Read more)
-
Feb. 19, 2024
DPoD services unreachable
For customers using Thales DPoD Cloud HSM, completion of signing requests was delayed until after the outage. (The origin of the connectivity problems could not be established, additional network probes added.)
-
Feb. 1, 2024
Processing errors
Some signing requests were not processed after an application update.
-
Feb. 1, 2024
DPoD signing errors
Failed signing requests for some customers using dedicated Thales DPoD Cloud HSM instances (DNS issue during DPoD maintenance). (Read more)
-
Jan. 11, 2024
Thales DPoD maintenance windows
For all customers using their own Thales DPoD Cloud HSMs hosted in the EU, signing operations may briefly be interrupted due to maintenance operations by Thales.
-
Nov. 26, 2023
Infrastructure problems
Problems in the database backend caused temporarily outdated lists and reports.
-
Nov. 8, 2023
Problem importing PFX files into the HSM key store
Importing private keys from PFX files into the HSM key store did not work (fixed in release 1.152).
-
Nov. 8, 2023
HSM maintenance
Planned maintenance for SignPath’s HSM cluster.
- Limited certificate management, slightly longer signing request processing times and hash signing response times.
- Software certificates and Thales DPoD Cloud HSM certificates were not affected.
-
Aug. 7, 2023
DNS error
The domain signpath.io was not resolved by our domain registrar’s name servers. Problem detection was delayed as many systems including our monitoring were using cached DNS entries, and support email transmission was affected by the same problem.
-
May 11, 2023
Performance degradation
Performance issues due to a regression caused by a dependency. We noticed performance degradation in queue processing during the following periods:
- May 11 13:00 - 15:36 UTC: 18 min. processing time in the top 95 percentile, some API calls returned HTTP 502 as a side effect
- May 11 17:12 - 18:25 UTC: same processing time, no API errors
- May 12 08:45 - 09:22 UTC: 15 min. processing time in the top 95 percentile, no API errors
As an initial reaction to 1 and 2, we allocated additional computing resources. Once the root cause was identified, we reverted the system to an old version of the component that caused the issue and deployed it as a hotfix.
-
Mar. 12, 2023
Planned maintenance: HSM network reconfiguration
We are reconfiguring the network connection to our HSM cluster for better availability. Operations using HSM keys will fail during this period. Software keys and customers using dedicated DPoD HSM instances are not affected.
-
Mar. 2, 2023
Performance degradation, failed signing requests
A configuration error caused a processing queue buildup from 9:15. The error was resolved by 11:00. By 11:30, the queue was processed completely and operations back to normal. Hash-based signing requests were not affected.
-
Jan. 25, 2023
Intermittent network problems
Due to multi-region network problems in Microsoft Azure (Tracking ID VSG1-B90), a small percentage of signing requests was failing. In most situations, this was mitigated by automated retries. (Read more)
-
Dec. 12, 2022
Infrastructure problems
One node experienced low-level infrastructure problems for signing operations. The issue could not be identified at runtime, so affected signing requests were not retried and failed immediately.
-
Sep. 14, 2022
Processing delays
Due to problems with the timestamp authority, several signing requests had to be rescheduled and completed late.
-
Jul. 21, 2022
Infrastructure issues
Due to outages of Azure SQL in the West Europe region, the web application and REST API were temporarily unavailable.
-
Apr. 6, 2022
Processing delays
Due to problems with the timestamp authority, several signing requests had to be rescheduled and completed late. (Read more)
-
Apr. 4, 2022
Processing delays
Due to problems with the timestamp authority, several signing requests had to be rescheduled and completed late. (Read more)
-
Mar. 31, 2022
Infrastructure issue
Our outbound proxy was temporarily out of service. This resulted in delays for Webhook notifications and signing requests that retrieve artifacts via URL.
-
Mar. 4, 2022
Intermittent infrastructure issues
The Azure Application Gateway was temporarily unavailable several times, but self-healed immediately each time
-
Oct. 16, 2021
Planned maintenance
Due to network configuration changes, HSM-based signing will experience problems. All signing requests will continue processing when network connectivity is restored.
-
Aug. 28, 2021
Planned maintenance
Due to network configuration changes, HSM-based signing will experience intermittent problems. All signing requests will continue processing when network connectivity is restored.
-
Jan. 4, 2021
Planned maintenance to change authentication provider
We are changing our authentication provider to Okta. This is the first of two migration steps.
-
Nov. 18, 2020
Payment provider: Planned maintenance
Our payment provider will do some maintenance, resulting in possible intermittent availability impact to platform services summing 1 hour. Service to existing customers of SignPath.io will not be affected.
-
Nov. 4, 2020
Planned maintenance
Due to a reconfiguration of our internet provider, the processing of HSM-based signing requests and creating/deleting certificates may be temporarily unavailable.
-
Jun. 4, 2020
Planned maintenance
Due to a reconfiguration of our internet provider, the processing of HSM-based signing requests and creating/deleting certificates may be temporarily unavailable.
-
May 23, 2020
Planned maintenance
Due to an upgrade in our networking infrastructure, problems performing operations involving the Hardware Security Module (HSM), such as signing operations or creating new certificates might occur.
-
May 14, 2020
Infrastructure problems during deployment
During the deployment of a new version of SignPath, infrastructure problems arose. The release was rolled back, but some downtime could not be avoided. One of the servers did not start correctly in the process, causing the API to be unavailable for certain customers.
-
May 9, 2020
Planned maintenance
Due to an upgrade in our networking infrastructure, problems performing operations involving the Hardware Security Module (HSM), such as signing operations or creating new certificates might occur.
-
Feb. 24, 2020
Planned maintenance
Due to an upgrade in our networking infrastructure, problems performing operations involving the Hardware Security Module (HSM), such as signing operations or creating new certificates might occur.
-
Nov. 7, 2019
Azure outage
Due to a Storage incident in the Azure datacenter in the West Europe regions, our services had several outages.
Note that system updates and SignPath software updates are not listed here unless they may result in more than 5 minutes of downtime. We recommend that you set a retry limit for unavailable service errors of 10 minutes. This is also the default for our PowerShell scripts.