ERI-SUPPORT-1000: Webshop orders fail with HTTP 503 and are very slow
Details
Status
IN PROGRESS
Severity
medium
Affected system
order-api
Created
Last updated
Description
Since about 09:10 customers get HTTP 503 errors when they place an order in the webshop, and the checkout takes over 30 seconds. It started shortly after this morning's release of the Order API.
Updates
Ticketing Tool
Ticket logged
Orchestrator
Resolution plan created: Customers get HTTP 503 errors and a slow checkout on order-api (severity medium) since a release this morning. A configuration or capacity change in that release is the likely cause. Establish the cause from logs and metrics, find the approved fix, and propose three reversible changes, one per Action Agent: roll back, scale up, restart.
Orchestrator
Perception: release 2.14.3 (09:05) reduced db.pool.maxSize from 50 to 10; pool is exhausted (10/10), causing 30s timeouts and HTTP 503 (error rate 18.2%, p95 4200 ms). Confidence high.
Orchestrator
Knowledge: RB-114 and INC-20418 recommend rolling back the release that changed the pool size; restart only if connections stay blocked after rollback. Next: three proposals (rollback, scale up, restart), none executed.
