{"page":{"id":"pg_hostsrc","name":"hostsrc","url":"https://status.hostsrc.com","time_zone":"Europe/Bucharest","updated_at":"2026-10-17T23:22:11.697Z"},"incidents":[{"id":"evt_lim_outage_2026_10_13","name":"Outage on LIM4 and LIM1 game servers","status":"resolved","created_at":"2026-10-13T20:39:23.000Z","updated_at":"2026-10-15T12:00:00.000Z","monitoring_at":"2026-10-13T22:33:21.000Z","resolved_at":"2026-10-13T22:54:00.000Z","impact":"major","shortlink":"https://status.hostsrc.com/incidents/evt_lim_outage_2026_10_13","started_at":"2026-10-13T20:39:23.000Z","page_id":"pg_hostsrc","incident_updates":[{"id":"upd_lim_outage_2026_10_13_7","status":"resolved","body":"Post-incident summary. On 13 October at 20:39 UTC (23:39 Romania time), an old admin login belonging to a former team member, which we had not removed, was used to shut down LIM1 and LIM4. At 20:53 UTC the same login was used to delete the system configuration on LIM4, so it could not start again. Nobody broke in from outside, and no customer files, game saves or databases were lost.\n\nDowntime: game servers and databases on LIM4 were down for 1h46m in total (20:39 to 20:46 and 20:53 to 22:33 UTC). Game servers reached through a dedicated IP on LIM4 were down for 2h07m (until 22:54 UTC), and FastDL for 1h50m. Game servers on LIM1 were down for 20 minutes in total (20:39 to 20:46 and 21:31 to 21:44 UTC).\n\nWhat we changed: all access held by former team members has been removed from every server, and the shared admin account is locked. Admin logins are key-only and tied to one person each, root passwords have been changed, and the addresses involved are blocked. We're also adding nightly backups of each server's system configuration, permanent alerts on unexpected logins, and VPN-only admin access.","incident_id":"evt_lim_outage_2026_10_13","created_at":"2026-10-15T12:00:00.000Z","updated_at":"2026-10-15T12:00:00.000Z","display_at":"2026-10-15T12:00:00.000Z","affected_components":null,"deliver_notifications":false,"custom_tweet":null,"tweet_id":null},{"id":"upd_lim_outage_2026_10_13_6","status":"resolved","body":"Game servers reached through a dedicated IP on LIM4 are reachable again. All services on LIM4 and LIM1 are restored.","incident_id":"evt_lim_outage_2026_10_13","created_at":"2026-10-13T22:54:00.000Z","updated_at":"2026-10-13T22:54:00.000Z","display_at":"2026-10-13T22:54:00.000Z","affected_components":null,"deliver_notifications":false,"custom_tweet":null,"tweet_id":null},{"id":"upd_lim_outage_2026_10_13_5","status":"monitoring","body":"LIM4 is back online. All game servers and their databases are running again, and FastDL followed at 22:37 UTC. Game servers reached through a dedicated IP on LIM4 are still unreachable while we restore their forwarding.","incident_id":"evt_lim_outage_2026_10_13","created_at":"2026-10-13T22:33:21.000Z","updated_at":"2026-10-13T22:33:21.000Z","display_at":"2026-10-13T22:33:21.000Z","affected_components":null,"deliver_notifications":false,"custom_tweet":null,"tweet_id":null},{"id":"upd_lim_outage_2026_10_13_4","status":"identified","body":"LIM1 is back online and its game servers are running. Work on LIM4 continues.","incident_id":"evt_lim_outage_2026_10_13","created_at":"2026-10-13T21:44:18.000Z","updated_at":"2026-10-13T21:44:18.000Z","display_at":"2026-10-13T21:44:18.000Z","affected_components":null,"deliver_notifications":false,"custom_tweet":null,"tweet_id":null},{"id":"upd_lim_outage_2026_10_13_3","status":"identified","body":"We are restarting LIM1 into rescue mode to remove the old access. Its game servers will be offline for about 15 minutes.","incident_id":"evt_lim_outage_2026_10_13","created_at":"2026-10-13T21:31:07.000Z","updated_at":"2026-10-13T21:31:07.000Z","display_at":"2026-10-13T21:31:07.000Z","affected_components":null,"deliver_notifications":false,"custom_tweet":null,"tweet_id":null},{"id":"upd_lim_outage_2026_10_13_2","status":"identified","body":"Both servers were shut down using an old admin login that should have been removed. LIM1 has been back since 20:46 UTC. LIM4 went down again at 20:53 UTC and cannot start, because its system configuration was deleted. We are rebuilding it from rescue mode. Customer files, game saves and databases on LIM4 are intact.","incident_id":"evt_lim_outage_2026_10_13","created_at":"2026-10-13T21:00:00.000Z","updated_at":"2026-10-13T21:00:00.000Z","display_at":"2026-10-13T21:00:00.000Z","affected_components":null,"deliver_notifications":false,"custom_tweet":null,"tweet_id":null},{"id":"upd_lim_outage_2026_10_13_1","status":"investigating","body":"LIM1 and LIM4 went offline at 20:39 UTC. Game servers on both servers are unreachable. We are investigating.","incident_id":"evt_lim_outage_2026_10_13","created_at":"2026-10-13T20:39:23.000Z","updated_at":"2026-10-13T20:39:23.000Z","display_at":"2026-10-13T20:39:23.000Z","affected_components":null,"deliver_notifications":false,"custom_tweet":null,"tweet_id":null}],"components":[{"id":"cmp_host_lim1","name":"LIM1-5800X","status":"operational","created_at":"2026-10-15T09:00:00.000Z","updated_at":"2026-10-15T09:00:00.000Z","position":2,"description":"OVHcloud dedicated server, Limburg (eu-west-lim).","showcase":true,"start_date":null,"group_id":"grp_hs_infra","page_id":"pg_hostsrc","group":false,"only_show_if_degraded":false},{"id":"cmp_host_lim4","name":"LIM4-5800X","status":"operational","created_at":"2026-10-15T09:00:00.000Z","updated_at":"2026-10-15T09:00:00.000Z","position":4,"description":"OVHcloud dedicated server, Limburg (eu-west-lim).","showcase":true,"start_date":null,"group_id":"grp_hs_infra","page_id":"pg_hostsrc","group":false,"only_show_if_degraded":false}],"reminder_intervals":null}]}