tag:byphone.statuspage.io,2005:/historyByphone Status - Incident History2024-03-03T22:00:56+00:00Byphonetag:byphone.statuspage.io,2005:Incident/201283002024-03-03T22:00:56+00:002024-03-03T22:00:56+00:00Customer Facing Edge Registrar : Resilience tests and minor upgrade<p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>22:00</var> GMT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>18:00</var> GMT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>10:52</var> GMT</small><br><strong>Scheduled</strong> - We will be running a routine resilience test of CPE registration and call routing. We will be using the opportunity to apply some minor upgrades to customer facing Edge services.<br /><br />We will be testing SIP Registrar configuration and customer premises equipment fail-over to ensure that the service is resilient. We will re-route SIP (registration and call setup) and RTP (voice) during the test. This should not cause any changes to behaviour of Customer Premises Equipment (phones), but the customer phones may automatically re-register during this maintenance window. Automatic re-registration should occur within a few minutes.<br /><br />In the unexpected case that any phones become Un-Registered and do not automatically re-register then please reboot the phone. If the phone remain unregistered then please raise a support ticket using the normal process.</p>tag:byphone.statuspage.io,2005:Incident/201317602024-03-02T21:00:56+00:002024-03-02T21:00:56+00:00UI + Gateway Maintenance<p><small>Mar <var data-var='date'> 2</var>, <var data-var='time'>21:00</var> GMT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 2</var>, <var data-var='time'>20:00</var> GMT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>13:53</var> GMT</small><br><strong>Scheduled</strong> - We will be upgrading the app.byphone.co.uk UI, and API during this time, as well as minor changes to one of our SIP Gateways in preparation for further changes later this month.<br /><br />Users should experience no impact to services during this time.</p>tag:byphone.statuspage.io,2005:Incident/196879632024-01-14T19:00:29+00:002024-01-14T19:00:29+00:00Security upgrades on Customer facing Edge Services<p><small>Jan <var data-var='date'>14</var>, <var data-var='time'>19:00</var> GMT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>14</var>, <var data-var='time'>17:00</var> GMT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>12</var>, <var data-var='time'>13:00</var> GMT</small><br><strong>Scheduled</strong> - We will be applying some upgrades to customer facing Edge services:<br /><br />1) We are upgrading the Application Firewall on customer facing load balancer, this will filter connection requests from customers web browsers and softphones to our UI and API servers. This should not cause any changes to observed behaviour but should provide us with better filtering and alerting in future.<br /><br />2) SIP Registrar configuration is being upgraded to allow us to control and re-route SIP (call setup) and RTP (voice) traffic more easily with reduced disruption in future. This should not cause any changes to behaviour od Customer Premises Equipment (phones), but the customer phones may automatically re-register during this maintenance window. Automatic re-registration should occur within a few minutes.<br /><br />In the unexpected case that any phones become Un-Registered and do not automatically re-register then please reboot the phone. If the phone remain unregistered then please raise a support ticket in the normal process.</p>tag:byphone.statuspage.io,2005:Incident/194301942023-12-13T22:00:33+00:002023-12-13T22:00:33+00:00App.Byphone.co.uk UI Maintenance<p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>22:00</var> GMT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>21:00</var> GMT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>18:15</var> GMT</small><br><strong>Scheduled</strong> - We will be upgrading the UI, and API during this time.</p>tag:byphone.statuspage.io,2005:Incident/190448212023-11-07T14:13:51+00:002023-11-07T14:13:51+00:00Issue - Ireland Calling Services<p><small>Nov <var data-var='date'> 7</var>, <var data-var='time'>14:13</var> GMT</small><br><strong>Resolved</strong> - Stability has been confirmed and this incident is now considered resolved.</p><p><small>Nov <var data-var='date'> 7</var>, <var data-var='time'>12:58</var> GMT</small><br><strong>Monitoring</strong> - Update: A fix has been implemented and we are monitoring the results.</p><p><small>Nov <var data-var='date'> 7</var>, <var data-var='time'>11:27</var> GMT</small><br><strong>Identified</strong> - One of our suppliers is experiencing a network impairment in Ireland affecting inbound and outbound traffic. They appear to have identified the issue and are working on a fix.<br />We will update further when we receive any new information.</p>tag:byphone.statuspage.io,2005:Incident/189773872023-11-04T20:24:09+00:002023-11-04T20:24:41+00:00Database Migration<p><small>Nov <var data-var='date'> 4</var>, <var data-var='time'>20:24</var> GMT</small><br><strong>Completed</strong> - Database migration has been completed.<br /><br />Testing finishing up and appear to be no issues currently.<br /><br />Some handsets may require a reboot after a short drop in registration as our registrars moved over to the new database, but the vast majority have done so already.<br />Softphone apps may need accessed to force re-registration.<br /><br />We will continue to monitor over the remainder of the weekend.<br /><br />If you experience any issues after rebooting hardware, please contact our Helpdesk via the link below:<br />https://byphone.atlassian.net/servicedesk/customer/portal/1</p><p><small>Nov <var data-var='date'> 4</var>, <var data-var='time'>17:00</var> GMT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>09:47</var> GMT</small><br><strong>Scheduled</strong> - We will be migrating core database services during this window.<br /><br />Web access to the Byphone application (https://app.byphone.co.uk) will be unavailable during this time preventing system changes.<br />Device registrations may be affected for a short period, though most should recover within 10 minutes. <br />If this is not the case, rebooting the device should resolve. <br />If users continue to experience issues, please raise a ticket via our Helpdesk [https://byphone.atlassian.net/servicedesk/customer/portal/1]<br />Once web access is restored, a browser refresh may be required to re-fetch any cached files.</p>tag:byphone.statuspage.io,2005:Incident/189773602023-11-02T21:00:21+00:002023-11-02T21:00:21+00:00System Maintenance<p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>21:00</var> GMT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>18:00</var> GMT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>09:42</var> GMT</small><br><strong>Scheduled</strong> - We will be making some configuration changes in preparation for a later maintenance window.<br />These changes will not affect the ability to make and receive calls and users should be unimpacted during this window.</p>tag:byphone.statuspage.io,2005:Incident/184795802023-09-12T00:30:00+01:002023-09-12T13:29:03+01:00Lack of Audio affecting some external calls<p><small>Sep <var data-var='date'>12</var>, <var data-var='time'>00:30</var> BST</small><br><strong>Resolved</strong> - Some users experienced issues with silence on external inbound and outbound calls today around 12:30PM.<br />The incident was attributed to an RTP application crash on one of our Gateway servers.<br />Service was restored within 10 minutes and monitoring has confirmed no recurrence.<br />We are investigating why the service did not restart immediately, and will be making changes to ensure that the service can self-heal.<br />We apologise for any inconvenience.</p>tag:byphone.statuspage.io,2005:Incident/179769672023-07-27T16:32:02+01:002023-07-27T16:32:02+01:00Outbound Calling Issue<p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>16:32</var> BST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>16:15</var> BST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>16:13</var> BST</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:byphone.statuspage.io,2005:Incident/176079592023-06-18T07:37:11+01:002023-06-18T07:37:11+01:00SIP Gateway Commissioning Tests<p><small>Jun <var data-var='date'>18</var>, <var data-var='time'>07:37</var> BST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jun <var data-var='date'>18</var>, <var data-var='time'>06:35</var> BST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jun <var data-var='date'>18</var>, <var data-var='time'>06:34</var> BST</small><br><strong>Scheduled</strong> - Further commissioning tests on SIPGW upgrades. Stress testing database and SIP.<br />Some opportunities for improvement with regard to database resource utilisation were identified yesterday morning and patches are being applied and tested this morning.</p>tag:byphone.statuspage.io,2005:Incident/176003072023-06-17T07:03:54+01:002023-06-17T07:03:54+01:00SIP Supplier Gateway upgrade and commissioning tests<p><small>Jun <var data-var='date'>17</var>, <var data-var='time'>07:03</var> BST</small><br><strong>Completed</strong> - The testing has been completed.</p><p><small>Jun <var data-var='date'>17</var>, <var data-var='time'>07:02</var> BST</small><br><strong>Update</strong> - Scheduled maintenance is still in progress. We will provide updates as necessary.</p><p><small>Jun <var data-var='date'>17</var>, <var data-var='time'>06:15</var> BST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jun <var data-var='date'>17</var>, <var data-var='time'>06:13</var> BST</small><br><strong>Scheduled</strong> - Improvements and tests include:<br />Connection and routing to new supplier<br />Improved management stats<br />Customer call limits<br />Logging and Accounting of inbound calls<br />Dialog data replication across the cluster</p>tag:byphone.statuspage.io,2005:Incident/171798962023-05-08T13:14:42+01:002023-05-12T17:45:08+01:00Reports of issues making receiving calls<p><small>May <var data-var='date'> 8</var>, <var data-var='time'>13:14</var> BST</small><br><strong>Resolved</strong> - This incident has been resolved. A post-mortem will be provided in due course.</p><p><small>May <var data-var='date'> 8</var>, <var data-var='time'>12:42</var> BST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>May <var data-var='date'> 8</var>, <var data-var='time'>11:55</var> BST</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:byphone.statuspage.io,2005:Incident/169732062023-04-26T21:30:06+01:002023-04-26T21:30:18+01:00Realtime Balances Updates<p><small>Apr <var data-var='date'>26</var>, <var data-var='time'>21:30</var> BST</small><br><strong>Update</strong> - Maintenance is now complete. All tests confirmed successful and no errors detected.<br /><br />Any user experiencing issues making calls should ensure they have sufficient bundle minutes or International/Premium credit to allow outbound calls before contacting support.</p><p><small>Apr <var data-var='date'>26</var>, <var data-var='time'>21:30</var> BST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Apr <var data-var='date'>26</var>, <var data-var='time'>21:00</var> BST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Apr <var data-var='date'>26</var>, <var data-var='time'>17:03</var> BST</small><br><strong>Scheduled</strong> - Realtime call balances will be re-enabled this evening following recent migration of this service to AWS hosting.<br /><br />Checks have been carried out to ensure organisations have the appropriate balances prior to, and will be tested to confirm expected behaviour during, this window.<br /><br />We forsee no impact to customers services at this stage.</p>tag:byphone.statuspage.io,2005:Incident/166296832023-03-24T14:19:45+00:002023-03-24T14:19:45+00:00Supplier Inbound DDI Issues<p><small>Mar <var data-var='date'>24</var>, <var data-var='time'>14:19</var> GMT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>24</var>, <var data-var='time'>11:56</var> GMT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Mar <var data-var='date'>24</var>, <var data-var='time'>11:03</var> GMT</small><br><strong>Identified</strong> - One of our suppliers is having issues with UK DDIs which will affect a small number of customers.<br />This is being investigated by their NOC team and we will provide updates as soon as possible.<br />Please raise a ticket via our helpdesk if you believe you are affected and our support team will be able to confirm.</p>tag:byphone.statuspage.io,2005:Incident/127321692022-11-06T22:37:10+00:002022-11-06T22:37:10+00:00Call History Database Upgrades<p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>22:37</var> GMT</small><br><strong>Completed</strong> - The scheduled maintenance has concluded for today.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>17:57</var> GMT</small><br><strong>Update</strong> - Scheduled maintenance is still in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>08:00</var> GMT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>07:39</var> GMT</small><br><strong>Scheduled</strong> - We will be migrating, merging, and upgrading database engines and schema during this time.<br /><br />This work will add some database capacity, resilience and allow us to move more of our services onto AWS managed services.</p>tag:byphone.statuspage.io,2005:Incident/122392382022-10-18T10:06:00+01:002022-10-18T10:24:22+01:00Upstream Routing Issue<p><small>Oct <var data-var='date'>18</var>, <var data-var='time'>10:06</var> BST</small><br><strong>Resolved</strong> - Some customer may have experienced issues with inbound/outbound external calls for a short period of time between 10:06 AM and 10:09 AM<br /><br />Initial investigations indicate that this was due to an upstream routing issue (possibly Linx) during that time which caused problems interfacing with suppliers. This appears to have been quickly resolved and Byphone services were running normally thoughout.</p>tag:byphone.statuspage.io,2005:Incident/112330742022-09-25T07:00:30+01:002022-09-25T07:00:30+01:00Planned Maintenance - Registrar Redundancy Upgrade<p><small>Sep <var data-var='date'>25</var>, <var data-var='time'>07:00</var> BST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'>25</var>, <var data-var='time'>05:00</var> BST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>23</var>, <var data-var='time'>12:13</var> BST</small><br><strong>Scheduled</strong> - During this window we will be upgrading Registrar configuration in multiple AWS availability zones. This work will deliver upgrades in the ability to have real-time in-memory replication of user location between AZ's. This improves our ability to transparently and automatically move customer device registrations to different data-centres and removes the current limitation whereby all of a single customer organisation devices register at the same POP to avoid split brain scenarios.<br /><br />In advance of the maintenance window we have reduced DNS TTL of the Registrar Proxy DNS records so that we can manage and test DNS migrations during the window,<br /><br />Some customers may see their devices registering during the window as we test various fail-over scenarios.</p>tag:byphone.statuspage.io,2005:Incident/106685762022-07-25T10:22:06+01:002022-07-25T10:22:06+01:00Third Party Broadband supplier issue<p><small>Jul <var data-var='date'>25</var>, <var data-var='time'>10:22</var> BST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'>22</var>, <var data-var='time'>12:40</var> BST</small><br><strong>Investigating</strong> - We have been made aware of a network issue on a third party broadband supplier that could be affecting some customers Byphone service. This issue is unrelated to Byphone. The suppliers status page below reflects this:<br />https://support.cityfibre.com/networks<br />We would suggest diverts to mobile apps registered via the mobile network or directly to external numbers in the meantime while this issue is ongoing.<br />The Byphone platform itself is unaffected at this time.</p>tag:byphone.statuspage.io,2005:Incident/106219732022-07-18T13:55:05+01:002022-07-18T13:55:05+01:00Registration Issue<p><small>Jul <var data-var='date'>18</var>, <var data-var='time'>13:55</var> BST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'>18</var>, <var data-var='time'>12:56</var> BST</small><br><strong>Update</strong> - Presence server has had more disk space added as well as more RAM. A restart was required to apply this change, and may have caused further disruption with errant BLF keys. Again a handset restart will clear this.</p><p><small>Jul <var data-var='date'>18</var>, <var data-var='time'>11:13</var> BST</small><br><strong>Update</strong> - Presence may have been affected for some users as a result of registration drops. This issue has been cleared on the Presence server and may require a handset reboot to clear any errant keys.</p><p><small>Jul <var data-var='date'>18</var>, <var data-var='time'>10:15</var> BST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jul <var data-var='date'>18</var>, <var data-var='time'>09:30</var> BST</small><br><strong>Investigating</strong> - We have observed further drops in registrations and are continuing to investigate.</p><p><small>Jul <var data-var='date'>18</var>, <var data-var='time'>09:11</var> BST</small><br><strong>Monitoring</strong> - We appear to have had a drop in handset registration. Registrar is back to normal now. We are investigating and monitoring for further drops.</p>tag:byphone.statuspage.io,2005:Incident/106126432022-07-17T23:01:22+01:002022-07-17T23:01:22+01:00Data Center Supplier Maintenance<p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>23:01</var> BST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>18:01</var> BST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>12:17</var> BST</small><br><strong>Scheduled</strong> - Following power issues at one of our Data Centres, one of our suppliers routing-engines failed. Emergency Works is to replace the failed routing-engine and restore redundancy will be carried out by the supplier.<br /><br />We will be re-routing calls via other Data Centres during this window and customers should notice no impact to call services.</p>tag:byphone.statuspage.io,2005:Incident/105902902022-07-17T12:11:44+01:002022-07-17T12:11:44+01:00Registrations Drop<p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>12:11</var> BST</small><br><strong>Resolved</strong> - We have observed no further drops in registration. This issue is marked resolved.</p><p><small>Jul <var data-var='date'>15</var>, <var data-var='time'>10:58</var> BST</small><br><strong>Monitoring</strong> - We appear to have experienced a further drop in registrations, however the Registrar remained accessible throughout, which is different behaviour than previously this week. We are looking into this but in the meantime forcing a re-registration should bring devices back online sooner.</p>tag:byphone.statuspage.io,2005:Incident/105638492022-07-15T09:37:36+01:002022-07-15T09:37:36+01:00Registration Issue<p><small>Jul <var data-var='date'>15</var>, <var data-var='time'>09:37</var> BST</small><br><strong>Resolved</strong> - Capacity added to registrar on Wednesday evening, no widespread drops in device registration caused by the same issue Yesterday (Thursday). This issue is marked as resolved.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>14:07</var> BST</small><br><strong>Update</strong> - Looks like we're had a further brief incident in handset registration. They should come back into service normally, but can force a re-registration to bring back sooner.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>11:57</var> BST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>11:57</var> BST</small><br><strong>Investigating</strong> - We appear to have had a brief drop in registrations on the registrar. It is back up now and we are investigating and monitoring.</p>tag:byphone.statuspage.io,2005:Incident/105524802022-07-13T11:09:54+01:002022-07-13T11:09:54+01:00Registration issue<p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>11:09</var> BST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'>12</var>, <var data-var='time'>16:03</var> BST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Jul <var data-var='date'>12</var>, <var data-var='time'>16:03</var> BST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jul <var data-var='date'>12</var>, <var data-var='time'>15:56</var> BST</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:byphone.statuspage.io,2005:Incident/105345002022-07-11T17:49:48+01:002022-07-21T09:06:29+01:00Call Issues<p><small>Jul <var data-var='date'>11</var>, <var data-var='time'>17:49</var> BST</small><br><strong>Resolved</strong> - Services have been confirmed operational and stable for the past few hours.<br />Some customers may still be experiencing some problems with individual configuration issues, but each of those will be dealt with on an individual basis and are not caused by this incident.<br />Post-mortem to follow in due course. Thank you for your patience and understanding.</p><p><small>Jul <var data-var='date'>11</var>, <var data-var='time'>12:26</var> BST</small><br><strong>Monitoring</strong> - We have added additional resource to our Gateways improving the quality of inbound and outbound external calls, we are continuing to monitor.</p><p><small>Jul <var data-var='date'>11</var>, <var data-var='time'>12:11</var> BST</small><br><strong>Update</strong> - We have seen an improvement in the number of external calls able to connect. We are seeing quality issues due to high call volume. We are continuing to work on improving this issue.</p><p><small>Jul <var data-var='date'>11</var>, <var data-var='time'>11:42</var> BST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue. We will provide a further update as soon as possible.</p><p><small>Jul <var data-var='date'>11</var>, <var data-var='time'>10:38</var> BST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Jul <var data-var='date'>11</var>, <var data-var='time'>09:14</var> BST</small><br><strong>Investigating</strong> - We are aware of some users experiencing issues with inbound and outbound calls this morning and are currently investigating</p>tag:byphone.statuspage.io,2005:Incident/103180642022-06-16T12:52:01+01:002022-06-24T16:32:42+01:00Registration issue<p><small>Jun <var data-var='date'>16</var>, <var data-var='time'>12:52</var> BST</small><br><strong>Resolved</strong> - This incident has been resolved. <br />We had more than half of registered devices fail over to our backup within 10 minutes of the initial incident and re-routed inbound DDIs shortly after.<br />A small number of handsets remain on our backup registrar having not yet failed back to our primary POP. However services on our primary registrar have remained stable since the fix was implemented and DDI routed via the primary POP again.<br />A post-mortem will follow in due course with further information on the cause and steps taken throughout.</p><p><small>Jun <var data-var='date'>16</var>, <var data-var='time'>12:11</var> BST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Jun <var data-var='date'>16</var>, <var data-var='time'>11:58</var> BST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results. Handsets may have automatically failed over to our backup POP and should fall back to the primary POP within 10 minutes. This could be forced back more quickly with a reboot of the device.</p><p><small>Jun <var data-var='date'>16</var>, <var data-var='time'>11:55</var> BST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Jun <var data-var='date'>16</var>, <var data-var='time'>11:46</var> BST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jun <var data-var='date'>16</var>, <var data-var='time'>11:46</var> BST</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>