Andrews & Arnold Incidents Feed

[Info] Broadband: 24 hour fault diagnostics

2010-09-02T15:16:25+01:00

We are pleased to confirm that the control pages now allow interactive BT fault diagnostics on all BT based lines (20CN and 21CN).

Until now this was only available on 20CN. We have now been able to enable this on 21CN lines and improve the reporting provided.

The disagnostics take you through simple questions and carry our line tests on the line to try and determine if there is a problem. Some of the wording can be confusing as it is mainly aimed at our use, but we have made the system available to customers directly.

The questions asked can often help eliminate the likely causes of problems and help us pin down the cause of the fault if there is one. The results also help BT resolve the issue when we report the fault in to them.

Simply select your line on the control pages and select the KBD diagnostics link.

If you do get crazy results, do let us know by email and we'll discuss with BT.

[Minor] Broadband: All lines dropped on 21CN-REGION-CF-C (Open)

2010-09-02T03:32:03+01:00

All lines on 21CN-REGION-CF-C dropped at 2010-09-02 03:31:16
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 21CN-BRAS-RED4-MQD (Open)

2010-09-02T00:04:02+01:00

All lines on 21CN-BRAS-RED4-MQD dropped at 2010-09-02 00:03:18
We have advised BT
This is likely to have affected multiple internet providers using BT

[PEW] Broadband: BE Planned Work (Open)

2010-09-01T12:26:10+01:00

This is a Planned Engineer Work notice from BE regarding some network upgrades:

As some of you may be aware there is currently a project running to support PPPoA on the O2 network for the wholesale channel. This will allow customers to connect using the same encapsulation, VPI/VCI and MTU settings as employed by BT Wholesale, which will pave the way for seamless customer migrations.

We are now starting the deployment stage of the project and for this O2 will be making some changes to our MPLS configuration on the core network.

This work is being carried out on core switches on the O2 broadband network, which will affect exchanges in geographical regions. The following regions will be affected on the following dates (the inclusion of Manchester on 2 separate dates is correct):

21/09/2010:

Cambridge

Harlow

Crawley

Croydon

Swindon

Gloucester

Bristol

Tunbridge Wells

Fareham

Brighton

Southampton

Time slot:

00:00 – 06:00

Tasks:

Configuring fast path redundancy on core switches.

This means that in the event of a core network link failure recovery via an alternative path will happen fast enough that PPP sessions will not drop and need to be re-established. This enhancement is being added to the existing PPPoE platform as well as the new PPPoA platform.

Service impact:

The configuration changes will disrupt traffic for a few seconds, this may be sufficient for sessions to drop and have to re-establish.

Further details regarding the PPPoA project will be announced when we approach the end of the project; we are working towards a go live date towards the end of October.

[PEW] Broadband: BE Planned Work (Open)

2010-09-01T12:25:48+01:00

This is a Planned Engineer Work notice from BE regarding some network upgrades:

We are now starting the deployment stage of the project and for this O2 will be making some changes to our MPLS configuration on the core network.

20/09/2010:

Dudley

Exeter

Plymouth

Maidstone

Cardiff

Chelmsford

Peterborough

Milton Keynes

Hemel

Slough

Time slot:

00:00 – 06:00

Tasks:

Configuring fast path redundancy on core switches.

Service impact:

The configuration changes will disrupt traffic for a few seconds, this may be sufficient for sessions to drop and have to re-establish.

Further details regarding the PPPoA project will be announced when we approach the end of the project; we are working towards a go live date towards the end of October.

[PEW] Broadband: BE Planned Work (Open)

2010-09-01T12:25:27+01:00

This is a Planned Engineer Work notice from BE regarding some network upgrades:

We are now starting the deployment stage of the project and for this O2 will be making some changes to our MPLS configuration on the core network.

14/09/2010:

Manchester

Sheffield

Stoke

Birmingham

Northampton

Derby

Nottingham

Streetly

Tipton

Birmingham South

Time slot:

00:00 – 06:00

Tasks:

Configuring fast path redundancy on core switches.

Service impact:

The configuration changes will disrupt traffic for a few seconds, this may be sufficient for sessions to drop and have to re-establish.

Further details regarding the PPPoA project will be announced when we approach the end of the project; we are working towards a go live date towards the end of October.

[PEW] Broadband: BE Planned Work (Open)

2010-09-01T12:25:05+01:00

This is a Planned Engineer Work notice from BE regarding some network upgrades:

We are now starting the deployment stage of the project and for this O2 will be making some changes to our MPLS configuration on the core network.

13/09/2010:

Newcastle

Low Moor

Leeds

Batley

Warrington

Liverpool

Ellesmere Port

Manchester

Portadown

Belfast

Time slot:

00:00 – 06:00

Tasks:

Configuring fast path redundancy on core switches.

Service impact:

The configuration changes will disrupt traffic for a few seconds, this may be sufficient for sessions to drop and have to re-establish.

Further details regarding the PPPoA project will be announced when we approach the end of the project; we are working towards a go live date towards the end of October.

[PEW] Broadband: BE Planned Work (Open)

2010-09-01T12:24:44+01:00

This is a Planned Engineer Work notice from BE regarding some network upgrades:

We are now starting the deployment stage of the project and for this O2 will be making some changes to our MPLS configuration on the core network.

09/09/2010:

Reading

London

Edinburgh

Glasgow

Preston

Bolton

Dundee

Aberdeen

York

Middlesbrough

Time slot:

00:00 – 06:00

Tasks:

Configuring fast path redundancy on core switches.

Service impact:

The configuration changes will disrupt traffic for a few seconds, this may be sufficient for sessions to drop and have to re-establish.

Further details regarding the PPPoA project will be announced when we approach the end of the project; we are working towards a go live date towards the end of October.

[PEW] Broadband: BE Planned Work (Open)

2010-09-01T12:24:23+01:00

This is a Planned Engineer Work notice from BE regarding some network upgrades:

We are now starting the deployment stage of the project and for this O2 will be making some changes to our MPLS configuration on the core network.

08/09/2010:

Leicester

Oxford

Coventry

Christchurch

Time slot:

00:00 – 06:00

Tasks:

Configuring fast path redundancy on core switches.

Service impact:

The configuration changes will disrupt traffic for a few seconds, this may be sufficient for sessions to drop and have to re-establish.

Further details regarding the PPPoA project will be announced when we approach the end of the project; we are working towards a go live date towards the end of October.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR10-FARADAY3

2010-09-01T10:30:56+01:00

All lines on 20CN-BRAS-ESR10-FARADAY3 dropped at 2010-08-29 10:00:31
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 1 Sep 2010 10:30:56

Lines have recovered and we are chasing BT for an explanation for this outage.
So far we have no news, but we will still tryto get the explanation.

[Minor] Broadband: Packet Loss at the COWDEN Exchange

2010-09-01T08:37:55+01:00

We have noticed that since about 19:00 yesterday, all 20CN lines at the COWDEN exchange have been showing quite severe packet loss.

This will be affecting multiple ISPs that use the BT network.

BT are aware and are investigating at the moment.

Update 1 Sep 2010 08:37:55

This appears to have been resolved.
We have had no word from BT reference the cause or the resolution, we will chase and try and get the information.

[PEW] Broadband: LNS reload - bank holiday weekend

2010-08-28T17:21:16+01:00

Reloading new code in LNS bank holiday weekend.

As usual this is a few seconds downtime while we switch circuits to the other server.

Update 27 Aug 2010 16:30:20

We are likely to update the primary of many of our core routers as well, but this should be pretty seamless.

Update 28 Aug 2010 17:04:25

Moving lines A to B now.

Update 28 Aug 2010 17:14:36

All lines moved over. As usual the graphs will be split for today but over night the archives will stitch them together. As usually each line had a simple ppp reconnect lasting typically a few seconds. Thank you for your patience.

Update 28 Aug 2010 17:21:16

Core router updates also done.

Update 28 Aug 2010 17:41:51

Some reports of the core router updates distrupting IPv6 for a minute. We are not sure why this happened.

[Minor] Broadband: L-WAT blipped again

2010-08-28T09:11:37+01:00

Looks like all lines on BT BRAS region L-WAT (London) went off.

They seem to be coming back on.

As ever, this is a general BT fault affecting multiple ISPs.

[MSO] Ethernet: Routing issue affecting Ethernet customers

2010-08-27T17:54:41+01:00

At just before 17:00 today a minor routing announcement change was made. This was a very minor change and was not run as a proper planned work because it was so minor, or so we thought. Even so the change was not done in the middle of the day.

At 17:36 we were advised by MSO text that customers on Ethernet links were seeing problems. By 17:44 we had identified the cause of the problem and resolved it.

Technical details: The problem is in fact related to exhaustion of IPv4 space. We are involved in arrangements to swap IP blocks around between ISPs to free up some additional space, and this meant fragmenting one of our larger IP blocks. In principle this is simple, we announce the smaller blocks and drop the larger block announcement later. Unfortunately one of the smaller blocks is routed to Ethernet connected customers and was included in the list annonced at Telehouse in London.

The impact was that some of the Internet was not accessable to Ethernet customers, depending on routing. This included all of our ADSL lines and many services peering on LINX in London which could not see Ethernet lines. Unfortunately, as a partial failure it was not picked up by any of our automated monitoring which could still see Ethernet customers.

This was human error, and resolved within 8 minutes of being reported on a bank holiday weekend out of hours.

We will consider ways to manage this better - it is a trade off as we could have put more in automated control which would have stopped this specific error but could lead to more radical errors being possible with a lot less effort. We're reviewing procedures for checking changes like this before hand in future.

Sorry for the inconvenience.

[Minor] Broadband: All lines dropped on 21CN-REGION-MR-DH

2010-08-27T16:36:46+01:00

All lines on 21CN-REGION-MR-DH dropped at 2010-08-25 16:40:37
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 27 Aug 2010 16:36:46

Lines have recovered and we are chasing BT for an explanation for this outage.

[Minor] Broadband: All lines dropped on 21CN-BRAS-RED3-GI-B

2010-08-27T16:36:33+01:00

All lines on 21CN-BRAS-RED3-GI-B dropped at 2010-08-26 00:19:53
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 27 Aug 2010 16:36:33

Lines have recovered and we are chasing BT for an explanation for this outage.

[Minor] Broadband: All lines dropped on 21CN-REGION-GI-B

2010-08-27T16:36:19+01:00

All lines on 21CN-REGION-GI-B dropped at 2010-08-26 02:00:31
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 26 Aug 2010 03:04:03 All lines on 21CN-REGION-GI-B dropped again at 2010-08-26 03:03:07.

Update 27 Aug 2010 16:36:19

Lines have recovered and we are chasing BT for an explanation for this outage.

[Minor] Broadband: All lines dropped on 21CN-BRAS-RED2-L-WAT

2010-08-27T16:35:27+01:00

All lines on 21CN-BRAS-RED2-L-WAT dropped at 2010-08-27 03:04:26
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 27 Aug 2010 16:35:27

We are still chasing BT for information for what is happening in the L-WAT area.

[MSO] Broadband: L-WAT outage over night

2010-08-27T16:34:56+01:00

We don't know why yet, but every BT 21CN line on L-WAT was off line for over 6 hours during the night. We'll update this when we get an explanation from BT.

This is likely to have affected many ISPs, not just us.

Update 26 Aug 2010 10:02:31

BTO are investigating the outage now, hopefully should get more details soon.

[Minor] Broadband: Unable to run BT Diagnostic Tests on ADSL lines

2010-08-27T13:41:33+01:00

We're currently unable to run diagnostic tests on BT ADSL lines (both 20cn and 21cn) - this is a BT system problem.

This will affect our diagnostic and fault reporting as we'll be unable to report falts to BT unless it's clear cut that the fault lies within BT.

Please to bear with us, we've not got an ETA from BT, but they are working to resolve the problem.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR11-BIRMINGHAM6

2010-08-25T13:37:14+01:00

All lines on 20CN-BRAS-ESR11-BIRMINGHAM6 dropped at 2010-08-24 04:57:45
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 25 Aug 2010 13:37:14

All lines recovered quite quickly. We are still waiting for an explanation from BT.

[Minor] Broadband: All lines dropped on 21CN-BRAS-RED4-L-WAT

2010-08-25T13:36:32+01:00

All lines on 21CN-BRAS-RED4-L-WAT dropped at 2010-08-23 16:42:04
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 25 Aug 2010 13:36:32

All lines recovered quite quickly. We are still waiting for an explanation from BT.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR10-KINGSTON5

2010-08-25T13:36:16+01:00

All lines on 20CN-BRAS-ESR10-KINGSTON5 dropped at 2010-08-21 00:09:14
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 25 Aug 2010 13:36:16

All lines recovered quite quickly. We are still waiting for an explanation from BT.

[PEW] General: Priceless Server Move - Accounts System

2010-08-24T12:08:57+01:00

Planned for Tuesday 24th August, starting 9am

We will be moving our accounts system server, 'Priceless' to new hardware in a different datacentre.

Priceless is our accounts system server, providing web based access to your billing account.

Customer Impact
During the move the accounts system's web pages will be unavailable.

Update 24 Aug 2010 07:47:50

This work has started, web page access to the accounts system will be unavailable during the move.

Update 24 Aug 2010 08:59:44

The main part of the move has been completed. We are in the process of reviewing and checking various functions that the server performs.

Update 24 Aug 2010 12:08:57

The move has been completed. Staff are still monitoring the server though, but the move was successful.

[Minor] Broadband: All lines dropped on 21CN-REGION-PE

2010-08-19T10:06:00+01:00

All lines on 21CN-REGION-PE dropped at 2010-08-18 03:19:43
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 19 Aug 2010 10:06:00

All lines recovered within 5 - 10 mins.
We are still chasing BT for an explanation for this but as of yet we have heard nothing.

[MSO] VoIP: VoIP Problems

2010-08-19T09:36:59+01:00

We are currently investigating a VoIP problem with incoming calls not working - We'll update very shortly.

Update 19 Aug 2010 09:36:59

The problem was due to a database problem, call are working ok now.

We will carry on monitoring the servers closely.

[PEW] General: Clueless Server Move

2010-08-18T19:51:33+01:00

Planned for Wednesday 18th August, starting 7am

We will be moving 'Clueless' to new hardware in a different datacentre.

Clueless is our core database server, control page server, primary radius server and runs other tasks.

Customer Impact:
During the move the control pages will unavailable. Other key services that Clueless performs will be handled by secondary/backup servers.

We do not expect broadband services to be affected by this work.

The work is being carried out on a week day as it will be easier and quicker for staff to respond to any problems that may arise.

Update 9 Aug 2010 10:32:53

Sorry, This has now been moved to Wednesday 18th August

Update 18 Aug 2010 07:30:55

We expect to start this work before 8am, with the web control pages on clueless being taken off line. This is to stop updates to the database which is then moved to the new server.

Update 18 Aug 2010 07:47:58

This work in in progress.

Update 18 Aug 2010 08:58:41

This is still being worked on at the moment. Most things are moved across, some elements of the control pages are not yet working.

Update 18 Aug 2010 09:26:56

Currently:

Line tests
Fault updates
Historical Graphs
RADIUS logs

are items on the new server which are not yet working. There may be others. -this is not affecting customer service, and they should be working again later this morning.

If you spot anything you think we may have missed, please do let us know on IRC.

Update 18 Aug 2010 13:52:05

Current outstanding issues:

We're still working on the BT XML interface - meaning we have problems with XML communication to and from BT with regards to orders, faults and lines tests.
Historical CQM graphs are still in the process of being copied over

Update 18 Aug 2010 16:27:12

Our BT XML systems are now operational, we are still in the progress of moving over old CQM graphs, this should be completed later this evening.

Thank you for bearing with us today.

[Minor] Broadband: 21CN-BRAS-RED3-SL drop

2010-08-18T11:28:20+01:00

Most lines on 21CN-BRAS-RED3-SL have dropped a few minutes ago and stayed off. We are chasing this with BT now.

Update 17 Aug 2010 10:28:21

Details of affected lines have been passed on to BT, they are investigating.

Update 17 Aug 2010 10:49:14

A couple of lines have come back

Update 17 Aug 2010 12:02:38

BT's technical teams are still working on this problem. There is an update due at 13:30.

Update 17 Aug 2010 12:40:37

Well, progress, the remaining lines that had not gone off also went off at 12:33:40

Update 17 Aug 2010 13:10:59

About a fifth of the lines came back on line at 13:08 - and have since dropped again.

Update 17 Aug 2010 13:24:57

BT have an Anticipated Clear Time of 14:30, although there are no guarantees.

Progress is being made as we are seeing some lines coming up but then dropping again.

Update 17 Aug 2010 14:49:55

BT have updated the Anticipated Clear Time to 15:30.

Update 17 Aug 2010 15:54:59

BT keep pushing the anticipated clear time for this fault, not very helpful and we do apoligise! It's now at 18:00.

The latest update is that new hardware is on it's way to the site, and should be there later this afternoon.

(The fault is affecting tens of thousands of lines and is not specific to just AAISP lines.)

Update 17 Aug 2010 18:29:26

Lines still mostly down, occasionally coming up for a bit. Still waiting on BT.

[PEW] VoIP: Call server move

2010-08-17T18:28:15+01:00

We will be doing more testing on the new call servers during this week.

We hope to be able to move over to the new call server pretty seamlessly, probably early one morning this week when we are happy that we have the new servers behaving exactly as we want them.

There is no change to configuration on customer equipment or IP addresses. This is simply a move to new hardware and setting up fallback hardware.

The legacy call server ("A" server, running asterisk) is not being touched.

Update 17 Aug 2010 18:27:45

This was done as an emergency this evening (Tuesday)

[MSO] VoIP: Call server issue

2010-08-17T17:56:15+01:00

We are again having an issue with the call server which we expect to be resolve in a few minutes. Apologies for inconvenience.

Update 17 Aug 2010 17:39:54

Sorry, someone is going to site now and will be a couple of minutes

Update 17 Aug 2010 17:56:15

The call server did a silly when we made a minor change ready for work later in the week. As a result we have moved to new hardware. Someone is on site trying to work out WTF happened anyway, but that may wait until morning as we have managed to switch to the main call server on the new hardware now.

Update 17 Aug 2010 18:35:37

As usual, with the new system for handling calls, any calls in progress and not recorded would have continued with no problems during the issues and would then not have been charged.

[Info] General: Wednesday morning

2010-08-17T15:35:38+01:00

Because of the move of clueless, and due to some staff off sick and on leave, we expect to be busy Wednesday morning. We'll try and ensure calls, etc, are all handled as quickly as possible. However, some key support staff will be concentrating on babysitting the new server in the morning to ensure all services are running smoothly for everyone.

Having said that we do not anticipate any major issues.

[PEW] VoIP: C.Speechless VoIP Call Server Move

2010-08-17T08:25:55+01:00

Planned for: Sunday 15th August

To increase resilience and reliability of our VoIP service we will be moving C.Speechless on to new hardware.

The changeover should happen very quickly. We expect there to be just a few minutes where calls will not be able to be placed.

We'll update this post as the work is carried out

Further information: We have 2 VoIP servers, the A server and the C server. The C server is our new server. It's the C server that we will be moving. The new hardware is a pair of servers to enable fall-back etc.

Update 15 Aug 2010 13:21:35

This may be delayed until late in the day.

Update 15 Aug 2010 16:19:15

This may be in the morning, apologies for delay.

Update 16 Aug 2010 08:43:02

We'll probably be doing this some time Monday evening - it should be pretty seemless. Sorry for the delay

[Minor] VoIP: Call issues this morning

2010-08-17T08:25:12+01:00

Some problems with calls and registrations this morning. Some of the work preparing for the planned change at the weekend has had unexpected side effects and has been reversed.

The impact is on setting up calls. Calls in progress should not be affected and not billed either.

Sorry for any inconvenience.

[MSO] Broadband: Current Routing Problem

2010-08-16T09:05:01+01:00

We are currently investigating a routing problem. Not sure of the exact details at the moment, but we'll post again in a few minutes.

Update 16 Aug 2010 09:00:27

The problem is with one of our routers in Telehouse.

[PEW] Broadband: We plan to reload the LNS code on Sunday

2010-08-15T09:47:30+01:00

This should address the recent issue with 20CN BRAS resets.

Update 12 Aug 2010 11:28:21

We may leave this till the end of the month. Our analysis suggests that by this weekend all BRASs will have cleared anyway and then be fine for around 45 days more afterwards.

[Minor] Broadband: BT 21CN London Issues

2010-08-13T10:37:14+01:00

Several exchanges in the London area have been down since roughly 14:00 today.

Exchanges we are aware of:

EUSTON, CROYDON, SHOREDITCH, KINGSLAND GREEN, WHITEHALL, UPPER HOLLOWAY, BELGRAVIA, BISHOPSGATE and DOWNLAND

This is a BT network issue and will be affecting multiple ISP that you BT technology. BT are aware and are investigating.

Update 11 Aug 2010 15:17:01

Also Affected:

ACTON, BECKENHAM, MITCHAM, THAMESMEAD, CHISWICK and BALHAM

Update 11 Aug 2010 15:35:00

BT have raised an incident and are currently investigating the cause of the issue.

Update 11 Aug 2010 16:41:24

Looks like most lines have come back now. All other lines should be back up soon.
We are chasing BT for the cause of this issue.

[Minor] Broadband: All lines on 21CN ST PETERS dropped at 2010-08-12 09:47:52 and 10:19:55

2010-08-12T11:49:01+01:00

All lines on 21CN ST PETERS dropped at 2010-08-12 09:47:52 and 10:19:55

We have advised BT, this is likely to have affected multiple internet providers using BT.

BT IMT22697/10 and ALS 290440

BT advise that over 500 users are down, possibly 850 users. BT should be carrying out a remote switch over which they are hoping will fix the issue. Next update should be just after 11:00.

Update 12 Aug 2010 11:11:39

Vendor support are currently taking logs off MSAN to find route cause of fault and will be performing IPMB switch over to fix fault. Next update will be just after 12:30

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR6-MILTONKEYNES3

2010-08-12T10:46:47+01:00

All lines on 20CN-BRAS-ESR6-MILTONKEYNES3 dropped at 2010-08-12 05:54:23
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:23:06

Lines came back in around 30 seconds and this is being looked in to

[Info] Broadband: Recent BRAS resets

2010-08-12T10:22:58+01:00

As customers will be aware we have seen a problem with 20CN BRAS resets over the last day or so. It seems BRAS connections resetting one after the other since yesterday morning. The effect for customers on the BRAS was that they lost service for a few seconds and reconnected. Most routers appear to reconnect in around 30 seconds.

Naturally we assumed it was a BT issue and have been hassling them. It looks like that was not the case, so we would like to apologise to BT for hassling them over this for the last day.

On checking our logs in more detail it looks like the issue is that our LNS has been running long enough for a sequence number to wrap around on the LNS/BRAS control messaging and it appears that we are mishandling this. It is the fact we have run for several months without even a software update that has finally highlighted this issue.

We will be doing an LNS s/w upgrade soon to address this. We'll not be logging these resets on the status pages for now.

Update 12 Aug 2010 11:26:25

Customers may see PortError updated for their line when this happens.

Update 13 Aug 2010 08:25:03

The spate of BRAS reconnects has indeed stopped, as expected.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR6-BIRMINGHAM5

2010-08-12T10:22:47+01:00

All lines on 20CN-BRAS-ESR6-BIRMINGHAM5 dropped at 2010-08-12 06:09:51
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:22:47

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX11-MANCHESTER3

2010-08-12T10:22:19+01:00

All lines on 20CN-BRAS-ERX11-MANCHESTER3 dropped at 2010-08-12 06:23:30
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:22:19

Lines came back in around 30 seconds and this is being looked in tov

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX5-ILFORD3

2010-08-12T10:22:04+01:00

All lines on 20CN-BRAS-ERX5-ILFORD3 dropped at 2010-08-12 06:25:25
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:22:04

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX8-BIRMINGHAM2

2010-08-12T10:21:35+01:00

All lines on 20CN-BRAS-ERX8-BIRMINGHAM2 dropped at 2010-08-12 06:51:56
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:21:35

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR11-BIRMINGHAM6

2010-08-12T10:21:20+01:00

All lines on 20CN-BRAS-ESR11-BIRMINGHAM6 dropped at 2010-08-12 07:10:15
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:21:20

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX4-READING2

2010-08-12T10:21:04+01:00

All lines on 20CN-BRAS-ERX4-READING2 dropped at 2010-08-12 07:13:02
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:21:04

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX12-EDINBURGH3

2010-08-12T10:20:48+01:00

All lines on 20CN-BRAS-ERX12-EDINBURGH3 dropped at 2010-08-12 07:17:40
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:20:48

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX2-BIRMINGHAM2

2010-08-12T10:20:29+01:00

All lines on 20CN-BRAS-ERX2-BIRMINGHAM2 dropped at 2010-08-12 07:19:57
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:20:29

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR1-FARADAY2

2010-08-12T10:20:06+01:00

All lines on 20CN-BRAS-ESR1-FARADAY2 dropped at 2010-08-12 07:55:11
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:20:06

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR2-FARADAY2

2010-08-12T10:19:53+01:00

All lines on 20CN-BRAS-ESR2-FARADAY2 dropped at 2010-08-12 08:04:44
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:19:53

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX6-MILTONKEYNES

2010-08-12T10:19:40+01:00

All lines on 20CN-BRAS-ERX6-MILTONKEYNES dropped at 2010-08-12 08:13:25
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 08:15:06 All lines on 20CN-BRAS-ERX6-MILTONKEYNES dropped again at 2010-08-12 08:13:25.

Update 12 Aug 2010 10:19:40

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX22-EDINBURGH4

2010-08-12T10:19:23+01:00

All lines on 20CN-BRAS-ERX22-EDINBURGH4 dropped at 2010-08-12 08:17:22
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:19:23

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX13-BIRMINGHAM3

2010-08-12T10:15:20+01:00

All lines on 20CN-BRAS-ERX13-BIRMINGHAM3 dropped at 2010-08-12 08:43:26
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:15:20

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR1-MANCHESTER5

2010-08-12T10:15:09+01:00

All lines on 20CN-BRAS-ESR1-MANCHESTER5 dropped at 2010-08-12 08:44:32
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:15:09

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR2-BIRMINGHAM5

2010-08-12T10:14:56+01:00

All lines on 20CN-BRAS-ESR2-BIRMINGHAM5 dropped at 2010-08-12 08:53:19
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:14:56

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX1-EDINBURGH2

2010-08-12T10:14:45+01:00

All lines on 20CN-BRAS-ERX1-EDINBURGH2 dropped at 2010-08-12 08:58:48
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:14:45

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX1-READING2

2010-08-12T10:14:14+01:00

All lines on 20CN-BRAS-ERX1-READING2 dropped at 2010-08-12 09:04:20
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:14:14

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX13-ILFORD4

2010-08-12T10:14:04+01:00

All lines on 20CN-BRAS-ERX13-ILFORD4 dropped at 2010-08-12 09:07:26
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 09:09:06 All lines on 20CN-BRAS-ERX13-ILFORD4 dropped again at 2010-08-12 09:07:26.

Update 12 Aug 2010 10:13:55

Lines came back in around 30 seconds and this is being looked in to

Update 12 Aug 2010 10:14:04

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR5-SHEFFIELD3

2010-08-12T10:13:45+01:00

All lines on 20CN-BRAS-ESR5-SHEFFIELD3 dropped at 2010-08-12 09:25:16
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:13:45

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR16-BIRMINGHAM6

2010-08-12T10:13:34+01:00

All lines on 20CN-BRAS-ESR16-BIRMINGHAM6 dropped at 2010-08-12 09:48:13
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:13:34

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX6-KINGSTON2

2010-08-12T10:13:28+01:00

All lines on 20CN-BRAS-ERX6-KINGSTON2 dropped at 2010-08-12 10:07:03
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 10:13:28

Lines came back in around 30 seconds and this is being looked in to

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR5-FARADAY2

2010-08-12T05:53:03+01:00

All lines on 20CN-BRAS-ESR5-FARADAY2 dropped at 2010-08-12 05:52:21
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 21CN-BRAS-RED1-L-STE

2010-08-12T05:49:06+01:00

All lines on 21CN-BRAS-RED1-L-STE dropped at 2010-08-12 05:48:05
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR11-KINGSTON5

2010-08-12T05:30:03+01:00

All lines on 20CN-BRAS-ESR11-KINGSTON5 dropped at 2010-08-12 05:29:28
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX4-KINGSTON2

2010-08-12T05:23:08+01:00

All lines on 20CN-BRAS-ERX4-KINGSTON2 dropped at 2010-08-12 05:22:29
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR6-EDINBURGH5

2010-08-12T05:14:03+01:00

All lines on 20CN-BRAS-ESR6-EDINBURGH5 dropped at 2010-08-12 05:12:15
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX12-MILTONKEYNES2

2010-08-12T05:12:08+01:00

All lines on 20CN-BRAS-ERX12-MILTONKEYNES2 dropped at 2010-08-12 05:11:13
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR6-KINGSTON4

2010-08-12T04:51:07+01:00

All lines on 20CN-BRAS-ESR6-KINGSTON4 dropped at 2010-08-12 04:49:58
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR13-BIRMINGHAM6

2010-08-12T04:49:07+01:00

All lines on 20CN-BRAS-ESR13-BIRMINGHAM6 dropped at 2010-08-12 04:48:39
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX12-READING3

2010-08-12T04:42:03+01:00

All lines on 20CN-BRAS-ERX12-READING3 dropped at 2010-08-12 04:41:54
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX2-FARADAY

2010-08-12T04:39:03+01:00

All lines on 20CN-BRAS-ERX2-FARADAY dropped at 2010-08-12 04:38:57
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX19-SHEFFIELD4

2010-08-12T04:36:03+01:00

All lines on 20CN-BRAS-ERX19-SHEFFIELD4 dropped at 2010-08-12 04:35:59
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 04:38:03 All lines on 20CN-BRAS-ERX19-SHEFFIELD4 dropped again at 2010-08-12 04:36:23.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR3-EDINBURGH5

2010-08-12T04:27:03+01:00

All lines on 20CN-BRAS-ESR3-EDINBURGH5 dropped at 2010-08-12 04:25:50
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR10-MILTONKEYNES4

2010-08-12T04:24:03+01:00

All lines on 20CN-BRAS-ESR10-MILTONKEYNES4 dropped at 2010-08-12 04:24:00
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX8-MILTONKEYNES

2010-08-12T04:09:04+01:00

All lines on 20CN-BRAS-ERX8-MILTONKEYNES dropped at 2010-08-12 04:08:16
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR1-KINGSTON4

2010-08-12T04:05:03+01:00

All lines on 20CN-BRAS-ESR1-KINGSTON4 dropped at 2010-08-12 04:04:39
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR8-KINGSTON4

2010-08-12T03:54:08+01:00

All lines on 20CN-BRAS-ESR8-KINGSTON4 dropped at 2010-08-12 03:53:21
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX13-READING3

2010-08-12T03:42:03+01:00

All lines on 20CN-BRAS-ERX13-READING3 dropped at 2010-08-12 03:41:32
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX10-ILFORD4

2010-08-12T03:28:07+01:00

All lines on 20CN-BRAS-ERX10-ILFORD4 dropped at 2010-08-12 03:27:08
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR9-BIRMINGHAM6

2010-08-12T03:23:07+01:00

All lines on 20CN-BRAS-ESR9-BIRMINGHAM6 dropped at 2010-08-12 03:21:15
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR2-MANCHESTER5

2010-08-12T03:08:03+01:00

All lines on 20CN-BRAS-ESR2-MANCHESTER5 dropped at 2010-08-12 03:07:19
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX6-READING2

2010-08-12T02:34:03+01:00

All lines on 20CN-BRAS-ERX6-READING2 dropped at 2010-08-12 02:34:00
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR3-READING4

2010-08-12T02:30:04+01:00

All lines on 20CN-BRAS-ESR3-READING4 dropped at 2010-08-12 02:29:07
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX7-FARADAY

2010-08-12T02:08:03+01:00

All lines on 20CN-BRAS-ERX7-FARADAY dropped at 2010-08-12 02:07:01
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX5-KINGSTON2

2010-08-12T02:07:03+01:00

All lines on 20CN-BRAS-ERX5-KINGSTON2 dropped at 2010-08-12 02:05:11
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR7-READING4

2010-08-12T01:59:04+01:00

All lines on 20CN-BRAS-ESR7-READING4 dropped at 2010-08-12 01:58:45
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX20-EDINBURGH4

2010-08-12T01:36:03+01:00

All lines on 20CN-BRAS-ERX20-EDINBURGH4 dropped at 2010-08-12 01:35:44
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 12 Aug 2010 01:37:04 All lines on 20CN-BRAS-ERX20-EDINBURGH4 dropped again at 2010-08-12 01:35:44.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR6-ILFORD5

2010-08-12T01:20:04+01:00

All lines on 20CN-BRAS-ESR6-ILFORD5 dropped at 2010-08-12 01:19:41
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR1-BIRMINGHAM5

2010-08-12T00:44:08+01:00

All lines on 20CN-BRAS-ESR1-BIRMINGHAM5 dropped at 2010-08-12 00:43:19
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX7-KINGSTON2

2010-08-11T23:40:03+01:00

All lines on 20CN-BRAS-ERX7-KINGSTON2 dropped at 2010-08-11 23:39:14
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX2-ILFORD3

2010-08-11T22:56:07+01:00

All lines on 20CN-BRAS-ERX2-ILFORD3 dropped at 2010-08-11 22:55:42
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR4-KINGSTON4

2010-08-11T22:39:06+01:00

All lines on 20CN-BRAS-ESR4-KINGSTON4 dropped at 2010-08-11 22:38:49
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX14-MILTONKEYNES2

2010-08-11T22:34:07+01:00

All lines on 20CN-BRAS-ERX14-MILTONKEYNES2 dropped at 2010-08-11 22:33:20
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX3-BIRMINGHAM2

2010-08-11T21:44:07+01:00

All lines on 20CN-BRAS-ERX3-BIRMINGHAM2 dropped at 2010-08-11 21:43:03
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR18-KINGSTON6

2010-08-11T20:11:07+01:00

All lines on 20CN-BRAS-ESR18-KINGSTON6 dropped at 2010-08-11 20:09:51
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX18-READING

2010-08-11T19:19:06+01:00

All lines on 20CN-BRAS-ERX18-READING dropped at 2010-08-11 19:18:40
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX16-READING3

2010-08-11T19:12:03+01:00

All lines on 20CN-BRAS-ERX16-READING3 dropped at 2010-08-11 19:11:32
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR2-MILTONKEYNES3

2010-08-11T19:07:07+01:00

All lines on 20CN-BRAS-ESR2-MILTONKEYNES3 dropped at 2010-08-11 19:06:11
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 11 Aug 2010 19:08:06 All lines on 20CN-BRAS-ESR2-MILTONKEYNES3 dropped again at 2010-08-11 19:06:11.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX12-BIRMINGHAM3

2010-08-11T18:31:06+01:00

All lines on 20CN-BRAS-ERX12-BIRMINGHAM3 dropped at 2010-08-11 18:31:00
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR1-READING4

2010-08-11T17:46:07+01:00

All lines on 20CN-BRAS-ESR1-READING4 dropped at 2010-08-11 17:45:50
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 11 Aug 2010 17:47:06 All lines on 20CN-BRAS-ESR1-READING4 dropped again at 2010-08-11 17:45:50.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX21-SHEFFIELD4

2010-08-11T17:29:06+01:00

All lines on 20CN-BRAS-ERX21-SHEFFIELD4 dropped at 2010-08-11 17:28:50
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX9-BIRMINGHAM3

2010-08-11T16:51:06+01:00

All lines on 20CN-BRAS-ERX9-BIRMINGHAM3 dropped at 2010-08-11 16:49:10
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX7-MILTONKEYNES

2010-08-11T16:49:07+01:00

All lines on 20CN-BRAS-ERX7-MILTONKEYNES dropped at 2010-08-11 16:47:53
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX2-READING2

2010-08-11T16:33:06+01:00

All lines on 20CN-BRAS-ERX2-READING2 dropped at 2010-08-11 16:32:08
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR8-BIRMINGHAM5

2010-08-11T16:31:07+01:00

All lines on 20CN-BRAS-ESR8-BIRMINGHAM5 dropped at 2010-08-11 16:30:37
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 11 Aug 2010 16:32:07 All lines on 20CN-BRAS-ESR8-BIRMINGHAM5 dropped again at 2010-08-11 16:30:37.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR12-BIRMINGHAM6

2010-08-11T16:19:07+01:00

All lines on 20CN-BRAS-ESR12-BIRMINGHAM6 dropped at 2010-08-11 16:18:58
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 11 Aug 2010 16:20:07 All lines on 20CN-BRAS-ESR12-BIRMINGHAM6 dropped again at 2010-08-11 16:18:58.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX3-READING2

2010-08-11T15:51:07+01:00

All lines on 20CN-BRAS-ERX3-READING2 dropped at 2010-08-11 15:50:16
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX16-EDINBURGH3

2010-08-11T15:16:08+01:00

All lines on 20CN-BRAS-ERX16-EDINBURGH3 dropped at 2010-08-11 15:15:39
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX16-MILTONKEYNES2

2010-08-11T15:07:09+01:00

All lines on 20CN-BRAS-ERX16-MILTONKEYNES2 dropped at 2010-08-11 15:06:23
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR7-KINGSTON4

2010-08-11T14:58:07+01:00

All lines on 20CN-BRAS-ESR7-KINGSTON4 dropped at 2010-08-11 14:57:15
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX11-BIRMINGHAM3

2010-08-11T14:21:07+01:00

All lines on 20CN-BRAS-ERX11-BIRMINGHAM3 dropped at 2010-08-11 14:20:22
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR6-READING4

2010-08-11T12:55:07+01:00

All lines on 20CN-BRAS-ESR6-READING4 dropped at 2010-08-11 12:54:34
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX10-READING3

2010-08-11T12:22:07+01:00

All lines on 20CN-BRAS-ERX10-READING3 dropped at 2010-08-11 12:21:12
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR4-READING4

2010-08-11T11:58:07+01:00

All lines on 20CN-BRAS-ESR4-READING4 dropped at 2010-08-11 11:57:39
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 11 Aug 2010 11:59:07 All lines on 20CN-BRAS-ESR4-READING4 dropped again at 2010-08-11 11:57:39.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX4-BIRMINGHAM2

2010-08-11T11:44:03+01:00

All lines on 20CN-BRAS-ERX4-BIRMINGHAM2 dropped at 2010-08-11 11:43:13
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX24-BIRMINGHAM4

2010-08-11T11:25:07+01:00

All lines on 20CN-BRAS-ERX24-BIRMINGHAM4 dropped at 2010-08-11 11:24:10
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR7-MILTONKEYNES3

2010-08-11T11:00:07+01:00

All lines on 20CN-BRAS-ESR7-MILTONKEYNES3 dropped at 2010-08-11 10:59:50
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR10-BIRMINGHAM6

2010-08-11T09:22:06+01:00

All lines on 20CN-BRAS-ESR10-BIRMINGHAM6 dropped at 2010-08-11 09:21:45
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX9-READING3

2010-08-11T09:12:07+01:00

All lines on 20CN-BRAS-ERX9-READING3 dropped at 2010-08-11 09:11:49
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 11 Aug 2010 09:13:07 All lines on 20CN-BRAS-ERX9-READING3 dropped again at 2010-08-11 09:11:49.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX16-BIRMINGHAM3

2010-08-11T07:24:03+01:00

All lines on 20CN-BRAS-ERX16-BIRMINGHAM3 dropped at 2010-08-11 07:23:59
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX10-MILTONKEYNES2

2010-08-11T06:56:06+01:00

All lines on 20CN-BRAS-ERX10-MILTONKEYNES2 dropped at 2010-08-11 06:54:27
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR9-MANCHESTER6

2010-08-11T06:47:06+01:00

All lines on 20CN-BRAS-ESR9-MANCHESTER6 dropped at 2010-08-11 06:46:37
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR5-MILTONKEYNES3

2010-08-11T05:07:03+01:00

All lines on 20CN-BRAS-ESR5-MILTONKEYNES3 dropped at 2010-08-11 05:06:50
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX19-BIRMINGHAM4

2010-08-11T04:52:03+01:00

All lines on 20CN-BRAS-ERX19-BIRMINGHAM4 dropped at 2010-08-11 04:51:59
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX22-BIRMINGHAM4

2010-08-11T03:06:03+01:00

All lines on 20CN-BRAS-ERX22-BIRMINGHAM4 dropped at 2010-08-11 03:05:35
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR14-BIRMINGHAM6

2010-08-11T01:19:07+01:00

All lines on 20CN-BRAS-ESR14-BIRMINGHAM6 dropped at 2010-08-11 01:18:49
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX11-MILTONKEYNES2

2010-08-10T23:18:06+01:00

All lines on 20CN-BRAS-ERX11-MILTONKEYNES2 dropped at 2010-08-10 23:17:03
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR5-KINGSTON4

2010-08-10T22:55:07+01:00

All lines on 20CN-BRAS-ESR5-KINGSTON4 dropped at 2010-08-10 22:54:54
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 10 Aug 2010 22:56:07 All lines on 20CN-BRAS-ESR5-KINGSTON4 dropped again at 2010-08-10 22:54:54.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR5-READING4

2010-08-10T22:34:06+01:00

All lines on 20CN-BRAS-ESR5-READING4 dropped at 2010-08-10 22:33:54
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 10 Aug 2010 22:35:06 All lines on 20CN-BRAS-ESR5-READING4 dropped again at 2010-08-10 22:33:54.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX15-MILTONKEYNES2

2010-08-10T21:52:06+01:00

All lines on 20CN-BRAS-ERX15-MILTONKEYNES2 dropped at 2010-08-10 21:51:30
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX9-MILTONKEYNES2

2010-08-10T21:14:06+01:00

All lines on 20CN-BRAS-ERX9-MILTONKEYNES2 dropped at 2010-08-10 21:13:44
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 10 Aug 2010 21:15:03 All lines on 20CN-BRAS-ERX9-MILTONKEYNES2 dropped again at 2010-08-10 21:13:44.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR8-MILTONKEYNES3

2010-08-10T20:11:03+01:00

All lines on 20CN-BRAS-ESR8-MILTONKEYNES3 dropped at 2010-08-10 20:10:53
We have advised BT
This is likely to have affected multiple internet providers using BT

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR5-BIRMINGHAM5

2010-08-10T14:02:33+01:00

All lines on 20CN-BRAS-ESR5-BIRMINGHAM5 dropped at 2010-08-10 09:06:00
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 10 Aug 2010 09:07:07 All lines on 20CN-BRAS-ESR5-BIRMINGHAM5 dropped again at 2010-08-10 09:06:00.

Update 10 Aug 2010 14:02:33

All lines recovered within a few seconds of the blip occurring.
We are still chasing for the cause.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR2-READING4

2010-08-10T14:01:45+01:00

All lines on 20CN-BRAS-ESR2-READING4 dropped at 2010-08-10 09:01:04
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 10 Aug 2010 14:01:45

Most line recovered within a few seconds of the blip occurring.
We are still chasing for the cause.

[Minor] Broadband: All lines dropped on 21CN-REGION-DY

2010-08-10T13:57:23+01:00

All lines on 21CN-REGION-DY dropped at 2010-08-10 00:33:47
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 10 Aug 2010 13:57:23

Almost all of these lines recovered with 20 minutes.
We have not had any info on what happened to these lines, however we are still chasing BT and investigating.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ERX13-MILTONKEYNES2

2010-08-10T13:52:26+01:00

All lines on 20CN-BRAS-ERX13-MILTONKEYNES2 dropped at 2010-08-08 21:44:20
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 10 Aug 2010 13:51:50

BT have not informed us as to what had caused this blip. However thankfully all lines did come back up quite soon after the initial drop.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR2-EALING5

2010-08-10T13:52:06+01:00

All lines on 20CN-BRAS-ESR2-EALING5 dropped at 2010-08-09 19:03:50
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 10 Aug 2010 13:52:06

BT have not informed us as to what had caused this blip. However thankfully all lines did come back up quite soon after the initial drop.

[Minor] Broadband: All lines dropped on 20CN-BRAS-ESR10-MANCHESTER6

2010-08-10T13:51:32+01:00

All lines on 20CN-BRAS-ESR10-MANCHESTER6 dropped at 2010-08-08 02:40:38
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 10 Aug 2010 13:51:32

BT have not informed us as to what had caused this blip. However thankfully all lines did come back up quite soon after the initial drop.

[Minor] Broadband: ALDERSHOT Exchange outage

2010-08-10T08:56:03+01:00

At just before 2pm today some lines at the Aldershot exchange went down.
BT are aware of this and have already raised an incident.

This will be affecting multiple ISPs at the Aldershot exchange on the specific MSAN that is affected.

Update 9 Aug 2010 16:29:38

Engineer is on his way to site and a spare card is also on its way.

Update 10 Aug 2010 08:56:03

This was resolved at around 17:20

[Minor] Broadband: High levels of Packet loss on ERX6-MANCHESTER2

2010-08-09T10:45:52+01:00

All 20CN lines on the ERX6-MANCHESTER2 are showing high levels of packet loss.
This is affecting the whole RAS so it appears to be a BT core network issue.

BT are aware and are investigating at the moment.
This will be affecting multiple ISPs that use BTs network.

Update 6 Aug 2010 12:06:40

BT are unable to raise an incident due to the lack of lines that have been reported with this issue.
Therefore we have bulk reported all lines with this issue via the normal fault process.

Update 6 Aug 2010 15:04:14

After reporting several individual faults, a member of BT picked up all the faults and sent them to BTO for investigation.

BTO have now raised an incident for this issue.

Update 6 Aug 2010 15:47:57

Operational teams are currently carrying out remote diagnostics.

Update 9 Aug 2010 10:45:52

BT resolved the issue at roughly half 4 last Friday.

[Minor] Broadband: All lines dropped on 20CN-REGION-EALING

2010-08-06T15:47:20+01:00

All lines on 20CN-REGION-EALING dropped at 2010-07-28 13:17:12
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 28 Jul 2010 14:13:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:12:19.

Update 28 Jul 2010 14:14:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:13:48.

Update 28 Jul 2010 14:15:11

Lines were dropping every minute or two since this started

Update 28 Jul 2010 14:16:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:15:02.

Update 28 Jul 2010 14:24:05 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:23:49.

Update 28 Jul 2010 14:25:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:24:41.

Update 28 Jul 2010 14:27:05 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:26:18.

Update 28 Jul 2010 14:28:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:27:21.

Update 28 Jul 2010 14:33:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:32:44.

Update 28 Jul 2010 14:34:05 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:33:28.

Update 28 Jul 2010 14:38:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:37:07.

Update 28 Jul 2010 14:55:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:54:45.

Update 28 Jul 2010 15:00:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 14:59:48.

Update 28 Jul 2010 15:11:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 15:10:18.

Update 28 Jul 2010 15:12:05 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 15:11:38.

Update 28 Jul 2010 15:12:41

It is associated with IMT 21322-10 which associated with Colindale, BT believe the link between Colindale and Ealing has gone down, engineers have will be dispatched to both sites.

Update 28 Jul 2010 15:20:07 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 15:19:18.

Update 28 Jul 2010 15:21:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 15:20:28.

Update 28 Jul 2010 15:22:07 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 15:21:56.

Update 28 Jul 2010 15:24:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 15:23:26.

Update 28 Jul 2010 15:25:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-28 15:24:30.

Update 6 Aug 2010 15:47:20

Fault has been resolved.

[Minor] Broadband: All lines dropped on 20CN-REGION-EALING

2010-08-06T15:46:34+01:00

All lines on 20CN-REGION-EALING dropped at 2010-07-29 09:40:11
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 29 Jul 2010 09:42:06 All lines on 20CN-REGION-EALING dropped again at 2010-07-29 09:41:50.

Update 6 Aug 2010 15:46:34

Linked to http://status.aaisp.net.uk/?incident=357 Please see for more info

[Minor] Broadband: All lines dropped on 21CN-REGION-L-NWS

2010-08-06T10:04:15+01:00

All lines on 21CN-REGION-L-NWS dropped at 2010-08-04 02:44:29
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 6 Aug 2010 10:04:15

BT have not informed us as to what caused this Blip

[Minor] Broadband: All lines dropped on 21CN-REGION-PR

2010-08-06T10:03:21+01:00

All lines on 21CN-REGION-PR dropped at 2010-08-06 02:02:56
We have advised BT
This is likely to have affected multiple internet providers using BT

Update 6 Aug 2010 02:53:07 All lines on 21CN-REGION-PR dropped again at 2010-08-06 02:51:58.

Update 6 Aug 2010 10:03:21

This was caused by PW135554

[Info] VoIP: Phone bill layout

2010-08-04T09:00:44+01:00

This month's telephone bills included (for most people) two separate sets of itemised bills for each numbers. One is the old call server and one is the new call server.

No calls are duplicated so the total amount is right, but the two sections have different layout.

In some cases the time periods overlap as some people had incoming calls on one server and outgoing on another.

We have moved all call routing and logging to the new call server now, so next bills should be tidier.

We have also made a few tweaks today to the way the itemised bills are presented for the new call server. This change is in the PDF layout so you can re-load the PDF from the accounts system to see the newer format for the existing bill if you wish.

The main changes are for number formatting - replacing +44xxxx and 44xxxx UK numbers with the more conventional national number format. We have also added spaces to area codes to make the numbers more readable. In the case of calls which are forwarded on to another number, this is now showing where the call was forwarded on to as well, so as to make the bill cleaer.

We aim to make the bills clearer over time.

[Info] Mobile: Mobile CLI tweaks

2010-08-03T16:28:14+01:00

There have been minor changes behind the scenes to finally fix the CLI issues we saw on mobiles when using prefixes (e.g. 9 for work number as a prefix). This is now sorted "properly" and the workaround we had in place removed. Any issues let me know on irc.

Update 3 Aug 2010 16:54:08

There will be a few minor tweaks this evening as well but they should not disrupt any calls.