Service History
| Date | Time | Description |
| 3/13/2003 | 8:05:00 PM | There is a problem on the Main TV Mast on Hayclose Road. At approx. At 19:53 our monitor server detected the failure and attempted to reset the remote end. As this was not possible, after repeated attempts, an engineer was paged at 20:04. He is currently on the way to the mast to investigate the failure |
| 3/13/2003 | 8:40:00 PM | There appeared to have been a sustained power failure lasting around 40 minutes to the main RADNET link. The current backup circuits are only able to maintain power for 20 minutes so the service was lost for around 23 minutes. We have decided to investigate the possibility of a 2Mb backup feed to the site. |
| 3/14/2003 | 9:30:00 AM | We will be further investigating the failure of Thursday evening to try and establish the cause and determine steps to prevent a re-occurance. |
| 3/15/2003 | 5:56:00 PM | We are still suffering service outages approximately once a day. Currently the only solution is to physically power off the radio equipment at the Hayclose mast and power back up again. Inexplicably, resetting via the software interface does not cure the problem. We are currently re-writing the firmware code to more fully reset the hardware during a reset cycle so that this problem can be eliminated. Once completed, service outages can be reset within 16 seconds. |
| 3/18/2003 | 9:00:00 AM | There will be several extended periods of RADNET service outage as we re-configure several of the service sprays, and strengthen the main feed to the main Kendal mast. Customers utilizing the WEST feeds will not be affected. |
| 3/22/2003 | 11:28:00 AM | We have a report that East1 is not visible again. However, at this time, only 1 user has reported this so it may be incorrect information. An engineer will be doing a signal survey later today. |
| 3/24/2003 | 6:00:00 PM | We will be experimenting with a higher speed link in preperation for Endmoor/Summerlands/Gatebeck/Docker/Old Hutton/New Hutton and surrounding areas coming on line. During this period additional carriers will become visible. Customers should NOT attempt to use these carriers as they are not permanent. Service will be unaffected. |
| 3/25/2003 | 10:24:00 PM | We have been trying to sort the problems with East1 and East4. This may have caused interuption to the service to ALL customers. Appologies for the inconvenience. We have finally discovered there are 3 different faults causing the extended outages. |
| 3/29/2003 | 10:00:00 AM | There is currently a global routing problem affecting trans-Atlantic sites. This would appear to have been going on since around 7PM last night. We stress that this is NOT a problem with our dialup, broadband, or freedial services, it is a problem at an IX exchange point. Customers will be able to view UK hosted sites (Note that not all .co.uk sites are actually hosted in the UK though) but not any sites in America. This problem is affecting all but the very largest UK ISPs who have their own Trans-Atlantic links. We have been unable to get an update on this problem, because the ORANGE phone network is also experiencing problems meaning that the Tech.numbers for our LINX-telehouse based support company are also non-functional. It never rains, it just POURS!!!!! |
| 3/30/2003 | 1:30:00 AM | State sites seem to have settled down a bit, and everything now seems back to normal. |
| 4/5/2003 | 6:00:00 PM | We will be upgrading the East transit link this evening to 22mb/s. Users of RADNET EAST and WEST will be unable to use the service for a period of around 1 hour. Users of Central will be unaffected. |
| 4/6/2003 | 12:01:00 AM | The main RADNET transit has now been upgraded to 22mb/s. Appologies to all users who would have been unable to connect for a few hours yesterday evening. Everything is now fully functional, and should be noticeable quicker and more consistent |
| 4/16/2003 | 7:00:00 PM | The RADNET system will be completely down, as will email and some hosted sites for a period of around 20 minutes this evening to allow us to upgrade our bandwidth control system. It has been noted that a few users have somewhat abused the system by using certain techniques to get more than their subscribed 1Mb/s service. This has resulted in other subscribers getting less than their fair share. The new control system will cut bandwidth to just 56kb/s for a period of 3 hours when it detects these practices, appologies to the guilty but it just isn't on, and you know who you are. The result of this change should be a more consistently quick service for the users who play fair. |
| 4/19/2003 | 10:30:00 PM | The VPN-SERVER has now been upgraded to allow transaction logging and Quality Of Service provision. This will allow us to police bandwidth useage, and effectively "share" the system more effectively. Users will now get a fairer share of bandwidth, with higher users being capped when others are on-line. |
| 4/19/2003 | 10:30:00 PM | There is currently a routing problem occuring on our primary telehouse link. Websites may be slightly slow as we are currently only able to utilise our backup (2Mb/s) line. Engineers are currently working on the problem. |
| 4/24/2003 | 8:00:00 PM | The WEST transit will be upgraded to 22mb/s to match the EAST service. This will mean the service will be unavailable for a period of around 1 hour. Once completed, the WEST service should be noticeable quicker and more consistent. |
| 4/29/2003 | 8:30:00 AM | Due to yesterdays power surges we are currently experiencing problems with our mail server. One of the hard disk drives was affected by the surge. We are replacing the drive at the moment and restoring all backups. This problem will be rectified as soon as possible. |
| 5/8/2003 | 10:00:00 AM | We have just been informed that our main transit provider, Intensive Networks has gone into liquidation and that they will cease the service on the 9th May. This gives us just 18 hours to arrange alternative bandwidth, which is impossible. Although we are multihomed, and services will therefore continue unaffected, we have effectively lost a large slice of bandwidth, we therefore expect our broadband services to run much slower than normal over the next few weeks. We have already ordered a replacement 8Mb/s feed, and the current expected installation is in 56 days. Appologies for this state of affairs, but it is completely out of our hands. |
| 5/22/2003 | 10:00:00 AM | We are experiencing, as are many internet providers, mail problems due to the much publicised MailMining hack. Basically, Emails are sent to every email address in the range 00000000000 to zzzzzzzzzzz @ everyprovider, and "unknown email address" responses are used to mark the address as none existent. If no response is received, then the address is assumed to exist. We are unable to block the attack because it is performed via several thousand badly configured private proxy servers meaning that each request appears to originate from a different IP address. Our mail servers have therefore been struggling under the load of 10s of thousands of emails every single hour for several days now, meaning that genuine emails are delayed. Such is the problem that Bill Gates was featured on CNBC news yesterday evening expressing his concern over the problem and discussing ways to tackle the rapidly increasing amount of SPAM on the internet. The attack is currently up to the G's, so we expect the problem will cease in approximately 4 days. In the meantime, we will be introducing a new much faster mail server into the cluster this weekend which will be able to handle 10 times the throughput, and hopefully therefore reduce the effect of this attack. |
| 5/23/2003 | 11:00:00 AM | The Main Kendal Transits will be upgraded to a new 54Mb/s carrier today. We expect East to be down for around 30 minutes, and West for around 1hour 30 minutes to enable this work to be carried out. We appologise for any inconvenience. The net result should be a dramatic increase in the speed of user to user communication and will give us the ability to introduce 3.5Mb/s and 5.5Mb/s services in the near future. |
| 5/28/2003 | 11:00:00 AM | It has come to our attention that several users have re-enabled file and print sharing over their radnet connection. Users should be aware that doing this without enabling relevant security will render their machine viewable to other internet users anywhere in the world. If you are unsure if you have your settings correct, please call 01539 724564 whilst you are in front of your machine so that we can check them with you. |
| 5/29/2003 | 3:00:00 PM | We currently have a fault with our phone lines, BT are currently investigating a fault on our ISDN lines. Appologies for any inconvenience. Customers may call Kendal Computer Centre on 01539 721284 as we have arranged for calls to be taken in their workshops for the time being. |
| 6/4/2003 | 2:07:00 PM | The Mail Server is currently down so that the machine can be replaced. Users will not be able to retrieve mail for the next 1.5 Hours. Appologies for any inconvenience, but we expect the new machine to be less effected by incidents such as the recent mail mining attack |
| 7/24/2003 | 10:00:00 PM | Due to electrical interference from nearby storms, connectivity to Kendal Hayclose and Old Hutton was lost for approximately 46 minutes |
| 7/27/2003 | 9:00:00 AM | All RADNET accounts were disabled temporarily for approximately 30 minutes whilst we carried out testing at the Hayclose Mast, Kendal. As a result, the EAST3 spray was found to be out of specification and was reset. |
| 7/28/2003 | 6:00:00 AM | One of the hard drives in Domainshost2 failed. Although Fault Tolerance allowed the server to continue running, Operating system attempts to recover bad sectors resulted in a reduction in performance of about 50%. The machine was taken down at 11:30am for the drive to be replaced, and some web sites, including this one, would have been down for just under 1 hour. Appologies for any inconvenience. |
| 7/28/2003 | 3:00:00 PM | The Old Hutton RADNET system will be off-line for a period this afternoon whilst we attempt to improve the reliability of the feed to this mast. Appologies for any inconvenience this may cause |
| 7/29/2003 | 9:05:00 PM | There is a routing problem affecting our connectivity to the states and some UK sites. Our primary transit provider is investigating, but unfortunately the nature of the problem means that backup routes will not function as intended. This is a level 2 fault, and may take some time for them to fix |
| 7/30/2003 | 1:00:00 AM | A second hard drive in Domainshost2 failed today. Because it seems very co-incidental that it should fail just 1 day after another drive, we've pre-empted a possible re-occuring fault by ordering a complete new hard drive sub-system. Domainshost2 is running again, but with disabled fault tolerance. The drive sub-system will be replaced Friday morning |
| 8/1/2003 | 10:00:00 AM | The drive sub-system in DH2 will be replaced this morning due to recent unreliability of the machine. Web sites will be unavailable for around 2 hours whilst the machine is ghosted then restored to the new drives. Appologies for the inconvenience this will cause, but we need to get it done to ensure against future problems. |
| 8/13/2003 | 10:00:00 AM | The RADNET system is suffering interference from somewhere causing congestion and general slowness. Although most users are still managing to achieve around 800Kb/s, many are struggling to reach just 300Kb/s. We are investigating the problem. Appologies, but we will need to change channel numbers and may even change the SSID so users will find the system intermittent. We will do our best to restore the service as soon as possible |
| 8/15/2003 | 11:58:00 AM | We have discovered that a certain individual or group are transmitting a signal externally to their premises with the SSID Kencomp-RADNET-Hayclose2. We can only assume that this serves 1 of 3 purposes :- 1 to deliberately cause us disruption, 2 an attempt to hack into our system, or 3 to trick people into connecting to the false service so that access can be had to the customer's machine. All purposes are malicious and will be treated as such. Both the name Kencomp, and word RADNET, are registered trademarks of Kencomp Internet LTD, and as such, we are able to take legal action against the culprit for broadcast of these trademarks with intent to pass off. |
| 8/16/2003 | 10:00:00 AM | Significant testing, and driving around with a low gain antenae allowed us to pinpoint 2 problems with the RADNET service last night. We have now managed to track the person causing problems to an approximate area, but unfortunately the signal stopped before we were able to pinpoint the street and then building responsible. We are continuing to track this lunatic. We also have discovered that the main feed to Hayclose is only running at 3.5Mb/s instead of the intended 7Mb/s. This is probably down to a faulty antenae, but unfortunately it is atop a 30 foot rooftop mast which needs to be taken down to replace. We will be re-aligning the mast tomorrow (Sunday), but will not be able to replace the suspect unit until next week. Appologies for any inconvenience |
| 8/22/2003 | 10:00:00 AM | We will be replacing the main Hayclose Feed unit today because of losses on the existing unit. We expect an outage of around 2-3 hours. Service speeds should hopefully increase noticeably following completion of the works. |
| 8/22/2003 | 6:00:00 PM | The Hayclose Feed unit has now been replaced, but dissapointingly, it has not had the expected effect. Speeds are now peaking at around 4Mb/s, nowhere near the normal 7Mb/s, and only a slight improvement over the 3.5Mb/s we were getting before we replaced it. Whilst atop the pole however, we did notice some serious scaffolding atop the tower block opposite us. This is in the direct path of our feed and will therefore be causing interference. Interestingly, it turns out it was erected 13 days ago, which was the same day the problems began. We are trying to get a completion date for the works so that we know when we can expect speeds to return to normal. |
| 9/5/2003 | 10:00:00 AM | We have been informed that the scaffolding atop Sandaire House will be removed within the next 2 weeks, so speeds of the Hayclose feed should return to the full 7Mb/s at last. Regarding the problems with our transit provider, we should have a new 10mb/s feed installed by the week commencing 15th September, at which point we will dump the existing 8mb/s. As it was our original intention to obtain an additional 10Mb/s, not a replacement, we will then have to source another 10mb/s from somewhere so that we have a total of 22mb/s over 3 different transits. However, the new 10Mb/s should make a huge difference as the existing 8 is rarely managing 1.5Mb/s. |
| 9/15/2003 | 11:00:00 AM | The 10Mb/s feed from Telewest was successfully tested this morning and the line is now on performance testing for a period of 96 hours. At the end of this period, the line will be fully commissioned and it will be available as bandwidth for our customers. |
| 9/16/2003 | 11:00:00 AM | The scaffolding atop Sandaire house has not been moved or removed as promised. We will be visiting the foreman again this morning to try and expediate the promised action. |
| 9/19/2003 | 6:00:00 PM | The new 10mb/s feed circuit has successfully passed it's reliability testing, but due to unforseen circumstances at Telewest (They won't actually tell us what) we are unable to establish a peering session to enable the bandwidth to be used. We are awaiting the return of a senior engineer later this week to find out what the issue is and when a resolution will be found. |
| 9/22/2003 | 5:00:00 PM | Fitting of the new 10Mb/s Microwave up at Hayclose went according to plan, other than persistent rain which made the job exceedingly unpleasant. Testing from the other side of Kendal produced speeds of 9.5Mb/s and 8.7Mb/s reliably in the pouring rain, very encouraging. Fitting of the other unit atop our building is on schedule tomorrow, meaning that the link should be active by tomorrow (Tuesday) evening as planned. The link to Crosslands is however NOT so "on schedule". The recent hurricane in the States has delayed shipment of the second set of Microwave bridges meaning that we are now not able to fit them tomorrow/Wednesday as planned. The install date has therefore had to be shifted until they arrive. We will know by 4PM tomorrow when they will be arriving, and will then post the new installation date. |
| 9/30/2003 | 9:00:00 AM | A new microwave link is being installed between Crosslands (Old Hutton) and Kendal. No interuption to services should occur |
| 10/1/2003 | 9:00:00 AM | The new link will be configured and tested today. This should provide 8Mb/s reliable feed to Crosslands enabling all users of the Crosslands mast to get decent speeds and connectivity |
| 10/1/2003 | 6:00:00 PM | The new microwave link to Crosslands is now configured and functional. It does however required some precise alignment to achieve the full 8Mb/s, it is providing just over 3Mb/s at the moment. There is however no packet loss at all which is the reliability we were looking for. The sprays continue to bounce making customer connections to Crosslands a little patchy, we will be investigating this further tomorrow (Thursday) and hope for a complete solution by around 10PM tomorrow. |
| 1/9/2004 | 5:00:00 PM | The main 10Mb/s feed from Telewest just failed in an outward direction. This appears to be a routing problem within their network but we are unable to raise anyone with enough technical ability to solve it. We have been told that someone should be in around 9:15am Monday who will be able to help! Magnificent!!! In the meantime we are running solely on the backup 2Mb/s line. As normal traffic is around 3.5Mb/s, this will obviously cause congestion problems. To help relieve the situation, and protect our hosting services somewhat, we have therefore restricted outbound flow on our broadband service to just 200Kb/s. This should not majorly affect WEB browsing or email, but will unfortunately have a rather massive effect on filesharing/online gaming type applications. |
| 1/27/2004 | 2:05:00 PM | There is a power cut over at Endmoor, which has obviously effected our Crosslands Broadband service. Everything should restart and service resume automatically once power is restored. |
| 5/14/2004 | 12:00:00 PM | There has been Power maintenance work up at Hayclose mast in Kendal all this week. We are expecting an outage between 12am and 5pm today. We have a generator on-site but have to rely on the power engineers to switch it on/off as required. Hopefully, the 1 hour grace period provided by our UPS systems should prevent any outages but as the saying goes "the best laid plans" |
| 6/19/2004 | 12:21:00 AM | Telewest has suffered a major router failure at Telehouse Metro. This is resulting in large packet loss which will be apparent in a slowness of external web sites and email. They are working on a solution, and we are hoping that it will be resolved on Tuesday 22/06/04. We will post an update when available |
| 6/20/2004 | 5:30:00 AM | One of the hard disks in secure host is currently failing, we are in the process of migrating all web sites on this server to the new DH3 machine. This should not cause problems due to RAID systems, but there may be periods of around 2-3 minutes of outage for some web sites as we continue with the migration. |
| 6/20/2004 | 4:21:00 PM | Our main feed to the Hayclose mast in Kendal failed during the lightning storm. We have moved to the backup 2.4GHz link but this is much slower than the original. Customers using the RADNET Hayclose sprays will notice slow responses and intermittent "Page not available" errors. If we could ask customers to refrain from file sharing at the moment this should ease the situation |
| 6/21/2004 | 1:00:00 AM | Could we again request that customers using the Hayclose sprays refrain from file sharing activity at the moment to relieve some of the load on the backup Hayclose link until we are able to replace the main bridge units linking the Hayclose mast |
| 6/22/2004 | 9:00:00 AM | The Telewest router has been replaced, routing is gradually being rebuilt, we expect return to normal speeds towards the end of tomorrow. In the meantime, we again appologise for any inconvenience. |
| 6/22/2004 | 9:00:00 AM | Post, the outgoing SMTP server is suffering a spam attack at the moment. We are in the process of introducing a new more capable machine to try and solve the timeout problems experienced by customers sending larger emails. We are also experimenting with a new mail server with intelligent anti-spam facilities. This will be made available to customers with their own domains once we are sure it is solid. |
| 7/1/2004 | 1:30:00 AM | The new Post server is running perfectly and has now been commissioned. A few customers have been trialing the anti-spam facilities with startlingly good results. We have therefore decided to purchase this anti-spam system and will be installing it over the next month or two. |
| 7/16/2004 | 1:30:00 PM | We have reports of difficulties connecting to the Hayclose services. We are currently investigating. |
| 7/20/2004 | 5:20:00 PM | It seems as though there has been a Vodafone installation on the Hayclose Mast that encroaches on our array space (Technically it is right in the Fresnel Zone of the sprays). The installation was placed 1M higher than planned due to existing antenaes preventing installation as intended which is why we now have a problem. We are consulting with the mast owners over solutions, either our installation is raised 1M, or the Vodaphone one is lowered 1M. Both solutions will take a few days to implement, appologies to our subscribers but it is not our doing and all we can do is work as rapidly as possible to resolve the issue. We will post any further details on this site as we get them. |
| 8/8/2004 | 8:40:00 PM | There was a brief power outage at Quarry Rigg but it returned approximated 8:54PM. Unfortunately, it went off permanently at 9:26pm. We currently have no time as to when power will be restored. |
Switch to Current Problems View Switch to Planned Upgrades View