{"id":31654,"date":"2011-08-18T12:04:38","date_gmt":"2011-08-18T10:04:38","guid":{"rendered":"http:\/\/mybroadband.co.za\/news\/?p=31654"},"modified":"2011-08-18T12:07:05","modified_gmt":"2011-08-18T10:07:05","slug":"mobile-network-quality-icasa-versus-operators","status":"publish","type":"post","link":"https:\/\/mybroadband.co.za\/news\/cellular\/31654-mobile-network-quality-icasa-versus-operators.html","title":{"rendered":"Mobile network quality: ICASA versus Operators"},"content":{"rendered":"

The Independent Communications Authority of South Africa (ICASA)<\/a> recently published their ECS and ECNS compliance reports for South Africa\u2019s largest telecoms operators.<\/p>\n

As part of the compliance reports ICASA assessed the network availability statistics provided to them by the cellular operators.<\/p>\n

Vodacom<\/a> submitted that their network availability was 99.6% over the measured period, while MTN<\/a> said that they have always achieved a network service availability of over 99% in all areas of coverage and Cell C<\/a> showed an average network availability of 99.33%.<\/p>\n

These figures mean that the three cellular operators comfortably comply with the regulations which require operators to \u201c\u2026achieve an average 95% network service availability over a period of six (6) months\u201d.<\/p>\n

The statistics provided by the networks were however significantly higher than figures released based on ICASA\u2019s own tests.<\/p>\n

ICASA conducted a quality of service survey of the cellular operators in Gauteng, and published a document in July 2011 which showed that Cell C, Vodacom and MTN failed to meet the minimum requirements for Call Set Up Success Rate (CSSR) and Dropped Call Rate (DCR).<\/p>\n

\"Overall<\/a>

Overall Performance<\/p><\/div>\n

ICASA\u2019s testing methodology questioned<\/strong><\/p>\n

Many industry players raised questions about ICASA\u2019s testing methodology and the statistical significance of ICASA\u2019s testing sample.<\/p>\n

MTN said that they have identified and informed ICASA of a number of fundamental flaws pertaining to the methodology utilized by the regulator in the Quality of Service report.<\/p>\n

\u201cMTN believes that this test was done in isolation, sampled only a statistically irrelevant number of calls and does not reflect the overall quality of MTN’s network. In fact, the report does not even follow the criteria set down in ICASA’s own regulations,\u201d said Robert Madzonga<\/a>, MTN SA Chief Corporate Services Officer.<\/p>\n

\u201cBy ICASA\u2019s own admission their report is but a snapshot of the quality of the network over a very short period of time. No real conclusions can therefore be drawn from ICASA\u2019s essentially defective report as the methodology is not only scientifically unsound, but the imprecise results thereof is not an accurate reflection of the true quality of the MTN network.\u201d<\/p>\n

MTN says that they continually assess the quality of the whole network and believes that it meets not only world class standards but also the standards set by ICASA in their regulations.<\/p>\n

\u201cIn fact the compliance report as published by ICASA clearly indicates in the supplementary report (that is attached to the main report) that MTN is in compliance with the required regulations. It is important to note that MTN had provided evidence of compliance to ICASA even prior to the date of the first ICASA compliance report,\u201d said Madzonga.<\/p>\n

\"Mothibi<\/a>

Mothibi Ramusi<\/p><\/div>\n

Mothibi Ramusi<\/a>, Cell C’s Executive Head of Regulatory Affairs, points out that ICASA only conducted the tests for two months and also in limited areas \u2013 specifically in Gauteng and KZN.<\/p>\n

\u201cWe have requested a meeting with ICASA to discuss methodology and procedures. It is only fair to divulge the methodology once such a meeting has taken place,\u201d said Ramusi.<\/p>\n

Ramusi said that there are no issues with regards to tracking of performance, however, it must be an activity that is based on agreed principles and methods in order to avoid any misinterpretation and related clashes.<\/p>\n

\u201cIt is always advisable to agree upfront on key performance indicators and targets before embarking on such an activity. Activities must then be conducted against set targets,\u201d said Ramusi.<\/p>\n

\"Andries<\/a>

Andries Delport<\/p><\/div>\n

Vodacom CTO Andries Delport<\/a> says that the number of test samples is very low and is unlikely to be statistically representative of network quality.<\/p>\n

\u201cThe number of areas trialed is too few to be representative of the Gauteng province overall, and the network quality measured in these areas alone is unlikely to be representative of the entire province,\u201d said Delport.<\/p>\n

\u201cTo have more representative network quality results for an area, one needs to trial the area repeatedly, and cannot rely on the trialing of one day only.\u201d<\/p>\n

Delport points out that Vodacom measures the call setup success rate and call drop rate based on every single call in the network.\u00a0 \u201cBased on these statistics, the call drop rate in the network is far better than stated in ICASA\u2019s report,\u201d said Delport.<\/p>\n

Delport added that it is only the operators that can provide the statistics for every single call on the network. \u201cIf one also wants to include drive testing results, it is recommended that ICASA uses an independent third party that has a proven track record in doing such measurements,\u201d said Delport.<\/p>\n

ICASA responds<\/strong><\/p>\n

ICASA explains that they have done \u201csnapshot\u201d testing in a limited area which explains the difference in results.<\/p>\n

\u201cICASA is testing results are based on a short period of time hence the Operators results are done over six month period. ICASA\u2019s testing is aimed at replicating the subscriber\u2019s experience when making calls in a certain area at a given point in time,\u201d said ICASA spokesperson Paseka Maleka.<\/p>\n

\u201cIt is a small sample that is not representative of the entire network, rather the network only at a given point and time. The network operators are reporting on a much larger sample of their entire network over an extended period of time.\u201d<\/p>\n

\"ICASA<\/a>

ICASA Gauteng Cellular Network Testing<\/p><\/div>\n

Maleka added that ICASA has no reason to believe that the results provided by the operators are not correct, and that they would expect ICASA\u2019s aggregated results to be similar to the operators\u2019 results as their sample size increases.<\/p>\n

Maleka however defended their testing, saying that ICASA\u2019s testing procedure is valid, as it is a snapshot of the mobile service provider’s network performance, based on the specified routes during the time of day when the measurements were carried out and using a particular type of handset.<\/p>\n

\u201cThe Authority is confident of the methodology and the equipment used-as it is the same or similar equipment as used by the network operators. The testing is statistically valid as the numbers of samples are acceptable for a snapshot result,\u201d said Maleka.<\/p>\n

\u201cThe Authority expects that the confidence level will increase with the number of samples taken, giving us a more accurate reflection of overall network quality. These snapshot results cannot be viewed as indicative of the overall network quality.\u201d<\/p>\n

\u201cWe are continuously doing testing and would be publishing results quarterly of our testing, increasing our sample size and hence a reflection of the overall network quality.\u201d<\/p>\n

Maleka added that the data from their tests and the data provided by the operators themselves complement each other. \u201cThe operators should still declare their performance and ICASA would still conduct QoS testing for verification,\u201d said Maleka.<\/p>\n","protected":false},"excerpt":{"rendered":"

Operators slate ICASA\u2019s testing methodology, describing it as fundamentally flawed and statistically irrelevant<\/p>\n","protected":false},"author":2,"featured_media":31754,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[337,355,35,533,3268,42,1171,41],"class_list":["post-31654","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cellular","tag-andries-delport","tag-cell-c","tag-headline","tag-icasa","tag-mothibi-ramusi","tag-mtn","tag-robert-madzonga","tag-vodacom"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/31654"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=31654"}],"version-history":[{"count":0,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/31654\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/31754"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=31654"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=31654"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=31654"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}