What Icasa is hiding about network quality
The Independent Communications Authority of South Africa (Icasa) released a correction to its Western Cape Quality of Service Report on 3 June 2014, but it did not contain the full extent of the faulty information.
Icasa said that its original report inadvertently contained “some corrupt retainability measurement data, which indicated an incorrect number of drop calls”.
The regulator provided updated information for the Worcester route, adding that its erratum only relates to this information in the original report.
According to the new data, Vodacom and MTN’s retainability scores improved, while Cell C’s score declined.
What Icasa is not saying
What Icasa did not mention in its correction is that this data forms part of the full data set for the region, and it significantly changes the results in the Western Cape.
For example, Icasa previously stated that Vodacom’s call drop rate was worse than the regulated target. The latest information shows that this is false, but the regulator did not mention this.
In fact, even when Icasa was asked whether its faulty Worcester information did not influence the overall results it would not answer this question.
The following charts, which were produced by Icasa but not made public, show the extent to which the incorrect data influenced overall results.
Western Cape retainability results – old results
Western Cape retainability results – new results
Western Cape dropped call rate – old results
Western Cape dropped call rate – new results
More questions remain unanswered
Icasa has also been criticized for using strange routes for its quality testing. This includes routes in nature reserves where it is difficult for mobile operators to get permission to erect towers.
Some industry players argued that South Africans will find more value in these tests if it showed performance in areas where most citizens are using mobile services.
The regulator was asked about this decision, but again it would not answer this question.
It is not clear why Icasa is unwilling to answer questions about its testing methodology, and why it is not transparent about possible problems with its results.
What makes it even more perplexing is the regulator was warned that there are problems with its test monitoring system. Transparency may go a long way to resolve the problems.
More on Icasa QoS reports
Icasa messes up network quality report
Is SA’s mobile network quality good enough?
ICASA QoS results: Vodacom vs MTN vs Cell C
Loading ...