Collaborative project: Platform for Quality Evaluation of Mobile Networks

March 17 2015 By Posted in Expertise

A preceding issue announced that the project would get underway in January 2014. We take this opportunity to report on its progress and to inform you of a few achievements. To refresh your memory, the project’s mission is to define the reference systems in France and in Europe for measuring the perceptual quality of mobile networks and services. This project is backed by the competitiveness cluster, Systematic, the French government via its FUI interministerial fund  (BPI France and the French ‘DGE’ directorate), as well as by the Ile-de-France region.

 

The 9 partners in the project (Orange, Altran, Next Interactive Media, GenyMobile, Data Publica, HEC, INRIA-Orpailleur and UPEC-Lissi) under the leadership of ip-label have moved forward as planned on the project’s various themes.

To date the consortium has:

  • measurement tools to test the capacity of mobile networks, in the form of mobile apps developed for Android and iOS. These tools have been assessed within the consortium and show very good results in their ability to test THD mobile networks (in particular 4G LTE-CA). This tool will soon be available as a free download in the app stores Apple Store and Google Play.
  • tools for testing the video quality of live and VoD transmissions available on community platforms (YouTube, for instance).
  • powerful interfaces for viewing results and querying data for first-stage analysis.
  • test scenarios for setting up a series of subjective analyses to work on models for evaluating the quality of mobile video (mobile video MOS) in order to then process correlations between QoE and QoS at the level of operator indicators.
  • information related to European regulatory directives about the protection of privacy.

 

Already the first network quality measurement campaigns have been led, notably by our partner HEC. This has made it possible to test the reliability of the measurement apparatus. The density of tests conducted in the city of Paris (see map below) yielded extremely precise results. This provided good visibility into the operation of the various operators’ networks.

Measurements network
Fig. 1: measurement of networks in Paris

 

The heat maps show coverage areas where lower speeds appear.  The areas outlined in red show the weaknesses of one operator’s 4G network.

 

Weak network areas
Fig. 2: weak areas in the 4G network

Measurements in the suburbs of Paris clearly show the much lower speeds of solely 2G/3G coverage.

 

Network
Fig. 3: lower speeds in the suburbs

 

The map of mobile latency shows rather high latency overall.

Network coverage
Fig. 4: map of mobile network latency

 

New 3D data visualization engines within a web browser are also being developed, as well as a rule engine for querying the data warehouse.

INRIA
Fig. 5: 3D query engine developed by the INRIA

 

INRIA
Fig. 6: 3D query engine developed by the INRIA

 


Fig. 7: rule engine developed by the INRIA

 

The project is very promising, and we are confident in the partners’ ability to spur forward the state of the art of quality measurement of  mobile networks and services.

 

William Rang
CTO & Deputy General Manager

Leave a Reply

Your email address will not be published