Collaborative project: Platform for Quality Evaluation of Mobile Networks
A preceding issue announced that the project would get underway in January 2014. We take this opportunity to report on its progress and to inform you of a few achievements. To refresh your memory, the project’s mission is to define the reference systems in France and in Europe for measuring the perceptual quality of mobile networks and services. This project is backed by the competitiveness cluster, Systematic, the French government via its FUI interministerial fund (BPI France and the French ‘DGE’ directorate), as well as by the Ile-de-France region.
The 9 partners in the project (Orange, Altran, Next Interactive Media, GenyMobile, Data Publica, HEC, INRIA-Orpailleur and UPEC-Lissi) under the leadership of ip-label have moved forward as planned on the project’s various themes.
To date the consortium has:
- measurement tools to test the capacity of mobile networks, in the form of mobile apps developed for Android and iOS. These tools have been assessed within the consortium and show very good results in their ability to test THD mobile networks (in particular 4G LTE-CA). This tool will soon be available as a free download in the app stores Apple Store and Google Play.
- tools for testing the video quality of live and VoD transmissions available on community platforms (YouTube, for instance).
- powerful interfaces for viewing results and querying data for first-stage analysis.
- test scenarios for setting up a series of subjective analyses to work on models for evaluating the quality of mobile video (mobile video MOS) in order to then process correlations between QoE and QoS at the level of operator indicators.
- information related to European regulatory directives about the protection of privacy.
Already the first network quality measurement campaigns have been led, notably by our partner HEC. This has made it possible to test the reliability of the measurement apparatus. The density of tests conducted in the city of Paris (see map below) yielded extremely precise results. This provided good visibility into the operation of the various operators’ networks.
Fig. 1: measurement of networks in Paris
The heat maps show coverage areas where lower speeds appear. The areas outlined in red show the weaknesses of one operator’s 4G network.
Fig. 2: weak areas in the 4G network
Measurements in the suburbs of Paris clearly show the much lower speeds of solely 2G/3G coverage.
Fig. 3: lower speeds in the suburbs
The map of mobile latency shows rather high latency overall.
Fig. 4: map of mobile network latency
New 3D data visualization engines within a web browser are also being developed, as well as a rule engine for querying the data warehouse.
Fig. 5: 3D query engine developed by the INRIA
Fig. 6: 3D query engine developed by the INRIA
Fig. 7: rule engine developed by the INRIA
The project is very promising, and we are confident in the partners’ ability to spur forward the state of the art of quality measurement of mobile networks and services.
CTO & Deputy General Manager