StarTrinity.com

Measuring quality

IP networks performance research: 3G, 4G, wifi for VoIP and data

On this page we publish results of our research of IP networks. With StarTrinity Network Tester software tool we run tests over various 3G, 4G LTE, ADSL, FTTx, ethernet and wifi LAN networks. We measure quality, reliability, speed of the IP networks under simulated VoIP and data packets. The benchmark tests analyse network jitter, packet loss, MOS, round trip delay (RTT), download time, upload time under a certain load.

Mobile 3G/4G internet: Tele2 vs MTS vs Megafon vs Yota (Russia, Kazan) under VoIP traffic

We run VoIP traffic between our server and a laptop via wifi hotspot or USB modem and 3G internet connection. Results are different for the 4 operators:
Tele2 3G during 45 hours (wifi, 1 G.729 channel): uptime = 99.89%, worst MOS = 2.5, max packet loss = 6.94%
MTS 3G during 19 hours (wifi, 1 G.729 channel): uptime = 100%, worst MOS = 3.45, max packet loss = 16.34%
MTS 3G during 96 hours (USB, 1 G.729 channel): uptime = 99.94%, worst MOS = 2.41, max packet loss = 6.06%
MTS 3G during 96 hours (USB, 3 G.729 channel): uptime = 99.87%, worst MOS = 1, max packet loss = 27.94%
Megafon 3G during 24 hours (wifi, 1 G.729 channel): uptime = 100%, worst MOS = 3.89, max packet loss = 0.47%
Yota 4G during 1 hour (wifi, 1 G.729 channel): uptime = 0%, worst MOS = 1, max packet loss = 100%
Used hardware: laptop Samsung NP305E7A, smartphone ZTE V880E (Tele2, MTS, Megafon 3G), smartphone iPhone 5S А1457 (Yota 4G)
Conclusion: Tele2 and Megafon 3G mobile internet connection is good enough for one-channel VoIP calls with codec G.729

FTTx internet: Rostelecom (Russia, Kazan) under VoIP traffic

We run 10-channel G.729 VoIP traffic between our server and a server via ethernet and FTTx internet connection Results: Rostelecom from 2016-11-13 till 2016-11-29 (during 16 days)
uptime = 99.85%, worst MOS = 1, max packet loss = 100%

Mobile 3G/4G internet under HTTP/TCP data traffic

Various tests with continuous speed tester:
4G LTE mobile internet in moving car (Megafon)
4G LTE mobile internet in moving car (MTS)
4G LTE mobile internet in office, non-static position (Megafon)
3G mobile internet in office, non-static position (Tele2)
3G mobile internet in office, static position near window (Megafon, 100 hours)
3G mobile internet in office, static position near window (MTS, 141 hour)
4G mobile internet in office, static position near window (Beeline, 9 hours)
Conclusion: Internet speed test is not stable during a long test. There are drops of connection because of obstacles and without any obstacles for both MTS and Megafon. Average long-duration 3G speed is better for MTS if compared with Megafon.
Internet connection uptime
4G mobile internet in office, static position near window (Beeline, 36 hours) - SLA uptime = 98.46%, 18 outages, 33 minutes of downtime
4G mobile internet in office, static position near window (Megafon, 44 hours) - SLA uptime = 98.76%, 64 outages, 33.5 minutes of downtime
FTTx wifi internet in office, static position (Rostelecom, 9+6 hours) - SLA uptime = 99.9%, 64 outages, 23 seconds of downtime
Conclusion: with the internet connection monitor test we found out that 4G LTE internet connection is unreliable. wifi internet connection is reliable on same mobile device, using same firmware and software
Copyright 2011-2024 StarTrinity.com | Blog | Contact lead developer via LinkedIn |