Charting Fibre speed over time.

gfmalan

Expert Member
Joined
Nov 11, 2013
Messages
2,676
@gfmalan it is your call but can we let the test run for the day. We now have 3 test sites showing similar issues using diffrent carriers. The data is starting to form a picture.

Jip, more than happy, I'll be using ADSL for my normal network, this test is important to me.
 

PBCool

Cool Ideas Rep
Company Rep
Joined
Jan 11, 2016
Messages
13,304
@gfmalan it is your call but can we let the test run for the day. We now have 3 test sites showing similar issues using diffrent carriers. The data is starting to form a picture.

No picture formed as yet, if these issues were across the network of thousands of users it wouldn't be usable. Octotel has had known issues the past few days.

JHBCT.jpg

This is our smokeping graph for the past 10 days, which is from the same hosted environment in JHB where our Speedtest server is hosted to the edge where Octotel and Frogfoot meet.
 
Last edited:

Armizael

Senior Member
Joined
May 31, 2006
Messages
642
So here's my test results for the past 7 hours:

http://imgur.com/a/3gAoR

Looks like ping is all over the place, but speed is looking fairly good, save for one dip which looks like my phone was downloading updates at the time.

I'm wondering if the speedtest-cli ping isn't too reliable - see my results when pinging the CI randburg speedtest server:

Ping statistics for 154.0.13.125:
Packets: Sent = 81, Received = 81, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 22ms, Maximum = 103ms, Average = 32ms

It spiked up to >100ms once or twice, but the average is still 32.
Don't know what to make of that.

I'll keep the test running and see how it goes through the day.
 

PBCool

Cool Ideas Rep
Company Rep
Joined
Jan 11, 2016
Messages
13,304
So here's my test results for the past 7 hours:

http://imgur.com/a/3gAoR

Looks like ping is all over the place, but speed is looking fairly good, save for one dip which looks like my phone was downloading updates at the time.

I'm wondering if the speedtest-cli ping isn't too reliable - see my results when pinging the CI randburg speedtest server:

Ping statistics for 154.0.13.125:
Packets: Sent = 81, Received = 81, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 22ms, Maximum = 103ms, Average = 32ms

It spiked up to >100ms once or twice, but the average is still 32.
Don't know what to make of that.

I'll keep the test running and see how it goes through the day.

Yeah that ping graph cant be accurate, if your average via a regular ping was 32ms but the graph says your lowest ping was 60ms? There is a fault on gfmalans link with huge packet loss. Chatting to Octotel about the line.
 

jacof

Well-Known Member
Joined
Aug 26, 2015
Messages
162
I agree that the ping may not be correct, traceroute does show me similar times but it could be wrong. I know the download is correct as I can compare the speed I see on the router (the mikrotik pppoe wan port) with the test results I get.
 
Last edited:

jacof

Well-Known Member
Joined
Aug 26, 2015
Messages
162
But again if I do a tracert I see very long times between 192.168.11.2 en 154.0.2.37

Tracing route to 154.0.13.125 over a maximum of 30 hops

1 <1 ms <1 ms <1 ms 10.64.9.20
2 * * * Request timed out.
3 35 ms 35 ms 32 ms 192.168.10.1
4 * 170 ms 51 ms 192.168.11.2
5 134 ms 135 ms 112 ms 154.0.2.37
6 5 ms 4 ms 4 ms 154.0.1.65
7 5 ms 5 ms 4 ms 154.0.2.162
8 5 ms 5 ms 5 ms 154.0.13.125
 

jacof

Well-Known Member
Joined
Aug 26, 2015
Messages
162
And on Linux using -I using ICMP I see this

sudo traceroute -I 154.0.13.125
traceroute to 154.0.13.125 (154.0.13.125), 30 hops max, 60 byte packets
1 router (10.64.9.20) 10.759 ms 10.592 ms 10.547 ms
2 * * *
3 192.168.10.1 (192.168.10.1) 19.019 ms 18.964 ms 18.922 ms
4 192.168.11.2 (192.168.11.2) 18.806 ms 18.761 ms 18.730 ms
5 154.0.2.37 (154.0.2.37) 18.685 ms 18.632 ms 18.570 ms
6 154.0.1.65 (154.0.1.65) 18.516 ms 11.511 ms 11.033 ms
7 154.0.2.162 (154.0.2.162) 10.667 ms 8.571 ms 8.442 ms
8 154.0.13.125 (154.0.13.125) 8.362 ms 8.289 ms 8.220 ms
 

PBCool

Cool Ideas Rep
Company Rep
Joined
Jan 11, 2016
Messages
13,304
But again if I do a tracert I see very long times between 192.168.11.2 en 154.0.2.37

Yeah which is the IPC handoff, but either way to the destination the latency is fine.

You are picking up 10ms of latency at your routers hop with the linux machine which is arb.
 

jacof

Well-Known Member
Joined
Aug 26, 2015
Messages
162
It is over wifi. I now forced it over the nic.

sudo traceroute -s 10.64.9.146 -I 154.0.13.125
traceroute to 154.0.13.125 (154.0.13.125), 30 hops max, 60 byte packets
1 router (10.64.9.20) 3.992 ms 4.027 ms 3.968 ms
2 * * *
3 192.168.10.1 (192.168.10.1) 8.016 ms 7.969 ms 8.088 ms
4 192.168.11.2 (192.168.11.2) 7.797 ms 7.696 ms 7.784 ms
5 154.0.2.37 (154.0.2.37) 8.147 ms 8.074 ms 8.530 ms
6 154.0.1.65 (154.0.1.65) 9.315 ms 39.038 ms 38.746 ms
7 154.0.2.162 (154.0.2.162) 34.430 ms 34.331 ms 34.256 ms
8 154.0.13.125 (154.0.13.125) 34.725 ms 34.654 ms 34.590 ms
 

jacof

Well-Known Member
Joined
Aug 26, 2015
Messages
162
I have now seen that if I run the speedtest in the browser and then the command line after that then the ping will be fast. If I leave it for the 10 min the ping is slow again. I will see if I can find something why it is doing that. It may be a bug in the code, not saying it is, I will ask on Git what can be the issue. I will see if I can find something. But ping is not our problem, it is the downloads that dip.
 

Armizael

Senior Member
Joined
May 31, 2006
Messages
642
Latest graphs:

http://imgur.com/a/z9TqA

Seems like I get some drops as well, but it's not too bad, here and there.
I've set up a smokeping docker container to track the latency to the CI Randburg Speedtest server, so I'll let that gather up some data as well, since the speedtest-cli latency results simply aren't accurate.

I'm going away for the weekend, but I'll leave both running so we can get some results over a longer period - I'll post my results on Sunday when I'm back.

Edit: Before I forget - I still have one of those old Mikrotik hapLITE models that only have 100mbps ports, so it's understandable I don't get the full 100mbps. I haven't been arsed to upgrade yet as the difference will be minimal.
 

jacof

Well-Known Member
Joined
Aug 26, 2015
Messages
162
OK we can ignore the speedtest-cli ping.

"Inconsistency

It is not a goal of this application to be a reliable latency reporting tool.

Latency reported by this tool should not be relied on as a value indicative of ICMP style latency. It is a relative value used for determining the lowest latency server for performing the actual speed test against."

We are testing against a selected server so the ping value is then not used in our case.
 
Last edited:

PBCool

Cool Ideas Rep
Company Rep
Joined
Jan 11, 2016
Messages
13,304
OK we can ignore the speedtest-cli ping.

"Inconsistency

It is not a goal of this application to be a reliable latency reporting tool.

Latency reported by this tool should not be relied on as a value indicative of ICMP style latency. It is a relative value used for determining the lowest latency server for performing the actual speed test against."

We are testing against a selected server so the ping value is then not used in our case.

It would be interesting to throw in someone using Active Ethernet, because OS, Octotel and Frogfoot are all PON.
 

jacof

Well-Known Member
Joined
Aug 26, 2015
Messages
162
I have now configured a Ping Sensor on my PRTG system to ping the CI test server

ciping.JPG


I also setup a cloud ping sensor that will ping the server from around the world.

cicloud.JPG
 

jacof

Well-Known Member
Joined
Aug 26, 2015
Messages
162
Here are the ping charts so far, should those spikes be there ?
Remember the network monitor does 5 pings and uses the best ones.

Ping

ping.JPG


Http Ping

httpping.JPG


Global Ping

cloudping.JPG
 

PBCool

Cool Ideas Rep
Company Rep
Joined
Jan 11, 2016
Messages
13,304
Here are the ping charts so far, should those spikes be there ?
Remember the network monitor does 5 pings and uses the best ones.

Ping

ping.JPG


Http Ping

httpping.JPG


Global Ping

cloudping.JPG
The spikes aren't there on the core network, so no.
 

jacof

Well-Known Member
Joined
Aug 26, 2015
Messages
162
Paul not sure what you did but the network seems a lot more stable from yesterday around 4pm. I have not seen any big dips in speed on my end and the other test site is also stable at this stage. We will still monitor for the rest of the weekend.

When you say the spikes should not be there then what is causing it. Before you say it is OS, we see the same spikes from the other sites around the world pointing to that server via the global cloud ping. They are not all on the OS network. The only thing in common is your network.
 

Seeyou

Expert Member
Joined
May 1, 2007
Messages
2,705
Paul not sure what you did but the network seems a lot more stable from yesterday around 4pm. I have not seen any big dips in speed on my end and the other test site is also stable at this stage. We will still monitor for the rest of the weekend.

So around the time everyone goes home for the weekend? :)
 
Top