RT-AC5300 High Ping Response Under Load

So not sure if I am overthinking it. I am setting up my new RT router today and I have had some weird issues with it dropping pings randomly. I did a few tests with a PC (Wired) and iPhone. Doing a speed test while the constant ping is running I am getting high response times mostly during the upload. Download I may see a single ping higher than 1ms, when the download starts it spikes to 100+ ms easy.

So to see if it was just my PC, I left the ping running and did the same thing from my...

RT-AC5300 High Ping Response Under Load