Changing the network to as can be seen in the pic bellow seems to have fixed my issue. Two days now that is like that I haven't managed to replicate the issue. I will keep testing and let you know if anything else comes up. Also I have ordered a new switch, a cisco one, to replace the cheap one I got for future proofing 🙂
