I did try using a killer expensive network switch HP 1810-8G (which I borrowed to test the cable), and everything connects fine, so the cable seems to be working fine
This would seem to point to your inexpensive rubbish switch. Get a decent switch such as Netgear, HP