There is a difference between what is RIGHT and what is LEGAL. In this case the right thing is not to steal an extra 7-25% from a person in VAT charges - there is no moral reason why anyone should have that extra money especially not the government. What did they contribute to the product? He paid shipping. He paid for postage and packing. He paid for the product. It's theft but because the government does it - they have legislated it in but it is still THEFT - even if dressed up as law. The Nazis said Jews, gays, Gypsies, Poles, Czechs, Russians etc were sub-human and it was OK to exterminate them all - it was law too - it would also have been the 'right thing' to be a Waffen SS Hauptmann and shoot little children as part of your daily job.
The LEGAL thing is not to cheat because you could be fined or imprisoned if they find out. That's not the same as the RIGHT THING. The Right thing would be for governments not to rip people off like this. Instead those funds would go for other purchases and more jobs and income tax would be created - but the government 'knows best'.
Items purchased overseas with foreign countries' infrastructure should not bear VAT in country of destination.