For comparison and uptime estimates one can look at how many watt-hours (Wh) they provide and compare that to your device's consumption. If you have a 32Wh UPS and your router draws 10 watts on average you're looking at around 3 hours (real world usage is always a bit below the max capacity and batteries degrade over time too).
Looking at router power supplies can give one some idea of the wattage but these are always specced higher than regular usage - my router and ONT power supplies combined would suggest a draw over 20watts but they really draw under 10 watts combined.
I wouldn't go for the first device you linked, only 22Wh and for the price one of
these sorts of units has better battery capacity (32Wh) and more connection options, and if you check Takealot they can sometimes be found for low R500s, plenty of similar units listed there. The second unit you listed is 38Wh and seems better, but more expensive, not sure what battery chemistry it has.
Personally I would look for something with LiFePO4 cells even if it costs a bit more as they will last longer than many of these "lithium ion" (NCM) models and LiFePO4 models are becoming more widely available now.
Like one of these for example:
https://www.takealot.com/elecstor-18w-mini-dc-ups-12000mah-38wh/PLID91634882