Depends what you want to spend on accommodation and whether you want to hang around and just stop overnight for a breather.
Some great places I’ve stayed at on similar trips around the country.
Colesberg - Die Kleipot Guest House
★★★★☆ · Guest house
goo.gl
Cheap and cheerful with an unexpectedly good restaurant. Makes a good half way point. Not sure if there is much to see in the area I’ve only ever stayed there overnight.
River Destiny Lodge
★★★★★ · Lodge
goo.gl
Very near the first one but more of a stay for a couple of days and relax next to the river kind of vibe.
Olivier's Rust
★★★★☆ · Self-catering accommodation
maps.google.com
Other side on the border of the Eastern Cape almost but a very tranquil place just outside Oudtshoorn.