That is true and a big worry...especially due to the incredibly huge life cycles of said waste and the generations of people that will have to look after it.
This explains it perfectly:
Into Eternity: A Film for the Future: Directed by Michael Madsen. With Carl Reinhold Bråkenhjelm, Mikael Jensen, Berit Lundqvist, Michael Madsen. A documentary on the safety of nuclear storage.
www.imdb.com
But so it the millions of tons of spent solar panels about to also enter the Earth's waste cycle........etc etc.
Humans need energy and the sun and wind is not enough....because we are too many people on this planet.
It is a conundrum indeed...but I'd rather take nuclear waste than billions of tons of plastic and "glass" and end of cycle batteries.