Yes, but let's be clear and say that they're no more, or less, dangerous than non-radioactive toxic substances.
Putting it differently: where are the deep geological repositories for arsenic, cadmium, mercury, etc, etc, etc? Sure, we also store that underground, but not in an overengineered DGR like Onkalo.