“But they can see them”
Neither optical analysis, lidar or surface directed sonar is going to inform the system of a pothole under surface water or ice.
The country is wet for 50% of the year.
“They can avoid suspected road surfaces”
Many roads in the UK are only wide enough for a single car, despite not being one-way.
“They can avoid areas with reported potholes”
Then you might as well walk.