That perspective you highlight, which is indeed the New Atheist viewpoint, is anti-scientific.
All the best philosophers of science share the idea that there is no objectivity, only ideas which are presently unfalsified.
We can only know through negation.
Nothing about the external world can ever be "true." It can only be false, possibly false, and not known to be false.