I believe, what they can do is buy like crazy and mine. As the price goes up more holders will be willing to sell and they will control a big stack.
But to those who hold on will see it increase in value.
The Bitcoin in circulation will continue to be decentralized an scarier!