not quite true. What the issue that came to a head on the matter was, that the cotton trade was making money hand over fist, but didn't have the manpower to keep up without more slaves being imported, they might have to pay workers otherwise.
And secondly the Industrial North was rapidly catching up in terms of trade and value and was grabbing all the available workers that were immigrating. Which meant the South was becoming less powerful in terms of influence.