I've seen some folks make projects like this — they use a 3d game-like environment with points and lines and spring physics to do basic physical modelling synthesis (which is a whole rich category of software, ICYMI — but the 3d game-like env is a more recent progression)
Looked around for some half-remembered videos, didn't find the ones I had in mind, but if you search "3d physical modelling synth” you'll surely find some interesting stuff
Eg: https://www.youtube.com/watch?v=XmRJot6RnFE