If you want to explore the embedding approach though, I’d recommend CatBoost as it does something similar with internal kNN matching.
It uses decision trees which should have better performance than a basic kNN, can accept other features as well, and is still lightweight to run
