major feedback: use setopt instead of setq to set user options. This yells at your face if you make a type error.
I was wondering if you misunderstood what require is but you had use-package right after. But you can remove the (require 'rainbow-delimiters) and the following face changes if you use use-package's :face(?) keyword.