Correct, from what I understand it is due to the fact that you are using your identity, (something you are) and not a password (something you have). If you change your nsec (your login) then you are changing your identity.
While I would think it would be possible to develop procedures to link old with new, there would be a huge security risk doing so.
