Paying the loan is not the trigger, giving 12 tokens is…I’m really not sure how you managed to trigger this @_@ He only leaves if you give him 12 tokens. Literally nothing about the loan is tied to the boss leaving. Did you somehow get 12 without finishing the additional quests??? Did some of them give you extra???