The Drifter seems relieved that you're still willing to talk to him after you heard everything he had to say.

As far as Drifter is concerned, the two of you are part of a crew now. If anyone crosses either one of you (and they likely will, given Drifter's extensive list of enemies)… well, he's got your back, and you've got his.