Did I just make a big mistake?

Sounds like it's a little more than FWB to him and he's a bit jealous. It may be time to re-state the parameters of the relationship, and if he can't deal cut him loose. Or cut off the "benefits" and see if he still wants to be friends.