Could the co-signer on my car take my car even if I've been making all the payments and making them on time?

I've been making all the payments and I've been making them on time he's just trying to take the car because he's mad at me.