A huge amount of durability comes from the initial primer. After all, that is the paint to object layer that will need to bond strongest to keep the paint in place.
In my experience the best primer for adhesion and handling resistance is that produced for the automotive industry. In this case you are looking for bonding to a metal part, and automotive primers are designed to resist wear and handling in pretty adverse and challenging conditions for the lifetime of a vehicle. I have metal wargames figures and well handled model railway stock primed with Halfords cellulose primer that have resisted handling for over forty years, and I’m sure modern primers are even better at this job.
For the top coat, I would say that, again, the best handling resistance comes from automotive paint, for the same reasons as the primer.
However, if you are talking about model paints, the handling resistance goes Cellulose (laquer), Enamel, Tamiya type acrylics, water based acrylics. Within those ranges, for maximum durability, gloss is more wear resistant than matt.
Water based acrylics are better in one respect. On flexible surfaces, being more rubbery in the dried state, they are able to bend with the surface as it moves. Enamels are not flexible and crack off, as anyone that painted
Airfix polythene figures back in the day will testify.
I have not included Artist oil paint, as the drying time alone will preclude it from this use. When properly dried though it’s as tough as old boots
