Not necessarily.
There are two or three different types of "overseas departements and territories." St. Barth is a "collectivité" (but only since 2007) and has a governing council which gives them a certain degree of autonomy, though the territory is considered to be part of France.
Cheers,
Bev