The best source for lists of English (or anglophone) expat groups is through the Consulates in France - British, American, Canadian and Australian. I think all of these have lists of national groups and associations in France.

The other place to look (for a more varied group of people, including "newcomers" from all countries, including France) is AVF (Accueil des Villes Françaises) here: AVF -- Accueil - then search the "Annuaire" for local groups near where you live.

Many AVFs have functions and facilities for foreigners and French people alike, including language circles, hiking groups and arts and crafts workshops.

Other than groups like AVF, most clubs and associations are organized through the local mairie (town hall) or regional governmental offices. Often the towns will hold "association forums" in the early fall (September - when the kids are back in school) to promote their activities. Check the lobby of your nearby mairies (not just limited to the town you live in) - they should have a rack of brochures for the local groups.
Cheers,
Bev