As the non-EU spouse of an EU national, you have the right to reside and work in any EU country with your spouse. Each country has its own registration process, though. The EU regulations only require each country to have a "facilitated" process for granting the non-EU spouse a residence permit in order to join their EU spouse.
But all bets are off if you are looking to join your EU spouse in the country of his nationality.
Your EU residency doesn't transfer unless you have lived in another EU country for at least 5 years. But you may still have some difficulty if your husband is maintaining his residence in Germany.