Good question, I would like to know this too.
Oh, and I found this on the Civilizations page:
"You can switch for free after doing the tutorial with Richard the Lionhart, yes. After that, you can do it whenever you'd like, but you have to pay 500 gold. "
Still curious about penalties.