Gradually, then suddenly...
That said, the most federalized country I can think of isn't Germany (where local government often trumps federal) but Switzerland, where they don't actually have a capitol, exactly. Geneva's more of a 'first among equals', national offices are scattered among the cantons.