You do not need to remove clusters or move the hosts out of the clusters before attaching them to the new vCenter server!
We have done migrations in the past (from one vCenter server to another) without this step and it worked fine.
In the new vCenter server you can also add the hosts directly to the clusters.
This works all fine ... unless you are using distributed switches! It's still possible then but requires additional steps.
- Andreas