As of versions upto 2.1 it is not recommended to use it together with more than one TFS server. This support is only coming into version 2.1.1.
For Quality Center there is limitation of QC API which does not allow to connect from one server with certain version and patch level to another QC server with different version and patch level. If all servers are exactly the same version, more than one Quality Center servers can be used.