I think it is pretty obvious that quality will significantly decline if free movement of people is removed. Mind you, even if we brexit, it is unlikely that immigration limits will be possible as we will need EU trade to stop our economy imploding.
For me, a constant stream of fresh new talent from the east is one of the EU's biggest benefits!