Officials insist visitors are unlikely to be affected but rights groups say "it will be a problem".