The number seeking to escape violence and political strife in the United States is small but growing