It is claimed the UK's roadside wild flowers are suffering because of pollution and poor management.