Minority and unemployed voters were more likely to be turned away, the Electoral Commission suggests.