Bedford residents are less likely to have a nearby library than almost anywhere in the East of England, new figures show.