Wow, what is going in with the replies that don't separate out. It's bugging me.
As far as I know, every county in every state has a sheriff's office. Big example would be L.A., not every county is wall to wall cities and someone must cover the un-incorporated areas... that does not always mean rural. Nearer you big cities it is rarely that way but they do have sheriffs.
Yes, I agree that sheriffs are elected and that they represent the population that elected them. However, even if you travel to Chicago, you will find a pro-2A sheriff... hardly a clear representation of his constituents.
On the other side, when you have a City Council in charge of hiring a police chief, they seem to gravitate to those candidates that in their view are "best qualified to run the department". This is a different skill set and rarely do these guys come from real community policing. Rather many are simply educated, or have been politically active.
bb