Is the order of the Arrow unfair?

Honestly, the elections into the Order of the Arrow are a popularity contest. Since that is true, the group is very elitist. The system around it, such as at summer camps not allowing non-members to do certain things, it seems like a cult. The order of the Arrow elections put lots of pressure on people, and younger scouts who don't know anyone just turn in blank forms with no-one chosen, causing the elections to not get anyone chosen. So my question is, is it unfair, and why?