How small is the bible-as-literal minority in your view? I think you're making a false equivalency between religious extremism and liberal extremism. We can't equate the rejection of science with some hippies taking away your guns. Both are extreme, but beyond that the equivalency falls away.
Just based on numbers, those claiming Christian denominations whose creeds declare the Bible as the "inspired Word of God" outnumbers those whose creeds declare the Bible as "unaltered (or some other form of direct/unchanged/etc.) Word of God" by nearly 3-1 in this country, and it's drastically more if you go worldwide. However, just like with guns, the loud talkers can persuade those who don't believe the Bible as literal to assume people are promoting evolution in ways that they simply are not doing. There are many in my area of South Dakota (essentially pheasant hunting mecca) who are easily persuaded that liberals are out to end hunting because some extreme talker said they are, and the possibility of such would so drastically impact their income that it is a huge issue.
There are many out there who believe Christ was born December 25th as well and that he stayed out in a barn outside of town after being rejected for a room at a Best Western-esque hotel. None of that is true, but because their translation of the Bible says it, they don't believe anything else is even possible.
It's always fun to ask fundamentalists to tell you about where the Old Testament came from -- who wrote it down and where did they get it from, and when. They base much of their lives on something that they don't know much about. Of course they are just trusting their leaders, who often have a pretty lucrative gig.