As someone with no deeply held religious beliefs I have certainly felt some discrimination from time to time. So, I suspect, have we all, regardless of our faith or lack of it. In my experience, there is nothing guaranteed to provoke intolerance than deeply held views on religion.
