The Fragility of Tolerant Pluralism