'Passive tolerance' is insufficient, says PM