I can hold a position in private, but the moment someone challenges me in front of others I fold. The audience does something to me, and I end up conceding things in the room that I quietly disagree with afterward.
Next time you are challenged publicly, buy time with let me think on that and come back rather than conceding. A pause protects you from folding to the audience.