Two separate issues:
The freedom of speech
The freedom to behave badly (or inappropriately)
Separate rules apply to those issues in society because when we ask the ill-behaved to leave, we are not focussing on freedom of speech even if that is inherent because the behaviour issue is greater.
Temporary cooling off periods ‘out’ are often very effective.
Robert