I hereby propose using a symbol for degenerate distributions that looks like its cdf (namely, two horizontal lines connected by a vertical one). Does anyone know a Unicode or LaTeX symbol for this shape? (Detexify doesn't find any).

The statement p_i | beta ~ degenerate is saying that p_i is determined by beta.

I'd also like to use \leftrightarrow to denote improper distributions.