LLMs are not (always) Bayesian: quantifying the internal (in)consistency of LLM probabilistic beliefs
LLMs Are Not (Consistently) Bayesian: Quantifying Internal (In)consistencies of LLMs’ Probabilistic Beliefs
AI BriefingApple’s machine learning research team proposed a new method that treats LLMs as information-processing rules and uses their information-processing gap from Bayesian updating to study how models internally update probabilistic beliefs based on evidence, including where they are consistent or inconsistent. Experiments evaluated LLM belief updating in complex fields such as medicine, science, and law, revealing systematic deviations between their probabilistic reasoning and the Bayesian ideal.
Source: Apple Machine Learning Research · machinelearning.apple.com