Can your AI model smell bullsh1t? BullshitBench has the receipts.

A new benchmark is asking a deceptively simple question: when you give an AI a nonsense prompt, does it call you out — or does it just roll with it? BullshitBench , created by Peter Gostev, measures exactly this. 100 carefully crafted nonsense questions across five domains (software, finance, legal, medical, physics), using 13 different BS techniques — things like "plausible nonexistent framework", "misapplied mechanism", and "specificity trap". A 3-judge panel (Claude + GPT + Gemini) then score