Showdown28. 01 2026
How Profession Shapes LLM Usage: Insights from SEAL Showdown
We analyze 580k+ production prompts and 100k+ preference battles from SEAL Showdown to study how profession shapes LLM usage. We find that professional background—independent of topic—predicts prompt difficulty, task type, and model preference, with domain experts asking harder in-domain questions and ranking models differently. These results motivate profession-aware evaluation of LLMs in expert workflows.
Janie Gu, Jaehwan Jeong, David Lee, Bing Liu, Zihao Wang
