Evaluating the Evaluators: Investigating LLM Judges for Personalized Writing Style Assessment
researchApple Machine LearningNov 10, 2026
This paper was accepted at the Can We Trust AI Evaluation? Workshop at NeurIPS 2026. We evaluate how good large language model (LLM) judges are for personalized writing tasks. This is important when a user’s preferred writing style is known (e.g., “upbeat”)...
Impact: LowConfidence: MediumNovelty: Incremental
researchapple-ml