Learning When to Personalize: LLM Based Playlist Generation via Query Taxonomy and Classification

Transactions of the Association for Computational Linguistics. 2026. P. 51–57.

Buzaev F., Пугачёва Д. В., Sukharev I., Mullakhmetov R., Pavlovich O., Bogachev R., Sedunov I.

Playlist generation based on textual queries using large language models (LLMs) is becoming an important interaction paradigm for music streaming platforms. User queries span a wide spectrum from highly personalized intent to essentially catalog-style requests. Existing systems typically rely on non-personalized retrieval/ranking or apply a fixed level of preference conditioning to every query, which can overfit catalog queries to a single user or under-personalize explicitly listener-dependent requests. We present an industrial-scale LLM-based playlist generation system with dynamic personalization that adapts the personalization strength to the query type. We define a query taxonomy, train a query-type classifier on 5,000 manually labeled queries, and use its predicted probability to modulate the mixture of LLM-based semantic scoring and personalized evaluation. In a blind user study with pairwise comparisons and ELO aggregation, this approach consistently outperforms both non-personalized and fixed-personalization baselines.

Keywords: Personalization, Large language models (LLM)