24

Reasoning-Based Personalized Generation for Users with Sparse Data

Bo Ni
Branislav Kveton
Samyadeep Basu
Subhojyoti Mukherjee
Leyao Wang
Franck Dernoncourt
Sungchul Kim
Seunghyun Yoon
Zichao Wang
Ruiyi Zhang
Puneet Mathur
Jihyung Kil
Jiuxiang Gu
Nedim Lipka
Yu Wang
Ryan A. Rossi
Tyler Derr
Main:10 Pages
3 Figures
Bibliography:5 Pages
14 Tables
Appendix:8 Pages
Abstract

Large Language Model (LLM) personalization holds great promise for tailoring responses by leveraging personal context and history. However, real-world users usually possess sparse interaction histories with limited personal context, such as cold-start users in social platforms and newly registered customers in online E-commerce platforms, compromising the LLM-based personalized generation. To address this challenge, we introduce GraSPer (Graph-based Sparse Personalized Reasoning), a novel framework for enhancing personalized text generation under sparse context. GraSPer first augments user context by predicting items that the user would likely interact with in the future. With reasoning alignment, it then generates texts for these interactions to enrich the augmented context. In the end, it generates personalized outputs conditioned on both the real and synthetic histories, ensuring alignment with user style and preferences. Extensive experiments on three benchmark personalized generation datasets show that GraSPer achieves significant performance gain, substantially improving personalization in sparse user context settings.

View on arXiv
Comments on this paper