Ethanhjwu Ethanhjwu

Token-level Preference Self-Alignment Optimization for Multi-style Outline Controllable Generation

Multi-style outline controllable generation is crucial for multiple applications, including document semantic structuring and retrieval-augmented generation.The great success of preference alignment approaches encourages their application in controllable generation tasks.However, these attempts enco…