Skip to yearly menu bar Skip to main content


Poster

Self-Equilibrated Online Data Balancing for Enhanced Concept Composition in Generation Models

Yukai Shi · Jiarong Ou · Rui Chen · Haotian Yang · Jiahao Wang · Xin Tao · Pengfei Wan · Di ZHANG · Kun Gai


Abstract:

In visual generation tasks, the responses and combinations of complex concepts often lack stability and are error-prone, which remains an under-explored area. In this paper, we attempt to explore the causal factors for poor concept responses through elaborately designed experiments. We also design a concept-wise equalization loss function (IMBA loss) to address this issue. Our proposed method is online, eliminating the need for offline dataset processing, and requires minimal code changes. In our newly proposed complex concept benchmark Inert-CompBench and two other public test sets, our method significantly enhances the concept response capability of baseline models and yields highly competitive results with only a few codes.

Live content is unavailable. Log in and register to view live content