FreeBlend: Advancing Concept Blending with Staged Feedback-Driven Interpolation Diffusion

1Harbin Institute of Techonology 2University of Science and Techonology of China 3Westlake University
Indicates Equal Contribution
*Corresponding author: wanghuan@westlake.edu.cn

HIT
USTC
Westlake
PDF Preview

We introduce FreeBlend, a novel, training-free approach that effectively blends concepts to generate new objects through feedback interpolation and auxiliary inference. FreeBlend consistently produces visually coherent and harmonious blends, setting a new benchmark for state-of-the-art blending techniques.

Abstract

Concept blending is a promising yet underexplored area in generative models. While recent approaches, such as embedding mixing and latent modification based on structural sketches, have been proposed, they often suffer from incompatible semantic information and discrepancies in shape and appearance. In this work, we introduce FreeBlend, an effective, training-free framework designed to address these challenges. To mitigate cross-modal loss and enhance feature detail, we leverage transferred image embeddings as conditional inputs. The framework employs a stepwise increasing interpolation strategy between latents, progressively adjusting the blending ratio to seamlessly integrate auxiliary features. Additionally, we introduce a feedback-driven mechanism that updates the auxiliary latents in reverse order, facilitating global blending and prevent-ing rigid or unnatural outputs. Extensive experiments demonstrate that our method significantly improves both the semantic coherence and visual quality of blended images, yielding compelling and coherent results.

Detailed Overview of Our Proposed Method

FreeBlend consists of three core components: (1) Transferred unCLIP (Ramesh et al., 2022) image conditions for Stable Diffusion. (2) A stepwise increasing interpolation strategy. (3) A feedback-driven mechanism of denoising process.

Method Overview
Illustration of our proposed FreeBlend framework.

Visualization results

Video demonstration of results

BibTeX


        @article{zhou2025freeblend,
          title={FreeBlend: Advancing Concept Blending with Staged Feedback-Driven Interpolation Diffusion},
          author={Zhou, Yufan and Shen, Haoyu and Wang, Huan},
          journal={arXiv preprint arXiv:2502.05606},
          year={2025}
        }
      

Visitor Location Map