Skip to main navigation Skip to search Skip to main content

CanFuUI: a Canvas-centric web user interface for iterative image generation with diffusion models and ControlNet

  • Qihan Hu
  • , Zhenghui Xu
  • , Peng Du
  • , Hao Zeng
  • , Tongqing Ma
  • , Youbing Zhao
  • , Hao Xie
  • , Peng Zhang
  • , Shuting Liu
  • , Tongnian Zang
  • , Xuemei Wang
  • Communication University of Zhejiang
  • Uber Technologies, Inc.
  • Jiangsu Dongyin Intelligent Engineering Technology Research Institute
  • Jiangsu CRRC Digital Technology Co. Ltd.

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

Today, various AI generation tools are emerging in succession. And the majority of existing tools are predominantly model-centric in design, resulting in steep learning curves and high usability thresholds for users. Moreover, current user interfaces lack built-in image editing capabilities, forcing users to rely on external software even for basic image editing tasks. Considering that most image generation is an iterative process, this limitation significantly hampers user experience and creative potential. Instead, this paper proposes a novel canvas-centric design that seamlessly integrates editing functionalities into the UI called CanFuUI, streamlining secondary image processing. Users can crop, modify, and annotation of specific regions of generated images within the same canvas in CanFuUI. Furthermore, canvas content is utilized as preprocessed images, directly integrated into the ControlNet preprocessing procedure, reinforcing the customization capabilities of AI-generated outputs.
Original languageEnglish
Title of host publicationAI-generated Content - 1st International Conference, AIGC 2023, Revised Selected Papers
EditorsFeng Zhao, Duoqian Miao
PublisherSpringer
Pages128-138
Number of pages11
ISBN (Electronic)9789819975877
ISBN (Print)9789819975860
DOIs
Publication statusPublished - 2 Nov 2023
EventInternational Conference on AI-generated Content, AIGC 2023 - Shanghai
Duration: 25 Aug 202326 Aug 2023

Publication series

NameCommunications in Computer and Information Science
Volume1946 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

ConferenceInternational Conference on AI-generated Content, AIGC 2023
CityShanghai
Period25/08/2326/08/23
OtherInternational Conference on AI-generated Content, AIGC 2023 (25/08/2023-26/08/2023, Shanghai)

Keywords

  • Canvas-Centric UI
  • ComfyUI
  • Diffusion Models
  • WebUI

ASJC Scopus subject areas

  • General Computer Science
  • General Mathematics

Fingerprint

Dive into the research topics of 'CanFuUI: a Canvas-centric web user interface for iterative image generation with diffusion models and ControlNet'. Together they form a unique fingerprint.

Cite this