Latest Generative AI Research Papers

Research on AI systems that create new content including image generation, text-to-image, video synthesis, and creative AI applications.

76 Papers

Showing 16 of 16 papers

Memory-V2V: Augmenting Video-to-Video Diffusion Models with Memory

Dohun Lee, Chun-Hao Paul Huang, Xuelin Chen +3 more

Recent foundational video-to-video diffusion models have achieved impressive results in editing user provided videos by modifying appearance, motion, or camera movement. However, real-world video editing is often an iterative process, where users refine results across multiple rounds of interaction....

video-to-video diffusion modelscross-consistencymulti-turn video editingmemory augmentationretrieval+5 more

Jan 22, 202618

Scaling Text-to-Image Diffusion Transformers with Representation Autoencoders

Shengbang Tong, Boyang Zheng, Ziteng Wang +7 more

Representation Autoencoders (RAEs) have shown distinct advantages in diffusion modeling on ImageNet by training in high-dimensional semantic latent spaces. In this work, we investigate whether this framework can scale to large-scale, freeform text-to-image (T2I) generation. We first scale RAE decode...

representation autoencodersdiffusion modelingsemantic latent spacestext-to-image generationfrozen representation encoder+8 more

Jan 22, 202650

A Mechanistic View on Video Generation as World Models: State and Dynamics

Luozhou Wang, Zhifei Chen, Yihua Du +11 more

Large-scale video generation models have demonstrated emergent physical coherence, positioning them as potential world models. However, a gap remains between contemporary "stateless" video architectures and classic state-centric world model theories. This work bridges this gap by proposing a novel t...

video generation modelsworld modelsstate constructiondynamics modelingimplicit paradigms+11 more

Jan 22, 20268

360Anything: Geometry-Free Lifting of Images and Videos to 360°

Ziyi Wu, Daniel Watson, Andrea Tagliasacchi +3 more

Lifting perspective images and videos to 360° panoramas enables immersive 3D world generation. Existing approaches often rely on explicit geometric alignment between the perspective and the equirectangular projection (ERP) space. Yet, this requires known camera metadata, obscuring the application to...

diffusion transformersperspective-to-equirectangular mappingtoken sequenceszero-paddingVAE encoder+5 more

Jan 22, 20267

HyperAlign: Hypernetwork for Efficient Test-Time Alignment of Diffusion Models

Xin Xie, Jiaxian Guo, Dong Gong

Diffusion models achieve state-of-the-art performance but often fail to generate outputs that align with human preferences and intentions, resulting in images with poor aesthetic quality and semantic inconsistencies. Existing alignment methods present a difficult trade-off: fine-tuning approaches su...

diffusion modelshypernetworklow-rank adaptationdenoising trajectoryreward-conditioned alignment+4 more

Jan 22, 20265

OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfer

Pengze Zhang, Yanze Wu, Mengtian Li +8 more

Videos convey richer information than images or text, capturing both spatial and temporal dynamics. However, most existing video customization methods rely on reference images or task-specific temporal priors, failing to fully exploit the rich spatio-temporal information inherent in videos, thereby ...

video customizationspatio-temporal video transfermulti-view informationtemporal cuestemporal alignment+4 more

Jan 20, 202634

FrankenMotion: Part-level Human Motion Generation and Composition

Chuqiao Li, Xianghui Xie, Yong Cao +2 more

Human motion generation from text prompts has made remarkable progress in recent years. However, existing methods primarily rely on either sequence-level or action-level descriptions due to the absence of fine-grained, part-level motion annotations. This limits their controllability over individual ...

diffusion-basedpart-aware motion generationlarge language modelstemporally-aware part-level text annotationsatomic motion annotations+2 more

Jan 15, 202615

CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation

Chengzhuo Tong, Mingkun Chang, Shenglong Zhang +12 more

Recent video generation models have revealed the emergence of Chain-of-Frame (CoF) reasoning, enabling frame-by-frame visual inference. With this capability, video models have been successfully applied to various visual tasks (e.g., maze solving, visual puzzles). However, their potential to enhance ...

Jan 15, 202628

Inference-time Physics Alignment of Video Generative Models with Latent World Models

Jianhao Yuan, Xiaofeng Zhang, Felix Friedrich +7 more

State-of-the-art video generative models produce promising visual content yet often violate basic physics principles, limiting their utility. While some attribute this deficiency to insufficient physics understanding from pre-training, we find that the shortfall in physics plausibility also stems fr...

Jan 15, 202611

M^4olGen: Multi-Agent, Multi-Stage Molecular Generation under Precise Multi-Property Constraints

Yizhan Li, Florence Cloutier, Sifan Wu +5 more

Generating molecules that satisfy precise numeric constraints over multiple physicochemical properties is critical and challenging. Although large language models (LLMs) are expressive, they struggle with precise multi-objective control and numeric reasoning without external structure and feedback. ...

large language modelsmulti-agent reasonerfragment-level editsretrieval-augmented generationGroup Relative Policy Optimization+8 more

Jan 15, 202616

Transition Matching Distillation for Fast Video Generation

Weili Nie, Julius Berner, Nanye Ma +3 more

Large video diffusion and flow models have achieved remarkable success in high-quality video generation, but their use in real-time interactive applications remains limited due to their inefficient multi-step sampling process. In this work, we present Transition Matching Distillation (TMD), a novel ...

Jan 14, 202628

Motion Attribution for Video Generation

Xindi Wu, Despoina Paschalidou, Jun Gao +5 more

Despite the rapid progress of video generation models, the role of data in influencing motion is poorly understood. We present Motive (MOTIon attribution for Video gEneration), a motion-centric, gradient-based data attribution framework that scales to modern, large, high-quality video datasets and m...

Jan 13, 202627

TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Experts

Yu Xu, Hongbin Yan, Juan Cao +11 more

Unified image generation and editing models suffer from severe task interference in dense diffusion transformers architectures, where a shared parameter space must compromise between conflicting objectives (e.g., local editing v.s. subject-driven generation). While the sparse Mixture-of-Experts (MoE...

Jan 12, 202611

Focal Guidance: Unlocking Controllability from Semantic-Weak Layers in Video Diffusion Models

Yuanyang Yin, Yufan Deng, Shenghai Yuan +3 more

The task of Image-to-Video (I2V) generation aims to synthesize a video from a reference image and a text prompt. This requires diffusion models to reconcile high-frequency visual constraints and low-frequency textual guidance during the denoising process. However, while existing I2V models prioritiz...

Jan 12, 20262

RigMo: Unifying Rig and Motion Learning for Generative Animation

Hao Zhang, Jiahao Luo, Bohui Wan +7 more

Despite significant progress in 4D generation, rig and motion, the core structural and dynamic components of animation are typically modeled as separate problems. Existing pipelines rely on ground-truth skeletons and skinning weights for motion generation and treat auto-rigging as an independent pro...

generative frameworkrig latentmotion latentSE(3) transformationsauto-rigging+5 more

Jan 10, 20267

VIBE: Visual Instruction Based Editor

Grigorii Alekseenko, Aleksandr Gordeev, Irina Tolstykh +7 more

Instruction-based image editing is among the fastest developing areas in generative AI. Over the past year, the field has reached a new level, with dozens of open-source models released alongside highly capable commercial systems. However, only a limited number of open-source approaches currently ac...

diffusion modelsQwen3-VLSana1.5instruction-based image editingimage generation+5 more

Jan 5, 202658

PreviousPage 4 of 4

View all categories

Latest Generative AI Research | Generative AI Papers