Awesome Layout Generation

• Dataset
• 2025
• 2024
• 2023
• 2022
• 2021
• 2019-2020
• Before
• Reference

Dataset

Content-agnostic Layout Generation

• Rico Dataset (ACM UIST 2017) [Paper] [Download]
  
• PubLayNet Dataset (ICDAR 2019) [Paper] [Download1] [Download2]
  
• Magazine Dataset (SIGRAPH 2019) [Paper] [Github] [Download1] [Download2]
  
• Crello Dataset (ICCV 2021) [Paper] [Github] [Download]
  
• DocLayNet Dataset (KDD 2022) [Paper] [Download] [Huggingface]
  
• WebUI Dataset (CHI 2023) [Paper] [Download]
  
• M6Doc Dataset (CVPR 2023) [Paper] [Download]
  
• SciPostLayout (BMVC 2024) [Paper] [Download]
  

Content-aware Layout Generation

• CGL Dataset v1 (IJCAI 2022) [Paper] [Github] [Download]
  
• CGL Dataset v2 (CIKM 2023) [Paper] [Github] [Download]
  
• PKU PosterLayout Dataset (CVPR 2023) [Paper] [Github] [Download1(official)] [Download2(unofficial)]
  

2025

Smaller But Better: Unifying Layout Generation with Smaller Large Language Models
Peirong Zhang, Jiaxin Zhang, Jiahuan Cao, Hongliang Li, Lianwen Jin.
arXiv 2025, South China University of Technology
Content-Agnostic LLM-based [Paper] [Github]

Illuminating Spaces: Deep Reinforcement Learning and Laser-Wall Partitioning for Architectural Layout Generation
Reza Kakooee, Benjamin Dillenburger.
arXiv 2025, ETH Zurich
Content-Agnostic [Paper]

Problem Solved? Information Extraction Design Space for Layout-Rich Documents using LLMs
Gaye Colakoglu, Gürkan Solmaz, Jonathan Fürst.
arXiv 2025, Zurich University of Applied Sciences
layout-aware LLM-based [Paper] [Github]

Spatial Information Integration in Small Language Models for Document Layout Generation and Classification
Pablo Melendez, Clemens Havas.
arXiv 2025, Salzburg University of Applied Sciences
Content-Agnostic LLM-based [Paper]

2024

VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correction
Jiahao Zhang, Ryota Yoshihashi, Shunsuke Kitada, Atsuki Osanai, Yuta Nakashima.
arXiv 2024, Osaka University
Content-Aware LLM-based [Paper]

DogLayout: Denoising Diffusion GAN for Discrete and Continuous Layout Generation
Zhaoxing Gan, Guangnan Ye.
arXiv 2024, Fudan University
Content-Agnostic LLM-based [Paper] [Github]

GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts
Junwen He, Yifan Wang, Lijun Wang, Huchuan Lu, Jun-Yan He, Chenyang Li, Hanyuan Chen, Jin-Peng Lan, Bin Luo, Yifeng Geng.
arXiv 2024, Dalian University of Technology & Alibaba
[Paper]

Image-aware layout generation with user constraints for poster design
Chenchen Xu, Kaixin Han, Weiwei Xu.
The Visual Computer, Zhejiang University
Content-Aware [Paper]

Design Element Aware Poster Layout Generation
Yinan Li, Jia Chen, Yin Bai, Jia Cheng, Jun Lei.
CIKM 2024, Mtituan
Content-Aware [Paper]

Multimodal Markup Document Models for Graphic Design Completion
Kotaro Kikuchi, Naoto Inoue, Mayu Otani, Edgar Simo-Serra, Kota Yamaguchi.
arxiv 2024, CyberAgent & Waseda University
Content-Aware [Paper]

Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Model
Shoma Iwai, Atsuki Osanai, Shunsuke Kitada, Shinichiro Omachi.
ECCV 2024, Tohoku University & LY Corporation
Content-Agnostic [Paper]

LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generation
Mayu Otani, Naoto Inoue, Kotaro Kikuchi, Riku Togashi.
arXiv 2024, CyberAgent
Content-Agnostic [Paper]

LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformer
Yu Li, Yifan Chen, Gongye Liu, Fei Yin, Qingyan Bai, Jie Wu, Hongfa Wang, Ruihang Chu, Yujiu Yang.
arXiv 2024, Tsinghua University & Tencent & HKUST
Content-Aware [Paper]

GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Models
Jian Ma, Yonglin Deng, Chen Chen, Haonan Lu, Zhenyu Yang.
arXiv 2024, OPPO AI Center & CUHK Shenzhen
LLM-based [Paper] [Github]

SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posters
Shohei Tanaka, Hao Wang, Yoshitaka Ushiku.
BMVC 2024, OMRON SINIC X Corporation & Waseda University
Content-Agnostic [Paper] [Github]

Predicting Visual Attention in Graphic Design Documents
Souradeep Chakraborty, Zijun Wei, Conor Kelton, Seoyoung Ahn, Aruna Balasubramanian, Gregory J. Zelinsky, Dimitris Samaras.
arXiv 2024, Stony Brook University
[Paper]

Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Rendering
Zeyu Liu, Weicong Liang, Yiming Zhao, Bohan Chen, Lin Liang, Lijuan Wang, Ji Li, Yuhui Yuan.
arXiv 2024, Microsoft
[Paper] [Project] [Github]

OpenCOLE: Towards Reproducible Automatic Graphic Design Generation
Naoto Inoue, Kento Masui, Wataru Shimoda, Kota Yamaguchi.
CVPRW 2024, CyberAgent
[Paper] [Github]

PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLM
Tao Yang, Yingmin Luo, Zhongang Qi, Yang Wu, Ying Shan, Chang Wen Chen.
arXiv 2024, Tencent PCG
Content-Aware LLM-based [Paper] [Project] [Github]

CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusion
Chin-Yi Cheng, Ruiqi Gao, Forrest Huang, Yang Li.
arXiv 2024, Google Research
Content-Agnostic [Paper]

Leveraging Human Revisions for Improving Text-to-Layout Models
Amber Xie, Chin-Yi Cheng, Forrest Huang, Yang Li.
arXiv 2024, Google Research
Content-Agnostic [Paper]

Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models
Wanrong Zhu, Jennifer Healey, Ruiyi Zhang, William Yang Wang, Tong Sun.
arXiv 2024, Adobe & UC Santa Barbara
LLM-based [Paper]

Graphic Design with Large Multimodal Model
Yutao Cheng, Zhao Zhang, Maoke Yang, Hui Nie, Chunyuan Li, Xinglong Wu, Jie Shao.
arXiv 2024, ByteDance & UCAS
LLM-based HLG [Paper] [Github]

PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generation
Jaejung Seol, Seojun Kim, Jaejun Yoo.
ECCV 2024, Ulsan National Institute of Science and Technology
LLM-based [Paper] [Github-1] [Github-2]

Constrained Layout Generation with Factor Graphs
Mohammed Haroon Dupty, Yanfei Dong, Sicong Leng, Guoji Fu, Yong Liang Goh, Wei Lu, Wee Sun Lee.
CVPR 2024, PayPal & National University of Singapore
[Paper]

LayoutFlow: Flow Matching for Layout Generation
Julian Jorge Andrade Guerreiro, Naoto Inoue, Kento Masui, Mayu Otani, Hideki Nakayama.
ECCV 2024, CyberAgent & The University of Tokyo
Content-Agnostic [Paper] [Project] [Github]

Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering
Zeyu Liu, Weicong Liang, Zhanhao Liang, Chong Luo, Ji Li, Gao Huang, Yuhui Yuan.
arXiv 2024, Microsoft Research Asia & Tsinghua University
[Paper] [Project] [Github]

Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation
Mohammad Amin Shabani, Zhaowen Wang, Difan Liu, Nanxuan Zhao, Jimei Yang, Yasutaka Furukawa.
CVPR 2024, Adobe & Simon Fraser University
Content-Aware [Paper] [Project]

Desigen: A Pipeline for Controllable Design Template Generation
Haohan Weng, Danqing Huang, Yu Qiao, Zheng Hu, Chin-Yew Lin, Tong Zhang, C. L. Philip Chen.
CVPR 2024, Microsoft Research Asia & South China University of Technology
[Paper] [Github]

Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation
Daichi Horita, Naoto Inoue, Kotaro Kikuchi, Kota Yamaguchi, Kiyoharu Aizawa.
CVPR 2024(oral), CyberAgent & The University of Tokyo
Content-Aware [Paper] [Project] [Github]

LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models
Zecheng Tang, Chenfei Wu, Juntao Li, Nan Duan.
ICLR 2024, Microsoft Research Asia & Soochow University
Content-Agnostic [Paper] [Github]

Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints
Jian Chen, Ruiyi Zhang, Yufan Zhou, Rajiv Jain, Zhiqiang Xu, Ryan Rossi, Changyou Chen.
ICLR 2024, Adobe Research & MBZUAI & University at Buffalo
Content-Agnostic [Paper] [Github]

Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locator
Jieru Lin, Danqing Huang, Tiejun Zhao, Dechen Zhan, Chin-Yew Lin.
AAAI 2024, Microsoft Research & Harbin Institute of Technology
Content-Agnostic [Paper] [Github]

Dolfin: Diffusion Layout Transformers without Autoencoder
Yilin Wang, Zeyuan Chen, Liangjun Zhong, Zheng Ding, Zhizhou Sha, Zhuowen Tu.
ECCV 2024, Tsinghua University & University of California, San Diego
Content-Agnostic [Paper]

LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer
Ning Yu, Chia-Chih Chen, Zeyuan Chen, Rui Meng, Gang Wu, Paul Josel, Juan Carlos Niebles, Caiming Xiong, Ran Xu.
ECCV 2024, Salesforce Research
Content-Aware [Paper] [Github]

2023

COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Design
Peidong Jia, Chenxuan Li, Yuhui Yuan, Zeyu Liu, Yichao Shen, Bohan Chen, Xingru Chen, Yinglin Zheng, Dong Chen, Ji Li, Xiaodong Xie, Shanghang Zhang, Baining Guo.
arXiv 2023, Microsoft Research Asia & Peking University
[Paper]

Relation-Aware Diffusion Model for Controllable Poster Layout Generation
Fengheng Li, An Liu, Wei Feng, Honghe Zhu, Yaoyu Li, Zheng Zhang, Jingjing Lv, Xin Zhu, Junjie Shen, Zhangang Lin, Jingping Shao.
CIKM 2023, JD & Nankai University
Content-Aware [Paper] [Github] [Dataset]

LayoutPrompter: Awaken the Design Ability of Large Language Models Jiawei Lin, Jiaqi Guo, Shizhao Sun, Zijiang James Yang, Jian-Guang Lou, Dongmei Zhang.
NeurIPS 2023, Microsoft Research Asia & Shanghai Jiao Tong University
LLM-based [Paper] [Github]

LayoutGPT: Compositional Visual Planning and Generation with Large Language Models
Weixi Feng, Wanrong Zhu, Tsu-jui Fu, Varun Jampani, Arjun Akula, Xuehai He, Sugato Basu, Xin Eric Wang, William Yang Wang.
NeurIPS 2023, Google & UC Santa Barbara
LLM-based [Paper] [Project] [Github]

DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer
Elad Levi, Eli Brosh, Mykola Mykhailych, Meir Perez.
ICCV 2023, Wix.com
Content-Agnostic [Paper] [Project] [Github]

LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models
Junyi Zhang, Jiaqi Guo, Shizhao Sun, Jian-Guang Lou, Dongmei Zhang.
ICCV 2023, Microsoft Research Asia & Shanghai Jiao Tong University
Content-Agnostic [Paper] [Github]

A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptions
Jiawei Lin, Jiaqi Guo, Shizhao Sun, Weijiang Xu, Ting Liu.
ICCV 2023, Microsoft Research Asia & Shanghai Jiao Tong University
Content-Agnostic [Paper] [Github]

Diffusion-based Document Layout Generation
Liu He, Yijuan Lu, John Corring, Dinei Florencio, Cha Zhang.
ICDAR 2023, Microsoft Cloud and AI & Purdue University
Content-Agnostic [Paper]

PLay: Parametrically Conditioned Layout Generation using Latent Diffusion
Chin-Yi Cheng, Forrest Huang, Gang Li, Yang Li.
ICML 2023, Google Research
Content-Agnostic [Paper]

PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layout
HsiaoYuan Hsu, Xiangteng He, Yuxin Peng, Hao Kong, Qing Zhang.
CVPR 2023, Meituan & Peking University
Content-Aware [Paper] [Project] [Github] [Dataset1] [Dataset2]

LayoutDM: Transformer-based diffusion model for layout generation
Shang Chai, Liansheng Zhuang, Fengying Yan.
CVPR 2023, University of Science and Technology of China & Tianjin University
Content-Agnostic [Paper]

LayoutDM: Discrete Diffusion Model for Controllable Layout Generation
Naoto Inoue, Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani, Kota Yamaguchi.
CVPR 2023, CyberAgent & Waseda University
Content-Agnostic [Paper] [Project] [Github]

LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restriction
Zhaoyun Jiang, Jiaqi Guo, Shizhao Sun, Huayu Deng, Zhongkai Wu, Vuksan Mijovic, Zijiang James Yang, Jian-Guang Lou, Dongmei Zhang.
CVPR 2023, Microsoft Research Asi & Xi’an Jiaotong University
Content-Agnostic [Paper] [Github]

Towards Flexible Multi-modal Document Models
Naoto Inoue, Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani, Kota Yamaguchi.
CVPR 2023, CyberAgent & Waseda University
Content-Agnostic [Paper] [Github]

Unifying Layout Generation with a Decoupled Diffusion Model
Mude Hui, Zhizheng Zhang, Xiaoyi Zhang, Wenxuan Xie, Yuwang Wang, Yan Lu.
CVPR 2023, Microsoft Research Asi & Xi’an Jiaotong University
Content-Agnostic [Paper]

Layout Generation as Intermediate Action Sequence Prediction
Huiting Yang, Danqing Huang, Chin-Yew Lin, Shengfeng He.
AAAI 2023, Microsoft Research Asia & South China University of Technology
Content-Agnostic [Paper] [Github]

Machine Learning Model to Evaluate the Appropriateness of Layout for Automatic Generation of Graphic Design Works
Kohei Ishiyama, Taketoshi Ushiama.
IMCOM 2023, Kyushu University
Content-Agnostic [Paper]

2022

Geometry Aligned Variational Transformer for Image-conditioned Layout Generation
Yunning Cao, Ye Ma, Min Zhou, Chuanbin Liu, Hongtao Xie, Tiezheng Ge, Yuning Jiang.
ACMMM 2022, Alibaba Group & University of Science and Technology of China
Content-Aware [Paper]

BLT: Bidirectional Layout Transformer for Controllable Layout Generation Xiang Kong, Lu Jiang, Huiwen Chang, Han Zhang, Yuan Hao, Haifeng Gong, Irfan Essa.
ECCV 2022, Google & Carnegie Mellon University
Content-Agnostic [Paper] [Github]

Composition-aware Graphic Layout GAN for Visual-textual Presentation Designs
Min Zhou, Chenchen Xu, Ye Ma, Tiezheng Ge, Yuning Jiang, Weiwei Xu.
IJCAI 2022, Alibaba Group & Zhejiang University
Content-Aware [Paper] [Project] [Github] [Dataset]

Coarse-to-Fine Generative Modeling for Graphic Layouts
Zhaoyun Jiang, Shizhao Sun, Jihua Zhu, Jian-Guang Lou, Dongmei Zhang.
AAAI 2022, Microsoft Research Asia & Xi’an Jiaotong University
Content-Agnostic [Paper] [Github]

Aesthetics++: Refining graphic designs by exploring design principles and human preference
Wenyuan Kong, Zhaoyun Jiang, Shizhao Sun, Zhuoning Guo, Weiwei Cui, Ting Liu, Jian-Guang Lou, and Dongmei Zhang.
TVCG 2022, Microsoft Research Asi & Peking University & Xi’an Jiaotong University
Content-Agnostic [Paper] [Github]

2021

Constrained Graphic Layout Generation via Latent Optimization
Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani, Kota Yamaguchi.
ACMMM 2021, CyberAgent & Waseda University
Content-Agnostic [Paper] [Github]

RUITE: Refining UI Layout Aesthetics Using Transformer Encoder
Soliha Rahman, Vinoth Pandian Sermuga Pandian, Matthias Jarke.
IUI 2021, RWTH Aachen University
[Paper] [Github]

LayoutTransformer: Layout Generation and Completion with Self-attention
Kamal Gupta, Justin Lazarow, Alessandro Achille, Larry Davis, Vijay Mahadevan, Abhinav Shrivastava.
ICCV 2021, Amazon & University of Maryland
Content-Agnostic [Paper] [Github]

CanvasVAE: Learning to Generate Vector Graphic Documents
Kota Yamaguchi.
ICCV 2021, CyberAgent
Content-Agnostic [Paper] [Github] [Dataset]

LayoutTransformer: Scene Layout Generation with Conceptual and Spatial Diversity
Cheng-Fu Yang, Wan-Cyuan Fan, Fu-En Yang, Yu-Chiang Frank Wang.
CVPR 2021, ASUS & National Taiwan University
Content-Agnostic [Paper] [Github]

Variational Transformer Networks for Layout Generation
Diego Martin Arroyo, Janis Postels, Federico Tombari.
CVPR 2021, Google & ETH
Content-Agnostic [Paper]

Attribute-Conditioned Layout GAN for Automatic Graphic Design
Jianan Li, Jimei Yang, Jianming Zhang, Chang Liu, Christina Wang, Tingfa Xu.
TVCG 2021, Adobe & Beijing Institute of Technology
Content-Agnostic [Paper]

2019-2020

READ: Recursive Autoencoders for Document Layout Generation
Akshay Gadi Patil, Omri Ben-Eliezer, Or Perel, Hadar Averbuch-Elor.
CVPRW 2020, Amazon & Simon Fraser University
Content-Agnostic [Paper]

Neural Design Network: Graphic Layout Generation with Constraints
Hsin-Ying Lee, Lu Jiang, Irfan Essa, Phuong B Le, Haifeng Gong, Ming-Hsuan Yang, Weilong Yang.
ECCV 2020, Google Research & University of California, Merced
Content-Agnostic [Paper]

Retrieve-Then-Adapt: Example-based Automatic Generation for Proportion-related Infographics Chunyao Qian, Shizhao Sun, Weiwei Cui, Jian-Guang Lou, Haidong Zhang, Dongmei Zhang.
VIS 2020, Microsoft Research Asia
Content-Agnostic [Paper] [Github]

Content-Aware Generative Modeling of Graphic Design Layouts
Xinru Zheng, Xiaotian Qiao, Ying Cao, Rynson W.H. Lau.
ACM TOG 2019 / SIGGRAPH 2019, City University of Hong Kong
Content-Aware [Paper] [Project] [Code] [Dataset1] [Dataset2] [Dataset3]

LayoutVAE: Stochastic Scene Layout Generation From a Label Set
Akash Abdu Jyothi, Thibaut Durand, Jiawei He, Leonid Sigal, Greg Mori.
ICCV 2019, Borealis AI & Simon Fraser University & University of British Columbia
Content-Agnostic [Paper] [Github]

LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators
Jianan Li, Jimei Yang, Aaron Hertzmann, Jianming Zhang, Tingfa Xu.
ICLR 2019, Adobe & Beijing Institute of Technology
TPAMI 2020 (LayoutGAN: Synthesizing Graphic Layouts with Vector-Wireframe Adversarial Networks)
Content-Agnostic [ICLR_Paper1] [ICLR_Paper2] [TPAMI_Paper] [Github-1] [Github-2] [Github-3]

Before

Automatic Generation of Visual-Textual Presentation Layout
Xuyong Yang, Tao Mei, Ying-Qing Xu, Yong Rui, Shipeng Li.
ACM ToMM 2016, Microsoft Research Asia & University of Science and Technology of China
[Paper]

DesignScape: Design with Interactive Layout Suggestions
Peter O’Donovan, Aseem Agarwala, Aaron Hertzmann.
CHI 2015, Adobe & the University of Toronto
[Paper] [Project]

Learning Layouts for Single-Page Graphic Designs
Peter O’Donovan, Aseem Agarwala, Aaron Hertzmann.
TVCG 2014, Adobe & the University of Toronto
[Paper] [Project]

Reference

https://github.com/JosephKJ/Awesome-Layout-Generators
https://github.com/huapohen/Awesome-Layout-Generation
https://github.com/Layout-Generation/layout-generation
https://github.com/microsoft/LayoutGeneration
https://github.com/jdily/awesome-layout-generation