File size: 2,693 Bytes
e777562
9b57b6b
e777562
 
 
 
 
 
9b57b6b
e777562
 
 
 
a7a8d59
e777562
a7a8d59
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e777562
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
---
title: ImagenWorld Visualizer
emoji: ๐Ÿš€
colorFrom: red
colorTo: red
sdk: docker
app_port: 8501
tags:
- streamlit
pinned: false
short_description: Streamlit template space
---

# ๐Ÿ–ผ๏ธ ImagenWorld

[![Paper](https://img.shields.io/badge/%F0%9F%93%84-Paper-b31b1b)](https://openreview.net/forum?id=bld9g6jFh9)
[![Project Website](https://img.shields.io/badge/%F0%9F%8C%90-Project%20Website-deepgray)](https://tiger-ai-lab.github.io/ImagenWorld/)
[![Visualization](https://img.shields.io/badge/%F0%9F%93%8A-Visualization-blue)](https://huggingface.co/spaces/TIGER-Lab/ImagenWorld-Visualizer)
[![GitHub](https://img.shields.io/badge/Code-GitHub-darkblue)](https://github.com/TIGER-AI-Lab/ImagenWorld)

**ImagenWorld** is a large-scale benchmark designed to **evaluate image generation and editing models** in realistic multimodal scenarios.  
It spans **six diverse tasks** and **six content domains**, providing a unified framework for assessing model compositionality, instruction following, and multimodal capability.

---

## ๐Ÿ“œ Citation

If you use **ImagenWorld**, please cite:

```bibtex
@inproceedings{
sani2026imagenworld,
title={ImagenWorld: Stress-Testing Image Generation Models with Explainable Human Evaluation on Open-ended Real-World Tasks},
author={Samin Mahdizadeh Sani and Max Ku and Nima Jamali and Matina Mahdizadeh Sani and Paria Khoshtab and Wei-Chieh Sun and Parnian Fazel and Zhi Rui Tam and Thomas Chong and Edisy Kin Wai Chan and Donald Wai Tong Tsang and Chiao-Wei Hsu and Lam Ting Wai and Ho Yin Sam Ng and Chiafeng Chu and Chak-Wing Mak and Keming Wu and Hiu Tung Wong and Yik Chun Ho and Chi Ruan and Zhuofeng Li and I-Sheng Fang and Shih-Ying Yeh and Ho Kei Cheng and Ping Nie and Wenhu Chen},
booktitle={The Fourteenth International Conference on Learning Representations},
year={2026},
url={https://openreview.net/forum?id=bld9g6jFh9}
}

@misc{sani2026imagenworldstresstestingimagegeneration,
      title={ImagenWorld: Stress-Testing Image Generation Models with Explainable Human Evaluation on Open-ended Real-World Tasks}, 
      author={Samin Mahdizadeh Sani and Max Ku and Nima Jamali and Matina Mahdizadeh Sani and Paria Khoshtab and Wei-Chieh Sun and Parnian Fazel and Zhi Rui Tam and Thomas Chong and Edisy Kin Wai Chan and Donald Wai Tong Tsang and Chiao-Wei Hsu and Ting Wai Lam and Ho Yin Sam Ng and Chiafeng Chu and Chak-Wing Mak and Keming Wu and Hiu Tung Wong and Yik Chun Ho and Chi Ruan and Zhuofeng Li and I-Sheng Fang and Shih-Ying Yeh and Ho Kei Cheng and Ping Nie and Wenhu Chen},
      year={2026},
      eprint={2603.27862},
      archivePrefix={arXiv},
      primaryClass={cs.GR},
      url={https://arxiv.org/abs/2603.27862}, 
}