ADNet: A Multi-Domain Benchmark for Anomaly Detection Across 380 Real-World Categories

Hai Ling1,2, Jia Guo3, Zhulin Tao1*, Donglin Di2,3, Hongyan Xu4, Xiu Su4, Yang Song5, Lei Fan5,2*
Arxiv 2025
1Communication University of China,
2DZ Matrix, 3Tsinghua University, 4Central South University, 5UNSW Sydney

*Corresponding Author
ADNet overview

Overview of ADNet, covering 380 categories across five application domains.

Abstract

Anomaly detection (AD) aims to identify defects using normal-only training data. Existing anomaly detection benchmarks (e.g., MVTec-AD with 15 categories) cover only a narrow range of categories, limiting the evaluation of cross-context generalization and scalability. We introduce ADNet, a large-scale, multi-domain benchmark comprising 380 categories aggregated from 49 publicly available datasets across Electronics, Industry, Agrifood, Infrastructure, and Medical domains. The benchmark includes a total of 196,294 RGB images, consisting of 116,192 normal samples for training and 80,102 test images, of which 60,311 are anomalous. All images are standardized with MVTec-style pixel-level annotations, and anomalous samples are further enriched with structured text descriptions spanning both spatial and visual attributes, enabling multimodal anomaly detection tasks. Extensive experiments reveal a clear scalability challenge: existing state-of-the-art methods achieve 90.6% I-AUROC in one-for-one settings but drop to 78.5% when scaling to all 380 categories in a multi-class setting. To this end, we propose Dinomalym, a context-guided Mixture-of-Experts extension of Dinomaly that forms image-conditioned decoder feed-forward networks through convex combinations of expert parameter banks. It achieves 83.2% I-AUROC and 93.1% P-AUROC, outperforming existing approaches while maintaining measured latency close to vanilla Dinomaly. We aim to make ADNet a standardized and extensible benchmark, supporting the community in expanding anomaly detection datasets across diverse domains and providing a scalable foundation for AD foundation models. Dataset: https://grainnet.github.io/ADNet.

Dataset Information

The ADNet dataset provides a comprehensive collection of high-quality images for anomaly detection. It includes over 196,294 RGB images, consisting of 116,192 normal samples for training and 80,102 test images, of which 60,311 are anomalous. The dataset supports tasks such as anomaly detection.

The ADNet dataset is licensed under the Creative Commons BY-NC-SA 4.0 license. Note that all data must not be used for commercial purposes.

Dataset Access

ADNet is released on HuggingFace:

Baseline Results

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP
UniAD 63.481.585.886.711.817.4
ViTAD 72.486.387.988.119.624.4
RD 66.983.286.487.415.721.2
SimpleNet 52.775.984.065.03.97.5
MambaAD 72.787.087.888.820.725.8
DesTSeg 63.981.985.681.014.016.4
Dinomaly 78.589.789.9 91.023.929.6
Dinomalym 83.292.191.7 93.130.635.6

BibTeX


        @article{ling2025adnet,
          title={ADNet: A Multi-Domain Benchmark for Anomaly Detection Across 380 Real-World Categories},
          author={Ling, Hai and Guo, Jia and Tao, Zhulin and Di, Donglin and Xu, Hongyan and Su, Xiu and Song, Yang and Fan, Lei},
          journal={arXiv preprint arXiv:2511.20169},
          year={2025}
        }

      
All categories overview

All categories overview of ADNet.