ADNet: A Large-Scale and Extensible Multi-Domain Benchmark for Anomaly Detection Across 380 Real-World Categories

Hai Ling1,2, Jia Guo3, Zhulin Tao1*, Yunkang Cao4, Donglin Di3, Hongyan Xu5, Xiu Su5, Yang Song6, Lei Fan6,2*
Arxiv 2025
1Communication University of China,
2DZ Matrix, 3Tsinghua University, 4Hunan University, 5Central South University, 6UNSW Sydney

*Corresponding Author
ADNet overview

Overview of ADNet, covering 380 categories across five application domains.

Abstract

Anomaly detection (AD) aims to identify defects using normal-only training data. Existing anomaly detection benchmarks (e.g., MVTec-AD with 15 categories) cover only a narrow range of categories, limiting the evaluation of cross-context generalization and scalability. We introduce ADNet, a large-scale, multi-domain benchmark comprising 380 categories aggregated from 49 publicly available datasets across Electronics, Industry, Agrifood, Infrastructure, and Medical domains. The benchmark includes a total of 196,294 RGB images, consisting of 116,192 normal samples for training and 80,102 test images, of which 60,311 are anomalous. All images are standardized with MVTec-style pixel-level annotations and structured text descriptions spanning both spatial and visual attributes, enabling multimodal anomaly detection tasks. Extensive experiments reveal a clear scalability challenge: existing state-of-the-art methods achieve 90.6% I-AUROC in one-for-one settings but drop to 78.5% when scaling to all 380 categories in a multi-class setting. To this end, we propose Dinomalym, a context-guided Mixture-of-Experts extension of Dinomaly that expands decoder capacity without added inference cost. It achieves 83.2% I-AUROC and 93.1% P-AUROC, demonstrating superior performance over existing approaches. We aim to make ADNet a standardized and extensible benchmark, supporting the community in expanding anomaly detection datasets across diverse domains and providing a scalable foundation for AD foundation models.

Dataset Information

The ADNet dataset provides a comprehensive collection of high-quality images for anomaly detection. It includes over 196,294 RGB images, consisting of 116,192 normal samples for training and 80,102 test images, of which 60,311 are anomalous. The dataset supports tasks such as anomaly detection.

The ADNet dataset is licensed under the Creative Commons BY-NC-SA 4.0 license. Note that all data must not be used for commercial purposes.

Dataset Access

ADNet is released on HuggingFace:

All categories overview

All categories overview of ADNet.

Baseline Results

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP
UniAD 63.481.585.886.711.817.4
ViTAD 72.486.387.988.119.624.4
RD 66.983.286.487.415.721.2
SimpleNet 52.775.984.065.03.97.5
MambaAD 72.787.087.888.820.725.8
DesTSeg 63.981.985.681.014.016.4
Dinomaly 78.589.789.9 91.023.929.6
Dinomalym 83.292.191.7 93.130.635.6

Mean metrics are extracted from the provided ADNET_BASELINE.xlsx (Overall row). Best in bold, second best in underline.