A Novel Out-of-Distribution Detector based on Autoencoder and Binary Classifier with Auxiliary Input
DOI:
https://doi.org/10.47611/jsrhs.v11i3.2701Keywords:
Out of distribution detection, outlier detection, Autoencoder, CNNAbstract
At industrial production levels, anomaly detection is crucial to maintaining adequate levels of safety standards and quality assurance in products. Numerous previous research focuses on detecting the anomaly samples yet their methods cannot filter the unexpected outliers that have completely different image features. In this research, we propose a novel out-of-distribution detector based on an autoencoder and binary classifier with auxiliary input. Given the input image, the autoencoder produces the latent variable and reconstructed image. The difference image is generated and fed to the binary classifier to classify whether the input image is an outlier or a normal sample. The latent variable which contains useful feature-level information is fed to the intermediate layer of the classifier to produce the precise classification results. We also propose noise-addition augmentation to make the trained model consistently perform against various kinds of noise-containing images which are often found in real-world scenarios in industrial environments. The proposed method achieves AUC of 0.9718 and 0.5908 in the MNIST and CIFAR10 datasets, respectively. Through these experiments, we have shown that the proposed method outperforms the previous state-of-the-art methods.
Downloads
References or Bibliography
Gudovskiy, Denis, Shun Ishizaka, and Kazuki Kozuka. "Cflow-ad: Real-time unsupervised anomaly detection with localization via conditional normalizing flows." Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2022.
Rudolph, Marco, et al. "Fully Convolutional Cross-Scale-Flows for Image-based Defect Detection." Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2022.
Kingma, Diederik P., and Jimmy Ba. "Adam: A method for stochastic optimization." arXiv preprint arXiv:1412.6980 (2014).
Paszke, Adam, et al. "Automatic differentiation in pytorch." (2017).
He, Kaiming, et al. "Deep residual learning for image recognition." Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
Deng, L. (2012). The mnist database of handwritten digit images for machine learning research. IEEE Signal Processing Magazine, 29(6), 141–142.
Krizhevsky, Alex, Vinod Nair, and Geoffrey Hinton. "Cifar-10 (canadian institute for advanced research)." URL http://www. cs. toronto. edu/kriz/cifar. html 5.4 (2010): 1.
Van den Oord, Aaron, et al. "Conditional image generation with pixelcnn decoders." Advances in neural information processing systems 29 (2016).
Zhai, Shuangfei, et al. "Deep structured energy based models for anomaly detection." International conference on machine learning. PMLR, 2016.
Kingma, Diederik P., and Max Welling. "Auto-encoding variational bayes." arXiv preprint arXiv:1312.6114 (2013).
Published
How to Cite
Issue
Section
Copyright (c) 2022 Sungmin Kim; Kyoung-Hyoun Kim
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright holder(s) granted JSR a perpetual, non-exclusive license to distriute & display this article.