A Novel Out-of-Distribution Detector based on Autoencoder and Binary Classifier with Auxiliary Input

Authors

  • Sungmin Kim Bergen County Academies
  • Kyoung-Hyoun Kim Korea National Institute of Health

DOI:

https://doi.org/10.47611/jsrhs.v11i3.2701

Keywords:

Out of distribution detection, outlier detection, Autoencoder, CNN

Abstract

 At industrial production levels, anomaly detection is crucial to maintaining adequate levels of safety standards and quality assurance in products. Numerous previous research focuses on detecting the anomaly samples yet their methods cannot filter the unexpected outliers that have completely different image features. In this research, we propose a novel out-of-distribution detector based on an autoencoder and binary classifier with auxiliary input. Given the input image, the autoencoder produces the latent variable and reconstructed image. The difference image is generated and fed to the binary classifier to classify whether the input image is an outlier or a normal sample. The latent variable which contains useful feature-level information is fed to the intermediate layer of the classifier to produce the precise classification results. We also propose noise-addition augmentation to make the trained model consistently perform against various kinds of noise-containing images which are often found in real-world scenarios in industrial environments. The proposed method achieves AUC of 0.9718 and 0.5908 in the MNIST and CIFAR10 datasets, respectively. Through these experiments, we have shown that the proposed method outperforms the previous state-of-the-art methods. 

Downloads

Download data is not yet available.

Author Biography

Kyoung-Hyoun Kim, Korea National Institute of Health

Principal Researcher in the Division of Healthcare and Artificial Intelligence

References or Bibliography

Gudovskiy, Denis, Shun Ishizaka, and Kazuki Kozuka. "Cflow-ad: Real-time unsupervised anomaly detection with localization via conditional normalizing flows." Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2022.

Rudolph, Marco, et al. "Fully Convolutional Cross-Scale-Flows for Image-based Defect Detection." Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2022.

Kingma, Diederik P., and Jimmy Ba. "Adam: A method for stochastic optimization." arXiv preprint arXiv:1412.6980 (2014).

Paszke, Adam, et al. "Automatic differentiation in pytorch." (2017).

He, Kaiming, et al. "Deep residual learning for image recognition." Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.

Deng, L. (2012). The mnist database of handwritten digit images for machine learning research. IEEE Signal Processing Magazine, 29(6), 141–142.

Krizhevsky, Alex, Vinod Nair, and Geoffrey Hinton. "Cifar-10 (canadian institute for advanced research)." URL http://www. cs. toronto. edu/kriz/cifar. html 5.4 (2010): 1.

Van den Oord, Aaron, et al. "Conditional image generation with pixelcnn decoders." Advances in neural information processing systems 29 (2016).

Zhai, Shuangfei, et al. "Deep structured energy based models for anomaly detection." International conference on machine learning. PMLR, 2016.

Kingma, Diederik P., and Max Welling. "Auto-encoding variational bayes." arXiv preprint arXiv:1312.6114 (2013).

Published

08-31-2022

How to Cite

Kim, S., & Kim, K.-H. (2022). A Novel Out-of-Distribution Detector based on Autoencoder and Binary Classifier with Auxiliary Input. Journal of Student Research, 11(3). https://doi.org/10.47611/jsrhs.v11i3.2701

Issue

Section

HS Research Projects