Neural Radiance Fields (NeRF) for 3D Visualization Rendering Based on 2D Images

Abstract

We are living in a 3D world, but oftentimes we visualize things in 2D scopes like in pictures and videos of different objects. The world of 3D visualization has been constantly evolving over the past few years, still growing with the introduction of cutting-edge computer vision and deep learning methods. Reconstructing 3D scenes and being able to interact with them in virtual environments used to be something beyond our capabilities but now with the use of Neural Radiance Fields (NeRF) and Instant Neural Graphic Primitives (InstantNGP) we are able to create a world in a virtual space, opening the gateways to applications in object detection and generation, augmented reality, medical imaging, and more. Access to these methods will allow for more immersive development by creators, hands-on educational resources, and more experimentation and research, stimulating future applications and techniques.