330

Filtering In Neural Implicit Functions

Computational Visual Media (CVM), 2022
Abstract

Neural implicit functions are highly effective for representing many kinds of data, including images and 3D surfaces. However, the implicit functions learned by neural networks usually include over-smoothed patches or noisy artifacts into the results if the data has many scales of details or a wide range of frequencies. Adapting the functions containing both noise and over-smoothed regions may suffer from either over smoothing or noisy issues. To overcome this challenge, we propose a new framework, coined FINN, that integrates a filtering module into the neural network to perform data reconstruction while filtering artifacts. The filtering module has a smoothing operator that acts on the intermediate results of the network and a recovering operator that brings distinct details from the input back to the regions overly smoothed. The proposed method significantly alleviates over smoothing or noisy issues. We demonstrate the advantage of the FINN on the tasks of image regression and surface reconstruction and showcases significant improvement compared to state-of-the-art methods. In addition, FINN also yields better performance in both convergence speed and network stability. Source code is available at https://github.com/yixin26/FINN.

View on arXiv
Comments on this paper