Neural Radiance Fields and Reconstruction Fidelity in Urban Heritage Scans: Causal Modeling

Authors

  • Helen Lau School of Computing and Information Sciences, Saint Francis University, Hong Kong, Hong Kong SAR, China Author
  • Chun-Ho Poon School of Computing and Information Sciences, Saint Francis University, Hong Kong, Hong Kong SAR, China Author
  • Vincent Woo School of Computing and Information Sciences, Saint Francis University, Hong Kong, Hong Kong SAR, China Author

Keywords:

Neural Radiance Fields, Causal Inference, Urban Heritage, Reconstruction Fidelity, Causal Modeling

Abstract

The rapid advancement of neural volume rendering has fundamentally transformed the landscape of three-dimensional digital preservation, particularly concerning complex urban heritage sites. Neural radiance fields have emerged as a dominant paradigm due to their ability to synthesize highly photorealistic novel views from a sparse set of two-dimensional images. However, the exact causal mechanisms determining the fidelity of these reconstructions remain poorly understood, as most existing literature relies heavily on associational observations rather than rigorous causal frameworks. This paper bridges this critical gap by introducing a structural causal model designed specifically to untangle the complex web of interactions between environmental conditions, geometric complexity, camera acquisition parameters, and the ultimate reconstruction fidelity of urban heritage scans. By employing Pearlian causal inference methodologies, this research rigorously identifies and isolates confounding variables such as ambient illumination fluctuations and structural occlusion that routinely corrupt observational data. Extensive interventional simulations are performed across a diverse portfolio of historical architectural datasets to quantify the direct and indirect causal effects of these variables on standard rendering metrics. The findings presented herein demonstrate that controlling for specific environmental confounders yields a statistically significant improvement in the structural integrity of the synthesized views. This investigation not only provides a robust theoretical foundation for understanding neural rendering artifacts but also offers actionable insights for optimizing data acquisition protocols in the context of digital heritage preservation.

References

1. Flora, G.D.; Venkataramanan, C. Intelligent Classification System for Thyroid Disease Diagnosis using Medical Imaging Data with Extreme Learning Machine. In Proceedings of the IEEE International Conference on Computing Methodologies and Communication (ICCMC), Erode, India, 23–25 July 2025; pp. 1369–1375.

2. Wang, S.; Liu, Z.; Lv, S.; Lv, Y.; Wu, G.; Peng, P.; Chen, F.; Wang, X. A natural visible and infrared facial expression database for expression recognition and emotion inference. IEEE Trans. Multimed. 2010, 12, 682–691.

3. Naseem, M.T.; Lee, C.-S.; Kim, N.-H. Facial expression recognition using visible, IR, and MSX images by early and late fusion of deep learning models. IEEE Access 2024, 12, 20692–20704.

4. Souza, D.; Geuna, A.; Rodríguez, J. How small is big enough? Open labeled datasets and the development of deep learning. Ind. Corp. Change 2025, 34, 1322–1365.

5. Li, L.; Sung, M.; Dubrovina, A.; Yi, L.; Guibas, L.J. Supervised fitting of geometric primitives to 3d point clouds. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019; pp. 2652–2660.

6. Ruizhongtai, Q.C.; Li, Y.; Hao, S.; Guibas, L.J. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Adv. Neural Inf. Process. Syst. 2023, 30.

7. Rahaman, M.M.; Millar, E.K.A.; Meijering, E. Breast cancer histopathology image-based gene expression prediction using spatial transcriptomics data and deep learning. Sci. Rep. 2023, 13, 13604.

8. Thomas, H.; Qi, C.R.; Deschaud, J.E.; Marcotegui, B.; Goulette, F.; Guibas, L.J. Kpconv: Flexible and deformable convolution for point clouds. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea, 27 October–2 November 2019; pp. 6411–6420.

9. Hu, Z.; Jing, Y.; Wu, G. Decision-level fusion detection method of visible and infrared images under low light conditions. EURASIP J. Adv. Signal Process. 2023, 2023, 38.

10. Zhao, H.; Zheng, C.; Zhang, H.; Rao, M.; Li, Y.; Fang, D.; Huang, J.; Zhang, W.; Yuan, G. Diagnosis of thyroid disease using deep convolutional neural network models applied to thyroid scintigraphy images: A multicenter study. Front. Endocrinol. 2023, 14, 1224191.

11. Rehman, M.U.; Nizami, I.F.; Ullah, F.; Hussain, I. IQA Vision Transformed: A Survey of Transformer Architectures in Perceptual Image Quality Assessment. IEEE Access 2024, 12, 183369–183393.

12. Roberts, J.W.; Van Aardt, J.A.; Ahmed, F.B. Assessment of image fusion procedures using entropy, image quality, and multispectral classification. J. Appl. Remote Sens. 2008, 2, 023522.

13. Xu, Y.; Khan, T.M.; Song, Y. Edge deep learning in computer vision and medical diagnostics: A comprehensive survey. Artif. Intell. 2025, 58, 93.

14. Zhang, P.; Xu, Q.; Jiang, F. The diagnostic value of convolutional neural networks in thyroid cancer detection using ultrasound images. Front. Oncol. 2025, 15, 1534228.

15. Wang, S.; Ren, J.; Guo, X. A high-accuracy lightweight network model for X-ray image diagnosis: A case study of COVID detection. PLoS ONE 2024, 19, e0303049.

16. Yang, K.; Xiang, W.; Chen, Z.; Zhang, J.; Liu, Y. A review on infrared and visible image fusion algorithms based on neural networks. J. Vis. Commun. Image Represent. 2024, 101, 104179.

17. Fan, W.; Li, X.; Liu, Z. Fusion of visible and infrared images using GE-WA model and VGG-19 network. Sci. Rep. 2023, 13, 190.

18. Irsyad, A.; Tengyue, Z.; Shrayes, R.; Zhuyu, Q.; Brandon, T.; Hexiang, F.; Sile, W.; Ashwath, R.; Shreeram, A.; Vedrana, I.; et al. STACT-Time: Spatio-Temporal Cross Attention for Cine Thyroid Ultrasound Time Series Classification. arXiv 2025, arXiv:2506.18172.

19. Xie, E.; Wang, W.; Yu, Z.; Anandkumar, A.; Alvarez, J.M.; Luo, P. SegFormer: Simple and efficient design for semantic segmentation with transformers. Adv. Neural Inf. Process. Syst. 2021, 34, 12077–12090.

20. Fischler, M.A.; Bolles, R.C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 1981, 24, 381–395.

Downloads

Published

2026-01-26

Issue

Section

Articles