injecting_domain_knowledge_into_deep_neural_networks_for_tree_crown_delineation.pdf (8.09 MB)
Download file

Injecting Domain Knowledge Into Deep Neural Networks for Tree Crown Delineation

Download (8.09 MB)
posted on 2022-07-22, 20:02 authored by Ira HarmonIra Harmon, Sergio Marconi, Ben Weinstein, Sarah Graves, Daisy Zhe Wang, Stephanie Bohlman, Alina Zare, Aditya Singh, Ethan White

Automated individual tree crown (ITC) delineation plays an important role in forest remote sensing. Accurate ITC delineation benefits biomass estimation, allometry estimation, and species classification among other forest related tasks, all of which are used to monitor forest health and make important decisions in forest management.  In this paper, we introduce Neuro-Symbolic DeepForest,  a convolutional neural network (CNN) based ITC delineation algorithm that uses a neuro-symbolic framework to inject domain knowledge (represented as rules written in probabilistic soft logic) into a CNN.  We create rules that encode concepts for competition, allometry, constrained growth, mean ITC area, and crown color.  Our results show that the delineation model learns from the annotated training data as well as the rules and that under some conditions, the injection of rules improves model performance and affects model bias.  We then analyze the effects of each rule on its related aspects of model performance.


Email Address of Submitting Author

Submitting Author's Institution

University of Florida

Submitting Author's Country

  • United States of America

Usage metrics