ProV Logo
0
Harnessing Deep Neural Networks with Log...
Hu, Zhiting...

Free

Harnessing Deep Neural Networks with Logic Rules by Hu, Zhiting ( Author )
Lemonjar Open Access
Australian National University
29-08-2023
Combining deep neural networks with structured logic rules is desirable to harness flexibility and reduce uninterpretability of the neural models. We propose a general framework capable of enhancing various types of neural networks (e.g., CNNs and RNNs) with declarative first-order logic rules. Specifically, we develop an iterative distillation method that transfers the structured information of logic rules into the weights of neural networks. We deploy the framework on a CNN for sentiment analysis, and an RNN for named entity recognition. With a few highly intuitive rules, we obtain substantial improvements and achieve state-of-the-art or comparable results to previous best-performing systems.
-
Article
pdf
30.00 KB
English
-
MYR 0.01
-
http://arxiv.org/abs/1603.06318
Share this eBook