Home Science Neuro-symbolic Syntactic Parsing: Shaping a Neural...
Science

Neuro-symbolic Syntactic Parsing: Shaping a Neural Network with the CYK Algorithm

Key Points

Announce Type: new Abstract: In this paper, we show the possibility of a direct injection of algorithms into neural network architecture. We focus on a complex algorithm, that is, Cocke-Youger-Kasami (CYK) for parsing context-free grammars in Chomsky Normal Form and we propose CYKNN, a simple recurrent neural network architecture for encoding the CYK algorithm in trainable matrix-vector multiplications. We experimented with a very simple grammar with 4 variations showing that our approach...

arXiv:2605.31421v1 Announce Type: new Abstract: In this paper, we show the possibility of a direct injection of algorithms into neural network architecture. We focus on a complex algorithm, that is, Cocke-Youger-Kasami (CYK) for parsing context-free grammars in Chomsky Normal Form and we propose CYKNN, a simple recurrent neural network architecture for encoding the CYK algorithm in trainable matrix-vector multiplications.We experimented with a very simple grammar with 4 variations showing that our approach outperforms existing LLMs with more than 20B parameters with an in-context learning setting and smaller LLMs of the Qwen family fine-tuned with LoRA. Our attempt paves the way to a different approach to neuro-symbolic methodologies.
Cocke-Youger-Kasami (PERSON) Chomsky Normal Form (PERSON) CYKNN (ORG) CYK (ORG) Qwen (PERSON)
Originally published by arXiv CS Read original →