Neural-symbolic ({NeSy}) {AI} has gained a lot of popularity by enhancing learning models with explicit reasoning capabilities. Both new systems and new benchmarks are constantly introduced\u00a0and used to evaluate learning and reasoning skills. The large variety\u00a0of systems and benchmarks, however, makes it difficult to establish\u00a0a fair comparison among the various frameworks, let alone a unifying set of benchmarking criteria. This paper analyzes\u00a0the state-of-the-art in benchmarking {NeSy} systems, studies\u00a0its limitations, and proposes ways to overcome them. We categorize popular neural-symbolic frameworks into three groups: model-theoretic, proof-theoretic fuzzy, and proof-theoretic probabilistic systems. We show how these three categories\u00a0have distinct strengths and weaknesses, and how this is reflected in\u00a0the type of tasks and benchmarks to which they are applied.<\/p>\n","protected":false},"excerpt":{"rendered":"
Neural-symbolic ({NeSy}) {AI} has gained a lot of popularity by enhancing learning models with explicit reasoning capabilities. Both new systems and new benchmarks are constantly introduced\u00a0and used to evaluate learning and reasoning skills. The large variety\u00a0of systems and benchmarks, however, makes it difficult to establish\u00a0a fair comparison among the various frameworks, let alone a unifying set of benchmarking criteria. This paper analyzes\u00a0the state-of-the-art in benchmarking {NeSy} systems, studies\u00a0its limitations, and […]<\/p>\n","protected":false},"author":12,"featured_media":0,"template":"","meta":{"_acf_changed":false,"footnotes":""},"publication-type":[32],"class_list":["post-32178","publication","type-publication","status-publish","hentry","publication-type-inproceedings"],"acf":[],"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication\/32178","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication"}],"about":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/types\/publication"}],"author":[{"embeddable":true,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/users\/12"}],"version-history":[{"count":0,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication\/32178\/revisions"}],"wp:attachment":[{"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/media?parent=32178"}],"wp:term":[{"taxonomy":"publication-type","embeddable":true,"href":"https:\/\/lamarr-institute.org\/de\/wp-json\/wp\/v2\/publication-type?post=32178"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}