Skip to main navigation Skip to search Skip to main content

Future Innovations in Combining Large Language Models and Knowledge Graphs

Publication: Chapter in book/Conference proceeding › Chapter in edited volume

Abstract

This chapter examines how large language models and knowledge graphs can be integrated to support factual grounding, traceable reasoning, and persistent, updatable knowledge. It develops a taxonomy covering graph-grounded retrieval and generation, KG construction, access and maintenance, and hybrid adaptive architectures. It reviews evaluation resources, emphasizing the need to assess graph access, evidence retrieval, updating, provenance, uncertainty, memory stability, and computational cost separately. Particular attention is given to graph-based agent memory, where KGs support persistent knowledge, world modeling, inference, tool and agent coordination, and governance of shared assertions. A running example of a scientific literature analyst illustrates these capabilities and their operational requirements. The chapter identifies key challenges in graph versioning, runtime logical validation, executable graph access, source discovery, and metadata interoperability. It outlines three future directions: data search engines combining natural-language interaction with federated querying over the decentralized Web of Data, a common semantic layer connecting diverse knowledge organization systems, and generative models that operate directly on language-independent semantic representations. It argues that the value of integration depends on task requirements and on maintaining graph memory that is accurate, auditable, reversible, and governable over time.
Original languageEnglish
Title of host publicationKnowledge Graphs and Large Language Models
Subtitle of host publicationCurrent approaches, challenges, and future directions
EditorsSanju Tiwari, Sven Groppe, Jinghua Groppe, Nandana Mihindukulasooriya
Place of PublicationLondon/Cambridge, MA
PublisherAcademic Press
Chapter11
Pages185-212
Number of pages28
ISBN (Electronic)9780443452451
ISBN (Print)9780443452444
Publication statusPublished - 6 Nov 2026

Publication series

SeriesIntelligent Data-Centric Systems

Austrian Classification of Fields of Science and Technology (ÖFOS)

  • 102001 Artificial intelligence
  • 102028 Knowledge engineering
  • 102030 Semantic technologies

Keywords

  • Knowledge graphs
  • Large language models
  • Neuro-symbolic AI
  • Agentic AI
  • Graph-based agent memory
  • GraphRAG
  • Semantic Web
  • Federated querying
  • Knowledge provenance
  • Knowledge management

Cite this