Prolog and LLMs/GenAI?

The key are feature vectors. According to Geoffrey Hinton’s
own statements, there was a prototype of a Little Language
Model (lLM) in 1985, he mentions it in the middle of his talk here:

Will Digital Intelligence Replace Biological Intelligence?
Geoffrey Hinton - 2024
https://www.youtube.com/watch?v=Es6yuMlyfPw

He spends a few minutes in the talk to explain how feature vectors
can represent meaning of words. And I suspect his ILM has
been reflected in this paper, probably the ChatGPT LLM ancestor:

Learning Distributed Representations of Concepts
Geoffrey Hinton - 1986
https://www.cs.toronto.edu/~hinton/absps/families.pdf

Prologers should be familier with the example he uses, i.e. Family Trees.
BTW: The family tree of Geoffrey Hinton himself is also interesting,
he is great-great-grandson of the logician George Boole.

1 Like