• 0 Posts
  • 6 Comments
Joined 1 year ago
cake
Cake day: July 2nd, 2023

help-circle
  • lordmauve@programming.devtoMemes@sopuli.xyzSolve a puzzle for me
    link
    fedilink
    arrow-up
    5
    arrow-down
    2
    ·
    6 months ago

    I don’t deny that this kind of thing is useful for understanding the capabilities and limitations of LLMs but I don’t agree that “the best match of a next phrase given his question, and not because it can actually consider the situation.” is an accurate description of an LLM’s capabilities.

    While they are dumb and unworldly they can consider the situation: they evaluate a learned model of concepts in the world to decide if the first word of the correct answer is more likely to be yes or no. They can solve unseen problems that require this kind of cognition.

    But they are only book-learned and so they are kind of stupid about common sense things like frying pans and ovens.