I’d appreciate it if everyone could just stop burning fossil fuels, please. Thank you for your cooperation.

  • 11 Posts
  • 356 Comments
Joined 2 years ago
cake
Cake day: November 3rd, 2023

help-circle










  • That’s a fine illustration of the problem, whatever it’s properly called.

    Having paused to search the web I find that “ablation” according to wikipedia is a term used in AI since 1974. Arxiv.org has a recent paper talking specifically about “semantic ablation” which phrase it uses to describe an operation deliberately removing semantic information from an LLM’s representation of a sentence in an attempt to see what purely syntactical information is left over afterwards, or something like that.