LLM Agents Play Pokemon Showdown

(olivergrabner.com)

12 points | by grabnero 46 minutes ago

4 comments

  • doctorpangloss 5 minutes ago
    Pokémon Showdown isn't a game so much as it is competitive Wiki reading.
  • pgn 15 minutes ago
    what was the selection for the teams? random per round? how does it play against people in ladder?
  • deadbabe 34 minutes ago
    Jev will give better results on this kind of thing.
    • nico 12 minutes ago
      For sure are many better models for this use case[0]

      At the same time, it’s interesting seeing how generally capable language models/LLMs/agents/harnesses are getting

      We’ll probably see a lot more experiments and benchmarks like these in the near future

      0: simple classifiers can play quite a few game, including Doom https://playground.jeffyclassify.com/#doom