Funsearch
February 11th, 2024
The core iteration loop in the Funsearch paper is so simple:
generate => evaluate => best-shot => generate => ...I imagine this is similar to how a lot of people ideate with LLMs:
- generate 5 ideas
- "my favorites are #2 and #4, please generate 5 more"
- ...
(one difference being that funsearch uses a population model to avoid getting stuck at local optima)
As they call out, the biggest challenge is "how do you establish an effective evaluator?", especially for multi-step tasks. (How do we do credit assignment?)