FIELD NOTES TOPIC

placebo-controlled study

1 note, newest first.

  1. Form, Not Content? A Preregistered, Placebo-Controlled Evaluation of Learned Error-Conditioned Self-Repair Through Prompts and Weights in Frozen Small Code Models

    Source note ·

    The study introduces a methodology called PoPE (Popperian Placebo-controlled Evaluation) to measure whether a frozen small code language model (LLM) can use evidence that falsifies its own generated code. The study…