Gaetano Sapia

Incoherence as Oracle-less Measure of Error in LLM-Based Code Generation

Generating code from a natural language programming task is one of the most successful applications of Large Language Models (LLMs). Yet, the generated program may be buggy. Without an oracle, such as an existing, correct implementation or a formal specification, can we somehow estimate how likely t