ConDefects: A New Dataset to Address the Data Leakage Concern for LLM-based Fault Localization and Program Repair

Title: ConDefects: A New Dataset to Address the Data Leakage Concern for LLM-based Fault Localization and Program Repair Authors: Yonghao Wu; Zheng Li; Jie M. Zhang; Yong Liu Year: 2023 Source: arXiv:2310.16253 Local PDF: library/pdfs/2023-condefects-a-new-dataset-to-address-the-data-leakage-concern-for-llm-based-fault-localization-and-program-repair.pdf Local fulltext: library/fulltexts/2023-condefects-a-new-dataset-to-address-the-data-leakage-concern-for-llm-based-fault-localization-and-program-repair.txt Short note: Introduces ConDefects, a dataset aimed at reducing data leakage concerns in LLM-based fault localization and program repair. Relevant to benchmark design and validity threats for modern debugging/repair evaluations.