Software Engineering Empirical Research Radar

Testing / QA Papers

Papers tagged as Testing / QA.

PaperVenueYearTopics
Assessing the Impact of Code Changes on the Fault Localizability of Large Language Models
Sabaat Haroon, Ahmand Faraz Khan, Ahmad Humayun, Waris Gill, Abdul Haddi Amjad		ICST2026Debugging / Fault Localization / Diagnosis / Repair; AI / LLM for SE; Testing / QA
xFUZZ: A Flexible Framework for Fine-Grained, Runtime-Adaptive Fuzzing Strategy Composition.
Dongsong Yu; Yiyi Wang; Chao Zhang 0008; Yang Lan; Zhiyuan Jiang; Shuitao Gan; Zheyu Ma; Wende Tan		ISSTA2025Testing / QA
ZTaint-Havoc: From Havoc Mode to Zero-Execution Fuzzing-Driven Taint Inference.
Yuchong Xie; Wenhui Zhang; Dongdong She		ISSTA2025Testing / QA; Security / Privacy / Vulnerability
You Name It, I Run It: An LLM Agent to Execute Tests of Arbitrary Projects.
Islem Bouzenia; Michael Pradel		ISSTA2025Testing / QA; AI / LLM for SE
WildSync: Automated Fuzzing Harness Synthesis via Wild API Usage Recovery.
Wei-Cheng Wu; Stefan Nagy; Christophe Hauser		ISSTA2025Testing / QA; Maintenance / Evolution / Refactoring / Review
Unlocking Low Frequency Syscalls in Kernel Fuzzing with Dependency-Based RAG.
Zhiyu Zhang 0017; Longxing Li; Ruigang Liang; Kai Chen 0012		ISSTA2025Testing / QA
Tratto: A Neuro-Symbolic Approach to Deriving Axiomatic Test Oracles.
Davide Molinelli; Alberto Martin-Lopez; Elliott Zackrone; Beyza Eken; Michael D. Ernst; Mauro Pezzè		ISSTA2025Testing / QA; Program Analysis / Verification / Formal Methods
Testing the Fault-Tolerance of Multi-sensor Fusion Perception in Autonomous Driving Systems.
Haoxiang Tian 0001; Wenqiang Ding; Xingshuo Han; Guoquan Wu; An Guo 0002; Junqi Zhang; Wei Chen 0018; Jun Wei 0001; Tianwei Zhang 0004		ISSTA2025Testing / QA; Human / Empirical / Socio-technical
TerzoN: Human-in-the-Loop Software Testing with a Composite Oracle.
Matthew C. Davis; Amy Wei; Brad A. Myers; Joshua Sunshine		ISSTA2025Testing / QA; Human / Empirical / Socio-technical
Structure-Aware, Diagnosis-Guided ECU Firmware Fuzzing.
Qicai Chen; Kun Hu 0001; Sichen Gong; Bihuan Chen 0001; Zikui Kong; Haowen Jiang; Bingkun Sun; You Lu 0005; Xin Peng 0001		ISSTA2025Testing / QA
STRUT: Structured Seed Case Guided Unit Test Generation for C Programs using LLMs.
Jinwei Liu; Chao Li 0078; Rui Chen 0042; Shaofeng Li; Bin Gu 0006; Mengfei Yang		ISSTA2025Testing / QA
Reinforcement Learning-Based Fuzz Testing for the Gazebo Robotic Simulator.
Zhilei Ren; Yitao Li; Xiaochen Li; Guanxiao Qi; Jifeng Xuan; He Jiang 0001		ISSTA2025Testing / QA; AI / LLM for SE
REACCEPT: Automated Co-evolution of Production and Test Code Based on Dynamic Validation and Large Language Models.
Jianlei Chi; Xiaotian Wang; Yuhan Huang; Lechen Yu; Di Cui; Jianguo Sun; Jun Sun 0001		ISSTA2025Testing / QA; Maintenance / Evolution / Refactoring / Review
Quantum Concolic Testing.
Shangzhou Xia; Jianjun Zhao 0001; Fuyuan Zhang; Xiaoyu Guo 0007		ISSTA2025Testing / QA; Program Analysis / Verification / Formal Methods
QTRAN: Extending Metamorphic-Oracle Based Logical Bug Detection Techniques for Multiple-DBMS Dialect Support.
Li Lin; Qinglin Zhu; Hongqiao Chen; Zhuangda Wang; Rongxin Wu; Xiaoheng Xie		ISSTA2025Testing / QA
Program Feature-Based Benchmarking for Fuzz Testing.
Miao Miao 0001; Sriteja Kummita; Eric Bodden; Shiyi Wei		ISSTA2025Testing / QA
Productively Deploying Emerging Models on Emerging Platforms: A Top-Down Approach for Testing and Debugging.
Siyuan Feng 0007; Jiawei Liu 0004; Ruihang Lai; Charlie Ruan; Yong Yu 0001; Lingming Zhang 0001; Tianqi Chen 0001		ISSTA2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
OpDiffer: LLM-Assisted Opcode-Level Differential Testing of Ethereum Virtual Machine.
Jie Ma; Ningyu He; Jinwen Xi; Mingzhe Xing; Haoyu Wang 0001; Ying Gao 0006; Yinliang Yue		ISSTA2025Testing / QA; AI / LLM for SE
No Bias Left Behind: Fairness Testing for Deep Recommender Systems Targeting General Disadvantaged Groups.
Zhuo Wu; Zan Wang; Chuan Luo 0002; Xiaoning Du 0001; Junjie Chen 0003		ISSTA2025Testing / QA
Model Checking Guided Incremental Testing for Distributed Systems.
Yu Gao 0002; Dong Wang 0048; Wensheng Dou; Wenhan Feng; Yu Liang; Yuan Feng; Jun Wei 0001		ISSTA2025Testing / QA; Program Analysis / Verification / Formal Methods; Cloud / Microservices / Distributed Systems
MoDitector: Module-Directed Testing for Autonomous Driving Systems.
Renzhi Wang; Mingfei Cheng; Xiaofei Xie; Yuan Zhou 0005; Lei Ma 0003		ISSTA2025Testing / QA
KRAKEN: Program-Adaptive Parallel Fuzzing.
Anshunkang Zhou; Heqing Huang 0002; Charles Zhang 0001		ISSTA2025Testing / QA
Intention-Based GUI Test Migration for Mobile Apps using Large Language Models.
Shaoheng Cao; Minxue Pan; Yuanhong Lan; Xuandong Li		ISSTA2025Testing / QA; Maintenance / Evolution / Refactoring / Review; Mobile / Web / GUI / Android
Improving Deep Learning Framework Testing with Model-Level Metamorphic Testing.
Yanzhou Mu; Juan Zhai; Chunrong Fang; Xiang Chen 0005; Zhixiang Cao; Peiran Yang; Kexin Zhao; An Guo 0002; Zhenyu Chen 0001		ISSTA2025Testing / QA; AI / LLM for SE
Gamifying Testing in IntelliJ: A Replicability Study.
Philipp Straubinger; Tommaso Fulcini; Giacomo Garaccione; Luca Ardito; Gordon Fraser 0001		ISSTA2025Testing / QA; Human / Empirical / Socio-technical
GUIPilot: A Consistency-Based Mobile GUI Testing Approach for Detecting Application-Specific Bugs.
Ruofan Liu; Xiwen Teoh; Yun Lin 0001; Guanjie Chen; Ruofei Ren; Denys Poshyvanyk; Jin Song Dong 0001		ISSTA2025Testing / QA; Mobile / Web / GUI / Android
FreeWavm: Enhanced WebAssembly Runtime Fuzzing Guided by Parse Tree Mutation and Snapshot.
Peng Qian; Xinlei Ying; Jiashui Wang; Long Liu; Lun Zhang; Jianhai Chen; Qinming He		ISSTA2025Testing / QA
FANDANGO: Evolving Language-Based Testing.
José Antonio Zamudio Amaya; Marius Smytzek; Andreas Zeller		ISSTA2025Testing / QA; Maintenance / Evolution / Refactoring / Review
Effective REST APIs Testing with Error Message Analysis.
Lixin Xu; Huayao Wu; Zhenyu Pan; Tongtong Xu; Shaohua Wang 0002; Xintao Niu; Changhai Nie		ISSTA2025Testing / QA
Automated Test Transfer across Android Apps using Large Language Models.
Benyamin Beyzaei; Saghar Talebipour; Ghazal Rafiei; Nenad Medvidovic; Sam Malek		ISSTA2025Testing / QA; Mobile / Web / GUI / Android
AudioTest: Prioritizing Audio Test Cases.
Yinghua Li; Xueqi Dang; Wendkûuni C. Ouédraogo; Jacques Klein; Tegawendé F. Bissyandé		ISSTA2025Testing / QA
Assessing Scene Generation Techniques for Testing COLREGS-Compliance of Autonomous Surface Vehicles.
Dominik Frey; Ulf Kargén; Dániel Varró		ISSTA2025Testing / QA
A Large-Scale Empirical Study on Fine-Tuning Large Language Models for Unit Testing.
Ye Shang; Quanjun Zhang; Chunrong Fang; Siqi Gu; Jianyi Zhou; Zhenyu Chen 0001		ISSTA2025Testing / QA; Human / Empirical / Socio-technical
exLong: Generating Exceptional Behavior Tests with Large Language Models.
Jiyang Zhang 0003, Yu Liu 0079, Pengyu Nie 0001, Junyi Jessy Li, Milos Gligoric 0001		ICSE2025Testing / QA
Your Fix Is My Exploit: Enabling Comprehensive DL Library API Fuzzing with Large Language Models.
Kunpeng Zhang, Shuai Wang, Jitao Han, Xiaogang Zhu 0001, Xian Li		ICSE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Security / Privacy / Vulnerability
What You See is What You Get: Attention-Based Self-Guided Automatic Unit Test Generation.
Xin Yin, Chao Ni 0001, Xiaodan Xu, Xiaohu Yang 0001		ICSE2025Testing / QA
Understanding the Effectiveness of Coverage Criteria for Large Language Models: A Special Angle from Jailbreak Attacks.
Shide Zhou, Tianlin Li, Kailong Wang 0001, Yihao Huang 0001, Ling Shi 0002		ICSE2025Testing / QA
Tumbling Down the Rabbit Hole: How do Assisting Exploration Strategies Facilitate Grey-Box Fuzzing?
Mingyuan Wu, Jiahong Xiang, Kunqiu Chen, Peng Di, Shin Hwei Tan		ICSE2025Testing / QA
TransferFuzz: Fuzzing with Historical Trace for Verifying Propagated Vulnerability Code.
Siyuan Li 0014, Yuekang Li, Zuxin Chen, Chaopeng Dong, Yongpan Wang		ICSE2025Testing / QA
Towards High-Strength Combinatorial Interaction Testing for Highly Configurable Software Systems.
Chuan Luo 0002, Shuangyu Lyu, Wei Wu 0011, Hongyu Zhang 0002, Dianhui Chu		ICSE2025Testing / QA
The Seeds of the Future Sprout from History: Fuzzing for Unveiling Vulnerabilities in Prospective Deep-Learning Libraries.
Zhiyuan Li, Jingzheng Wu, Xiang Ling 0001, Tianyue Luo, Zhiqing Rui		ICSE2025Testing / QA
Thanos: DBMS Bug Detection via Storage Engine Rotation Based Differential Testing.
Ying Fu, Zhiyong Wu 0010, Yuanliang Zhang, Jie Liang 0006, Jingzhou Fu		ICSE2025Testing / QA
Testing and Understanding Deviation Behaviors in FHE-Hardened Machine Learning Models.
Yiteng Peng, Daoyuan Wu, Zhibo Liu, Dongwei Xiao, Zhenlan Ji		ICSE2025Testing / QA; AI / LLM for SE
Test Intention Guided LLM-Based Unit Test Generation.
Zifan Nan, Zhaoqiang Guo, Kui Liu 0001, Xin Xia 0001		ICSE2025Testing / QA; AI / LLM for SE
TOGLL: Correct and Strong Test Oracle Generation with LLMS.
Soneya Binta Hossain, Matthew B. Dwyer		ICSE2025Testing / QA
Selecting Initial Seeds for Better JVM Fuzzing.
Tianchang Gao, Junjie Chen 0003, Dong Wang 0044, Yile Guo, Yingquan Zhao		ICSE2025Testing / QA
Scenario-Driven and Context-Aware Automated Accessibility Testing for Android Apps.
Yuxin Zhang, Sen Chen 0001, Xiaofei Xie, Zibo Liu, Lingling Fan 0003		ICSE2025Testing / QA; Mobile / Web / GUI / Android
Sand: Decoupling Sanitization from Fuzzing for Low Overhead.
Ziqiao Kong, Shaohua Li 0002, Heqing Huang 0002, Zhendong Su 0001		ICSE2025Testing / QA
Rug: Turbo Llm for Rust Unit Test Generation.
Xiang Cheng, Fan Sang, Yizhuo Zhai, Xiaokuan Zhang, Taesoo Kim		ICSE2025Testing / QA; AI / LLM for SE
RediI: Test Infrastructure to Enable Deterministic Reproduction of Failures for Distributed Systems.
Yang Feng 0003, Zheyuan Lin, Dongchen Zhao, Mengbo Zhou, Jia Liu		ICSE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Cloud / Microservices / Distributed Systems
Ranking Relevant Tests for Order-Dependent Flaky Tests.
Shanto Rahman, Bala Naren Chanumolu, Suzzana Rafi, August Shi, Wing Lam		ICSE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
ROSA: Finding Backdoors with Fuzzing.
Dimitri Kokkonis, Michaël Marcozzi, Emilien Decoux, Stefano Zacchiroli		ICSE2025Testing / QA
No Harness, No Problem: Oracle-guided Harnessing for Auto-generating C API Fuzzing Harnesses.
Gabriel Sherman, Stefan Nagy		ICSE2025Testing / QA
Navigating the Testing of Evolving Deep Learning Systems: An Exploratory Interview Study.
Hanmo You, Zan Wang, Bin Lin 0008, Junjie Chen 0003		ICSE2025Testing / QA; AI / LLM for SE; Human / Empirical / Socio-technical; Maintenance / Evolution / Refactoring / Review
NIODebugger: A Novel Approach to Repair Non-Idempotent-Outcome Tests with LLM-Based Agent.
Kaiyao Ke		ICSE2025Testing / QA; AI / LLM for SE; Debugging / Fault Localization / Diagnosis / Repair
Mock Deep Testing: Toward Separate Development of Data and Models for Deep Learning.
Ruchira Manke, Mohammad Wardat, Foutse Khomh, Hridesh Rajan		ICSE2025Testing / QA; AI / LLM for SE
Mobile Application Coverage: The 30% Curse and Ways Forward.
Faridah Akinotcho, Lili Wei, Julia Rubin		ICSE2025Testing / QA; Mobile / Web / GUI / Android
Lightweight Concolic Testing via Path-Condition Synthesis for Deep Learning Libraries.
Sehoon Kim, Yonghyeon Kim, Dahyeon Park, Yuseok Jeon, Jooyong Yi		ICSE2025Testing / QA; AI / LLM for SE; Program Analysis / Verification / Formal Methods
Leveraging Large Language Models for Enhancing the Understandability of Generated Unit Tests.
Amirhossein Deljouyi, Roham Koohestani, Maliheh Izadi, Andy Zaidman		ICSE2025Testing / QA
LWDIFF: an LLM-Assisted Differential Testing Framework for Webassembly Runtimes.
Shiyao Zhou, Jincheng Wang, He Ye, Hao Zhou 0043, Claire Le Goues		ICSE2025Testing / QA; AI / LLM for SE
LLM-Agents Driven Automated Simulation Testing and Analysis of small Uncrewed Aerial Systems.
Venkata Sai Aswath Duvvuru, Bohan Zhang, Michael Vierhauser, Ankit Agrawal 0002		ICSE2025Testing / QA; AI / LLM for SE
LLM Based Input Space Partitioning Testing for Library APIs.
Jiageng Li, Zhen Dong, Chong Wang, Haozhen You, Cen Zhang		ICSE2025Testing / QA; AI / LLM for SE
Invivo Fuzzing by Amplifying Actual Executions.
Octavio Galland, Marcel Böhme		ICSE2025Testing / QA
Insvdf: Interface-State-Aware Virtual Device Fuzzing.
Zexiang Zhang, Gaoning Pan, Ruipeng Wang, Yiming Tao, Zulie Pan		ICSE2025Testing / QA
Increasing the Effectiveness of Automatically Generated Tests by Improving Class Observability.
Geraldine Galindo-Gutierrez, Juan Pablo Sandoval Alcocer, Nicolas Jimenez-Fuentes, Alexandre Bergel, Gordon Fraser 0001		ICSE2025Testing / QA; Cloud / Microservices / Distributed Systems
IRFuzzer: Specialized Fuzzing for LLVM Backend Code Generation.
Yuyang Rong, Zhanghan Yu, Zhenkai Weng, Stephen Neuendorffer, Hao Chen		ICSE2025Testing / QA
Fuzzing MLIR Compilers with Custom Mutation Synthesis.
Ben Limpanukorn, Jiyuan Wang, Hong Jin Kang, Eric Zitong Zhou, Miryung Kim		ICSE2025Testing / QA
Fork State-Aware Differential Fuzzing for Blockchain Consensus Implementations.
Wonhoi Kim, Hocheol Nam 0001, Muoi Tran, Amin Jalilov, Zhenkai Liang		ICSE2025Testing / QA; Security / Privacy / Vulnerability
Fidelity of Cloud Emulators: The Imitation Game of Testing Cloud-Based Software.
Anna Mazhar, Saad Sher Alam, William X. Zheng, Yinfang Chen, Suman Nath		ICSE2025Testing / QA; Cloud / Microservices / Distributed Systems
Feature-Driven End-to-End Test Generation.
Parsa Alian, Noor Nashid, Mobina Shahbandeh, Taha Shabani, Ali Mesbah 0001		ICSE2025Testing / QA
Faster Configuration Performance Bug Testing with Neural Dual-Level Prioritization.
Youpeng Ma, Tao Chen 0001, Ke Li 0001		ICSE2025Testing / QA; AI / LLM for SE; DevOps / CI / Build / Release; Performance / Energy / Reliability
Fairness Testing Through Extreme Value Theory.
Verya Monjezi, Ashutosh Trivedi 0001, Vladik Kreinovich, Saeid Tizpaz-Niari		ICSE2025Testing / QA
FairChecker: Detecting Fund-Stealing Bugs in DeFi Protocols via Fairness Validation.
Yi Sun 0004, Zhuo Zhang 0002, Xiangyu Zhang 0001		ICSE2025Testing / QA
Efficient Domain Augmentation for Autonomous Driving Testing Using Diffusion Models.
Luciano Baresi, Davide Yi Xian Hu, Andrea Stocco 0001, Paolo Tonella		ICSE2025Testing / QA
Does GenAI Make Usability Testing Obsolete?
Ali Ebrahimi Pourasad, Walid Maalej		ICSE2025Testing / QA
Dissecting Global Search: A Simple Yet Effective Method to Boost Individual Discrimination Testing and Repair.
Lili Quan, Tianlin Li, Xiaofei Xie, Zhenpeng Chen, Sen Chen 0001		ICSE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Critical Variable State-Aware Directed Greybox Fuzzing.
Xu Chen, Ningning Cui, Zhe Pan, Liwei Chen, Gang Shi		ICSE2025Testing / QA
Coni: Detecting Database Connector Bugs via State-Aware Test Case Generation.
Wenqian Deng, Jie Liang 0006, Zhiyong Wu 0010, Jingzhou Fu, Mingzhe Wang		ICSE2025Testing / QA
Clozemaster: Fuzzing Rust Compiler by Harnessing Llms for Infilling Masked Real Programs.
Hongyan Gao, Yibiao Yang, Maolin Sun, Jiangchang Wu, Yuming Zhou		ICSE2025Testing / QA
Chatgpt-Based Test Generation for Refactoring Engines Enhanced by Feature Analysis on Examples.
Chunhao Dong, Yanjie Jiang, Yuxia Zhang, Yang Zhang, Hui Liu		ICSE2025Testing / QA; AI / LLM for SE; Maintenance / Evolution / Refactoring / Review
Automating a Complete Software Test Process Using LLMs: An Automotive Case Study.
Shuai Wang, Yinan Yu, Robert Feldt, Dhasarathy Parthasarathy		ICSE2025Testing / QA; Human / Empirical / Socio-technical
Automated Test Generation For Smart Contracts via On-Chain Test Case Augmentation and Migration.
Jiashuo Zhang 0001, Jiachi Chen, John Grundy 0001, Jianbo Gao 0003, Yanlin Wang 0001		ICSE2025Testing / QA; Maintenance / Evolution / Refactoring / Review
Automated Generation of Accessibility Test Reports from Recorded User Transcripts.
Syed Fatiul Huq, Mahan Tafreshipour, Kate Kalcevich, Sam Malek		ICSE2025Testing / QA; Mobile / Web / GUI / Android
A Test Oracle for Reinforcement Learning Software Based on Lyapunov Stability Control Theory.
Shiyu Zhang, Haoyang Song, Qixin Wang 0001, Henghua Shen, Yu Pei 0001		ICSE2025Testing / QA
A Tale of Two DL Cities: When Library Tests Meet Compiler.
Qingchao Shen, Yongqiang Tian 0001, Haoyang Ma, Junjie Chen 0003, Lili Huang		ICSE2025Testing / QA
A Multi-Agent Approach for REST API Testing with Semantic Graphs and LLM-Driven Inputs.
Myeongsoo Kim, Tyler Stennett, Saurabh Sinha 0003, Alessandro Orso		ICSE2025Testing / QA; AI / LLM for SE
A Little Goes a Long Way: Tuning Configuration Selection for Continuous Kernel Fuzzing.
Sanan Hasanov, Stefan Nagy, Paul Gazzillo		ICSE2025Testing / QA; DevOps / CI / Build / Release
A Differential Testing Framework to Identify Critical AV Failures Leveraging Arbitrary Inputs.
Trey Woodlief, Carl Hildebrandt, Sebastian G. Elbaum		ICSE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
$\mu \text{PRL}$: A Mutation Testing Pipeline for Deep Reinforcement Learning Based on Real Faults.
Deepak-George Thomas, Matteo Biagiola, Nargiz Humbatova, Mohammad Wardat, Gunel Jahangirova		ICSE2025Testing / QA; AI / LLM for SE; DevOps / CI / Build / Release
VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulation.
Zhijie Wang 0014; Zhehua Zhou; Jiayang Song; Yuheng Huang 0004; Zhan Shu 0001; Lei Ma 0003		FSE2025Testing / QA
UnitCon: Synthesizing Targeted Unit Tests for Java Runtime Exceptions.
Sujin Jang; Yeonhee Ryou; Heewon Lee; Kihong Heo		FSE2025Testing / QA
Understanding and Characterizing Mock Assertions in Unit Tests.
Hengcheng Zhu 0001; Valerio Terragni; Lili Wei 0001; Shing-Chi Cheung; Jiarong Wu; Yepang Liu 0001		FSE2025Testing / QA
Understanding Industry Perspectives of Static Application Security Testing (SAST) Evaluation.
Yuan Li; Peisen Yao; Kan Yu; Chengpeng Wang 0001; Yaoyang Ye; Song Li 0006; Meng Luo 0002; Yepang Liu 0001; Kui Ren 0001		FSE2025Testing / QA; Security / Privacy / Vulnerability
Standing on the Shoulders of Giants: Bug-Aware Automated GUI Testing via Retrieval Augmentation.
Mengzhuo Chen; Zhe Liu 0025; Chunyang Chen 0001; Junjie Wang 0001; Boyu Wu; Jun Hu 0015; Qing Wang 0001		FSE2025Testing / QA; Mobile / Web / GUI / Android
Smart Contract Fuzzing Towards Profitable Vulnerabilities.
Ziqiao Kong; Cen Zhang; Maoyi Xie; Ming Hu 0003; Yue Xue; Ye Liu 0012; Haijun Wang 0002; Yang Liu 0003		FSE2025Testing / QA; Security / Privacy / Vulnerability
RegTrieve: Reducing System-Level Regression Errors for Machine Learning Systems via Retrieval-Enhanced Ensemble.
Junming Cao; Xuwen Xiang; Mingfei Cheng; Bihuan Chen 0001; Xinyan Wang; You Lu 0005; Chaofeng Sha; Xiaofei Xie; Xin Peng 0001		FSE2025Testing / QA; AI / LLM for SE
On-Demand Scenario Generation for Testing Automated Driving Systems.
Songyang Yan; Xiaodong Zhang 0014; Kunkun Hao; Haojie Xin; Yonggang Luo; Jucheng Yang 0001; Ming Fan 0002; Chao Yang 0025; Jun Sun 0001; Zijiang Yang 0006		FSE2025Testing / QA
Multi-modal Traffic Scenario Generation for Autonomous Driving System Testing.
Zhi Tu; Liangkun Niu; Wei Fan; Tianyi Zhang 0001		FSE2025Testing / QA
LlamaRestTest: Effective REST API Testing with Small Language Models.
Myeongsoo Kim; Saurabh Sinha 0003; Alessandro Orso		FSE2025Testing / QA
Liberating Libraries through Automated Fuzz Driver Generation: Striking a Balance without Consumer Code.
Flavio Toffalini; Nicolas Badoux; Zurab Tsinadze; Mathias Payer		FSE2025Testing / QA
Less Is More: On the Importance of Data Quality for Unit Test Generation.
Junwei Zhang; Xing Hu 0008; Shan Gao 0009; Xin Xia 0001; David Lo 0001; Shanping Li		FSE2025Testing / QA
LLMDroid: Enhancing Automated Mobile App GUI Testing Coverage with Large Language Model Guidance.
Chenxu Wang 0011; Tianming Liu 0002; Yanjie Zhao 0001; Minghui Yang; Haoyu Wang 0001		FSE2025Testing / QA; AI / LLM for SE; Mobile / Web / GUI / Android
Doc2OracLL: Investigating the Impact of Documentation on LLM-Based Test Oracle Generation.
Soneya Binta Hossain; Raygan Taylor; Matthew B. Dwyer		FSE2025Testing / QA; AI / LLM for SE
Directed Testing in MLIR: Unleashing Its Potential by Overcoming the Limitations of Random Fuzzing.
Weiyuan Tong; Zixu Wang; Zhanyong Tang; Jianbin Fang; Yuqun Zhang; Guixin Ye		FSE2025Testing / QA
Detecting and Reducing the Factual Hallucinations of Large Language Models with Metamorphic Testing.
Weibin Wu 0002; Yuhang Cao; Ning Yi; Rongyi Ou; Zibin Zheng		FSE2025Testing / QA
Demystifying Memorization in LLM-Based Program Repair via a General Hypothesis Testing Framework.
Jiaolong Kong; Xiaofei Xie; Shangqing Liu		FSE2025Testing / QA; AI / LLM for SE; Debugging / Fault Localization / Diagnosis / Repair
CoverUp: Effective High Coverage Test Generation for Python.
Juan Altmayer Pizzorno; Emery D. Berger		FSE2025Testing / QA
CRISPE: Semantic-Guided Execution Planning and Dynamic Reasoning for Enhancing Code Coverage Prediction.
Hridya Dhulipala; Aashish Yadavally; Smit Soneshbhai Patel; Tien N. Nguyen		FSE2025Testing / QA
Automated Unit Test Refactoring.
Yi Gao; Xing Hu 0008; Xiaohu Yang 0001; Xin Xia 0001		FSE2025Testing / QA; Maintenance / Evolution / Refactoring / Review
Automated Trustworthiness Oracle Generation for Machine Learning Text Classifiers.
Lam Nguyen Tung; Steven Cho; Xiaoning Du 0001; Neelofar; Valerio Terragni; Stefano Ruberto; Aldeida Aleti		FSE2025Testing / QA; AI / LLM for SE
Automated Soap Opera Testing Directed by LLMs and Scenario Knowledge: Feasibility, Challenges, and Road Ahead.
Yanqi Su; Zhenchang Xing; Chong Wang 0013; Chunyang Chen 0001; Xiwei Xu 0001; Qinghua Lu 0001; Liming Zhu 0001		FSE2025Testing / QA
AlphaTrans: A Neuro-Symbolic Compositional Approach for Repository-Level Code Translation and Validation.
Ali Reza Ibrahimzada; Kaiyao Ke; Mrigank Pawagi; Muhammad Salman Abid; Rangeet Pan; Saurabh Sinha 0003; Reyhaneh Jabbarvand		FSE2025Testing / QA; Program Analysis / Verification / Formal Methods; DevOps / CI / Build / Release
Adaptive Random Testing with Q-grams: The Illusion Comes True.
Matteo Biagiola; Robert Feldt; Paolo Tonella		FSE2025Testing / QA
A Mixed-Methods Study of Model-Based GUI Testing in Real-World Industrial Settings.
Shaoheng Cao; Renyi Chen; Wenhua Yang 0001; Minxue Pan; Xuandong Li		FSE2025Testing / QA; Human / Empirical / Socio-technical; Mobile / Web / GUI / Android
ZendDiff: Differential Testing of PHP Interpreter.
Yuancheng Jiang, Jianing Wang, Qiange Liu, Yeqi Fu, Jian Mao		ASE2025Testing / QA
XRintTest: An Automated Framework for User Interaction Testing in Extended Reality Applications.
Ruizhen Gu, José Miguel Rojas, Donghwan Shin 0001		ASE2025Testing / QA
WingMuzz: Blackbox Testing of IoT Protocols via Two-dimensional Fuzzing Schedule.
Xiaogang Zhu 0001, Enze Dai, Xiaotao Feng, Shaohua Wang 0002, Xin Xia 0001		ASE2025Testing / QA
Who's to Blame? Rethinking the Brittleness of Automated Web GUI Testing from a Pragmatic Perspective.
Haonan Zhang 0006, Kundi Yao, Zishuo Ding, Lizhi Liao, Weiyi Shang		ASE2025Testing / QA; Mobile / Web / GUI / Android
When Control Flows Deviate: Directed Grey-box Fuzzing with Probabilistic Reachability Analysis.
Peihong Lin, Pengfei Wang, Xu Zhou 0004, Wei Xie 0007, Xin Ren		ASE2025Testing / QA
What's DAT Smell? Untangling and Weaving the Disjoint Assertion Tangle Test Smell.
Monil Narang, Hang Du, James A. Jones		ASE2025Testing / QA
WEST: Specification-Based Test Generation for WebAssembly.
Dongjun Youn, Wonho Shin, Sukyoung Ryu		ASE2025Testing / QA; Program Analysis / Verification / Formal Methods
VRTestSniffer: Test Smell Detector for Virtual Reality (VR) Software Projects.
Faraz Gurramkonda, Avishak Chakroborty, Bruce Maxim, Mohamed Wiem Mkaouer, Foyzul Hassan		ASE2025Testing / QA
VRExplorer: A Model-based Approach for Semi-Automated Testing of Virtual Reality Scenes.
Zhengyang Zhu, Hong-Ning Dai, Hanyang Guo, Zeqin Liao, Zibin Zheng		ASE2025Testing / QA
Using Fourier Analysis and Mutant Clustering to Accelerate DNN Mutation Testing.
Ali Ghanbari 0001, Sasan Tavakkol		ASE2025Testing / QA
Using Active Learning to Train Predictive Mutation Testing with Minimal Data.
Miklos Borsi		ASE2025Testing / QA
Unit Test Update through LLM-Driven Context Collection and Error-Type-Aware Refinement.
Yuanhe Zhang, Zhiquan Yang, Shengyi Pan, Zhongxin Liu 0002		ASE2025Testing / QA; AI / LLM for SE; Program Analysis / Verification / Formal Methods
Tron: Fuzzing Linux Network Stack via Protocol-System Call Payload Synthesis.
Qiang Zhang, Yifei Chu, Yuheng Shen, Jianzhong Liu, Heyuan Shi		ASE2025Testing / QA
Thinking Longer, Not Larger: Enhancing Software Engineering Agents via Scaling Test-Time Compute.
Yingwei Ma, Yongbin Li, Yihong Dong, Xue Jiang, Yanhao Li		ASE2025Testing / QA
Testing Autonomous Driving Systems Through Blind-Spot Guided Fuzzing.
Sali Moussa		ASE2025Testing / QA
Terminator: Enabling Efficient Fuzzing of Closed-Source GUI Programs by Automatic Coverage-Guided Termination.
Jonas Zabel, Philip Kolvenbach, Steven Arzt		ASE2025Testing / QA; Mobile / Web / GUI / Android
Tephra: Principled Discovery of Fuzzer Limitations.
Vasil Sarafov, David Markvica, Stefan Brunthaler 0001		ASE2025Testing / QA
Streamlining Acceptance Test Generation for Mobile Applications Through Large Language Models: An Industrial Case Study.
Pedro Luís Fonseca, Bruno Lima, João Pascoal Faria		ASE2025Testing / QA; Human / Empirical / Socio-technical; Mobile / Web / GUI / Android
State Field Coverage: A Metric for Oracle Quality.
Facundo Molina, Nazareno Aguirre, Alessandra Gorla		ASE2025Testing / QA
SPICE: An Automated SWE-Bench Labeling Pipeline for Issue Clarity, Test Coverage, and Effort Estimation.
Gustavo Ansaldi Oliva, Gopi Krishnan Rajbahadur, Aaditya Bhatia, Haoxiang Zhang 0001, Yihao Chen		ASE2025Testing / QA; DevOps / CI / Build / Release
SATORI: Static Test Oracle Generation for REST APIs.
Juan C. Alonso, Alberto Martin-Lopez, Sergio Segura, Gabriele Bavota, Antonio Ruiz-Cortés		ASE2025Testing / QA
RustAssure: Differential Symbolic Testing for LLM-Transpiled C-to-Rust Code.
Yubo Bai, Tapti Palit		ASE2025Testing / QA; AI / LLM for SE; Program Analysis / Verification / Formal Methods
Risk Estimation in Differential Fuzzing via Extreme Value Theory.
Rafael Baez, Alejandro Olivas, Nathan K. Diamond, Marcelo F. Frias, Yannic Noller		ASE2025Testing / QA
Reflective Unit Test Generation for Precise Type Error Detection with Large Language Models.
Chen Yang, Ziqi Wang, Yanjie Jiang, Lin Yang 0030, Yuteng Zheng		ASE2025Testing / QA; Program Analysis / Verification / Formal Methods
ReFuzzer: Feedback-Driven Approach to Enhance Validity of LLM-Generated Test Programs.
Iti Shree, Karine Even-Mendoza, Tomasz Radzik		ASE2025Testing / QA; AI / LLM for SE
RSFuzz: A Robustness-Guided Swarm Fuzzing Framework Based on Behavioral Constraints.
Ruoyu Zhou, Zhiwei Zhang 0004, Haocheng Han, Xiaodong Zhang 0014, Zehan Chen		ASE2025Testing / QA
RPG: Linux Kernel Fuzzing Guided by Distribution-Specific Runtime Parameter Interfaces.
Yuhan Chen, Yuheng Shen, Guoyu Yin, Fan Ding, Runzhe Wang		ASE2025Testing / QA
Quirx: A Mutation-Based Framework for Evaluating Prompt Robustness in LLM-based Software.
Souhaila Serbout		ASE2025Testing / QA; AI / LLM for SE
Quantum Machine Learning-based Test Oracle for Autonomous Mobile Robots.
Xinyi Wang 0004, Qinghua Xu, Paolo Arcaini, Shaukat Ali 0001, Thomas Peyrucain		ASE2025Testing / QA; AI / LLM for SE; Mobile / Web / GUI / Android
PromFuzz: Leveraging LLM-Driven and Bug-Oriented Composite Analysis for Detecting Functional Bugs in Smart Contracts.
Xingshuang Lin, Qinge Xie, Binbin Zhao, Yuan Tian 0001, Saman A. Zonouz		ASE2025Testing / QA; AI / LLM for SE
Profile Coverage: Using Android Compilation Profiles to Evaluate Dynamic Testing.
Jakob Bleier, Felix Kehrer, Jürgen Cito, Martina Lindorfer		ASE2025Testing / QA; Mobile / Web / GUI / Android
PrioTestCI: Efficient Test Case Prioritization in GitHub Workflows for CI Optimization.
Shubham Vasudeo Desai, Shonil Bhide, Souhaila Serbout, Luciano Marchezan, Wesley K. G. Assunção		ASE2025Testing / QA; Human / Empirical / Socio-technical; DevOps / CI / Build / Release; Performance / Energy / Reliability
Practical Escape of Exploration Tarpits for Mini-Game Testing in an Industrial Setting.
Yuan Cao, Dezhi Ran, Haochuan Lu, Chao Guo, Xuran Hao		ASE2025Testing / QA
PALM: Synergizing Program Analysis and LLMs to Enhance Rust Unit Test Coverage.
Bei Chu, Yang Feng 0003, Kui Liu 0001, Hange Shi, Zifan Nan		ASE2025Testing / QA; Program Analysis / Verification / Formal Methods
On Automating Configuration Dependency Validation via Retrieval-Augmented Generation.
Sebastian Simon, Alina Mailach, Johannes Dorn, Norbert Siegmund		ASE2025Testing / QA; DevOps / CI / Build / Release
ORFuzz: Fuzzing the "Other Side" of LLM Safety - Testing Over-Refusal.
Haonan Zhang 0007, Dongxia Wang 0002, Yi Liu, Kexin Chen, Jiashui Wang		ASE2025Testing / QA; AI / LLM for SE
NovaQ: Improving Quantum Program Testing through Diversity-Guided Test Case Generation.
Tiancheng Jin, Shangzhou Xia, Jianjun Zhao 0001		ASE2025Testing / QA
Non-termination Witnesses and Their Validation.
Zsófia Ádám, Paulína Ayaziová, Levente Bajczi, Dirk Beyer 0001, Marek Jankola		ASE2025Testing / QA
Navigating the Labyrinth: Path-Sensitive Unit Test Generation with Large Language Models.
Dianshu Liao, Xin Yin, Shidong Pan, Chao Ni 0001, Zhenchang Xing		ASE2025Testing / QA
NATE: A Network-Aware Testing Enhancer for Network-Related Fault Detection in Android Apps.
Yuanhong Lan, Shaoheng Cao, Yifei Lu, Minxue Pan, Xuandong Li		ASE2025Testing / QA; Mobile / Web / GUI / Android
Multi-dimensional Assessment of Crowdsourced Testing Reports via LLMs.
Yue Wang, Yuan Zhang, Shengcheng Yu, Zhenyu Chen 0001		ASE2025Testing / QA
Metamorphic Testing of Deep Reinforcement Learning Agents with MDPMorph.
Jiapeng Li, Zheng Zheng, Yuning Xing, Daixu Ren, Steven Cho		ASE2025Testing / QA
Metamorphic Testing for Audio Content Moderation Software.
Wenxuan Wang 0001, Yongjiang Wu, Junyuan Zhang, Shuqing Li 0001, Yun Peng 0003		ASE2025Testing / QA
MIMIC: Integrating Diverse Personality Traits for Better Game Testing Using Large Language Model.
Yifei Chen, Sarra Habchi, Lili Wei		ASE2025Testing / QA; AI / LLM for SE
LspFuzz: Hunting Bugs in Language Servers.
Hengcheng Zhu 0001, Songqiang Chen, Valerio Terragni, Lili Wei 0001, Yepang Liu 0001		ASE2025Testing / QA
LogSage: An LLM-Based Framework for CI/CD Failure Detection and Remediation with Industrial Validation.
Weiyuan Xu, Juntao Luo, Tao Huang, Kaixin Sui, Jie Geng		ASE2025Testing / QA; AI / LLM for SE; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release
Lares: LLM-driven Code Slice Semantic Search for Patch Presence Testing.
Siyuan Li 0014, Yaowen Zheng, Hong Li 0004, Jingdong Guo, Chaopeng Dong		ASE2025Testing / QA; AI / LLM for SE; Debugging / Fault Localization / Diagnosis / Repair
LLMs for Automated Unit Test Generation and Assessment in Java: The AgoneTest Framework.
Andrea Lops, Fedelucio Narducci, Azzurra Ragone, Michelantonio Trizio, Claudio Bartolini		ASE2025Testing / QA
LLMorph: Automated Metamorphic Testing of Large Language Models.
Steven Cho, Stefano Ruberto, Valerio Terragni		ASE2025Testing / QA
LLM-based Dynamic Differential Testing for Database Connectors with Reinforcement Learning-Guided Prompt Selection.
Ce Lyu, Yanhao Wang 0001, Jie Liang, Minghao Zhao 0001		ASE2025Testing / QA; AI / LLM for SE
LLM-assisted Industrial-Scale Differential Testing of Package Incompatibilities in Linux Distributions.
Yuhao Yang, Chijin Zhou, Runzhe Wang, Weibo Zhang, Yuheng Shen		ASE2025Testing / QA; AI / LLM for SE
Is Measurement Enough? Rethinking Output Validation in Quantum Program Testing.
Jiaming Ye, Xiongfei Wu, Shangzhou Xia, Fuyuan Zhang, Jianjun Zhao 0001		ASE2025Testing / QA
Interleaved Learning and Exploration: A Self-Adaptive Fuzz Testing Framework for MLIR.
Zeyu Sun 0004, Jingjing Liang, Weiyi Wang, Chenyao Suo, Junjie Chen 0003		ASE2025Testing / QA
Industry Practice of LLM-Assisted Protocol Fuzzing for Commercial Communication Modules.
Qiang Fu, Changjian Liu, Yuan Ding, Chao Fan, Yulai Fu		ASE2025Testing / QA; AI / LLM for SE
IMUFuzzer: Resilience-based Discovery of Signal Injection Attacks on Robotic Aerial Vehicles.
Sudharssan Mohan, Kyeongseok Yang, Zelun Kong, Yonghwi Kwon 0001, Junghwan Rhee		ASE2025Testing / QA
IDBFuzz: Web Storage DataBase Fuzzing with Controllable Semantics.
Jingyi Chen, Jinfu Chen 0001, Saihua Cai, Shengran Wang		ASE2025Testing / QA; Mobile / Web / GUI / Android
Human-In-The-Loop Oracle Learning for Simulation-Based Testing.
Ben-Hau Chia, Eunsuk Kang, Christopher S. Timperley		ASE2025Testing / QA; Human / Empirical / Socio-technical
Human-Centered Evaluation of REST API Fuzzing Tools: Bridging Academia and Industry.
Fanny Febriani Susilo		ASE2025Testing / QA; Human / Empirical / Socio-technical
HFuzzer: Testing Large Language Models for Package Hallucinations via Phrase-based Fuzzing.
Yukai Zhao, Menghan Wu, Xing Hu 0008, Xin Xia 0001		ASE2025Testing / QA
Generating Failure-Based Oracles to Support Testing of Reported Bugs in Android Apps.
Jack Johnson, Junayed Mahmud, Oscar Chaparro, Kevin Moran, Mattia Fazzini		ASE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Mobile / Web / GUI / Android
GUIFuzz++: Unleashing Grey-box Fuzzing on Desktop Graphical User Interfacing Applications.
Dillon Otto, Tanner Rowlett, Stefan Nagy		ASE2025Testing / QA
Function Clustering-Based Fuzzing Termination: Toward Smarter Early Stopping.
Liang Ding, Wenzhang Yang, Yinxing Xue		ASE2025Testing / QA
From Redundancy to Efficiency: Exploiting Shared UI Interactions towards Efficient LLM-Based Testing.
Xuan Wang, Yingchuan Wang, Yongxiang Hu 0003, Yu Zhang 0165, Hailiang Jin		ASE2025Testing / QA; AI / LLM for SE; Mobile / Web / GUI / Android; Performance / Energy / Reliability
FlakyGuard: Automatically Fixing Flaky Tests at Industry Scale.
Chengpeng Li 0002, Farnaz Behrang, August Shi, Peng Liu		ASE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release
Faster Runtime Verification during Testing via Feedback-Guided Selective Monitoring.
Shinhae Kim, Saikat Dutta 0001, Owolabi Legunsen		ASE2025Testing / QA; Program Analysis / Verification / Formal Methods
FailMapper: Automated Generation of Unit Tests Guided by Failure Scenarios.
Ruiqi Dong, Zehang Deng, Xiaogang Zhu 0001, Xiaoning Du 0001, Huai Liu		ASE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
EyeNav: Accessible Webpage Interaction and Testing using Eye-tracking and NLP.
Juan Diego Yepes-Parra, Camilo Escobar-Velásquez		ASE2025Testing / QA
Exact Inference for Quantum Circuits: A Testing Oracle for Quantum Software Stacks.
Kanguk Lee, Jaemin Hong, Sukyoung Ryu		ASE2025Testing / QA
Evaluating Program Coverage for Code-Model Training.
Nandakishore Menon, Diptikalyan Saha		ASE2025Testing / QA
Enhancing LLM's Ability to Generate More Repository-Aware Unit Tests Through Precise Context Injection.
Xin Yin, Chao Ni 0001, Xinrui Li, Liushan Chen, Guojun Ma		ASE2025Testing / QA; AI / LLM for SE; DevOps / CI / Build / Release
Element-Aware Fine-Tuning of Vision-Language Models for Cost-Efficient GUI Testing in an Industrial Setting.
Mengzhou Wu, Yuzhe Guo, Yuan Cao, Haochuan Lu, Hengyu Zhang		ASE2025Testing / QA; Mobile / Web / GUI / Android; Performance / Energy / Reliability
Dynamic Testing of GUI Exercises in Headless Environments.
Benjamin Schmitz		ASE2025Testing / QA; Mobile / Web / GUI / Android
DualFuzz: Detecting Vulnerability in Wi-Fi NICs through Dual-Directional Fuzzing.
Yuanliang Chen, Fuchen Ma, Yanyang Zhao, Yuanyi Li, Yu Jiang 0001		ASE2025Testing / QA
Do LLMs Generate Useful Test Oracles? An Empirical Study with an Unbiased Dataset.
Davide Molinelli, Luca Di Grazia, Alberto Martin-Lopez, Michael D. Ernst, Mauro Pezzè		ASE2025Testing / QA; Human / Empirical / Socio-technical
Detecting and Mitigating Inconsistencies Between Code, Documentation and Tests.
Tobias Kiecker		ASE2025Testing / QA
DebCovDiff: Differential Testing of Coverage Measurement Tools on Real-World Projects.
Wentao Zhang, Jinghao Jia, Erkai Yu, Darko Marinov, Tianyin Xu		ASE2025Testing / QA
DRIFT: Debug-based Trace Inference for Firmware Testing.
Changming Liu, Alejandro Mera, Meng Xu, Engin Kirda		ASE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
DNAFuzz: Descriptor-Aware Fuzzing for USB Drivers.
Zhengshu Wang, Peng He, Fuchen Ma, Yuanliang Chen, Shuoshuo Duan		ASE2025Testing / QA
DESIGNATOR: a Toolset for Automated GAN-enhanced Search-based Testing and Retraining of DNNs in Martian Environments.
Mohammed Oualid Attaoui, Fabrizio Pastore		ASE2025Testing / QA
Coverage-Based Harmfulness Testing for LLM Code Transformation.
Honghao Tan, Haibo Wang, Diany Pressato, Yisen Xu, Shin Hwei Tan		ASE2025Testing / QA; AI / LLM for SE
Comprehend, Imitate, and then Update: Unleashing the Power of LLMs in Test Suite Evolution.
Tangzhi Xu, Jianhan Liu, Yuan Yao 0001, Cong Li 0003, Feng Xu 0007		ASE2025Testing / QA; Maintenance / Evolution / Refactoring / Review
Code-DiTing: Automatic Evaluation of Code Generation without References or Test Cases.
Guang Yang 0019, Yu Zhou 0010, Xiang Chen 0005, Wei Zheng 0006, Xing Hu 0008		ASE2025Testing / QA
Clarifying Semantics of In-Context Examples for Unit Test Generation.
Chen Yang, Lin Yang 0030, Ziqi Wang, Dong Wang 0044, Jianyi Zhou		ASE2025Testing / QA
Chrysalis: A Lightweight Logging and Replay Framework for Metamorphic Testing in Python.
Jai Parera, Nathan Huey, Ben Limpanukorn, Miryung Kim		ASE2025Testing / QA
Bridging Research and Practice in Simulation-based Testing of Industrial Robot Navigation Systems.
Sajad Mazraeh Khatiri, Francisco Eli Vina Barrientos, Maximilian Wulf, Paolo Tonella, Sebastiano Panichella		ASE2025Testing / QA
Beyond Static GUI Agent: Evolving LLM-based GUI Testing via Dynamic Memory.
Mengzhuo Chen, Zhe Liu 0025, Chunyang Chen 0001, Junjie Wang 0001, Yangguang Xue		ASE2025Testing / QA; AI / LLM for SE; Maintenance / Evolution / Refactoring / Review; Mobile / Web / GUI / Android
BenGQL: An Extensible Benchmarking Framework for Automated GraphQL Testing.
Abenezer Angamo, Marcello Maugeri		ASE2025Testing / QA
BCFuzz: Bytecode-Driven Fuzzing for JavaScript Engines.
Jiming Wang, Chenggang Wu 0002, Jikai Ren, Yuhao Hu, Yan Kang 0002		ASE2025Testing / QA
BASHIRI: Learning Failure Oracles from Execution Features.
Marius Smytzek, Martin Eberlein, Tural Mammadov, Lars Grunske, Andreas Zeller		ASE2025Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Automated Generation of Issue-Reproducing Tests by Combining LLMs and Search-Based Testing.
Konstantinos Kitsios, Marco Castelluccio, Alberto Bacchelli		ASE2025Testing / QA
Automated Combinatorial Test Generation for Alloy.
Agustín Borda, Germán Regis, Nazareno Aguirre, Marcelo F. Frias, Pablo Ponzio		ASE2025Testing / QA
Algernon: A Flag-Guided Hybrid Fuzzer for Unlocking Hidden Program Paths.
Peng Deng, Lei Zhang 0006, Jingqi Long, Wenzheng Hong, Zhemin Yang		ASE2025Testing / QA
Adaptive Performance Regression Detection Using A Semi-Supervised Siamese Network.
Yongqian Sun, Mengyao Li, Xiao Xiong, Lei Tao, Yimin Zuo		ASE2025Testing / QA; Performance / Energy / Reliability
Acceleration of Automotive Software Development by Retrieval Augmented Integration Test Script Generation.
Masashi Mizoguchi, Kentaro Yoshimura, Keita Nakazawa, Yasuomi Sato, Takahiro Iida		ASE2025Testing / QA
ARG: Testing Query Rewriters via Abstract Rule Guided Fuzzing.
Dawei Li, Yuxiao Guo, Qifan Liu, Jie Liang 0006, Zhiyong Wu 0010		ASE2025Testing / QA
ADPerf: Investigating and Testing Performance in Autonomous Driving Systems.
Tri Minh-Triet Pham, Diego Elias Costa, Weiyi Shang, Jinqiu Yang 0001		ASE2025Testing / QA; Performance / Energy / Reliability
Wapplique: Testing WebAssembly Runtime via Execution Context-Aware Bytecode Mutation.
Wenxuan Zhao, Ruiying Zeng, Yangfan Zhou 0002		ISSTA2024Testing / QA
WASMaker: Differential Testing of WebAssembly Runtimes via Semantic-Aware Binary Generation.
Shangtong Cao, Ningyu He, Xinyu She, Yixuan Zhang, Mu Zhang 0001		ISSTA2024Testing / QA
VioHawk: Detecting Traffic Violations of Autonomous Driving Systems through Criticality-Guided Simulation Testing.
Zhongrui Li, Jiarun Dai, Zongan Huang, Nianhao You, Yuan Zhang 0009		ISSTA2024Testing / QA
UniTSyn: A Large-Scale Dataset Capable of Enhancing the Prowess of Large Language Models for Program Testing.
Yifeng He, Jiabo Huang, Yuyang Rong, Yiwen Guo, Ethan Wang		ISSTA2024Testing / QA
UPBEAT: Test Input Checks of Q# Quantum Libraries.
Tianmin Hu, Guixin Ye, Zhanyong Tang, Shin Hwei Tan, Huanting Wang		ISSTA2024Testing / QA
Towards More Complete Constraints for Deep Learning Library Testing via Complementary Set Guided Refinement.
Gwihwan Go, Chijin Zhou, Quan Zhang 0003, Xiazijian Zou, Heyuan Shi		ISSTA2024Testing / QA; AI / LLM for SE
Towards Automatic Oracle Prediction for AR Testing: Assessing Virtual Object Placement Quality under Real-World Scenes.
Xiaoyi Yang, Yuxing Wang, Tahmid Rafi, Dongfang Liu, Xiaoyin Wang		ISSTA2024Testing / QA
The Flexcrash Platform for Testing Autonomous Vehicles in Mixed-Traffic Scenarios.
Alessio Gambi, Shreya Mathews, Benedikt Steininger, Mykhailo Poienko, David Bobek		ISSTA2024Testing / QA
Testing Gremlin-Based Graph Database Systems via Query Disassembling.
Yingying Zheng, Wensheng Dou, Lei Tang, Ziyu Cui, Yu Gao 0002		ISSTA2024Testing / QA
Testing Graph Database Systems with Graph-State Persistence Oracle.
Shuang Liu 0007, Junhao Lan, Xiaoning Du 0001, Jiyuan Li, Wei Lu 0015		ISSTA2024Testing / QA
Testing Concurrent Algorithms on JVM with Lincheck and IntelliJ IDEA.
Aleksandr Potapov, Maksim Zuev, Evgenii Moiseenko, Nikita Koval		ISSTA2024Testing / QA
Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics.
Demet Demir, Aysu Betin Can, Elif Sürer		ISSTA2024Testing / QA; AI / LLM for SE; DevOps / CI / Build / Release
TeDA: A Testing Framework for Data Usage Auditing in Deep Learning Model Development.
Xiangshan Gao, Jialuo Chen, Jingyi Wang 0004, Jie Shi 0013, Peng Cheng 0001		ISSTA2024Testing / QA; AI / LLM for SE
Tacoma: Enhanced Browser Fuzzing with Fine-Grained Semantic Alignment.
Jiashui Wang, Peng Qian, Xilin Huang, Xinlei Ying, Yan Chen 0004		ISSTA2024Testing / QA; Mobile / Web / GUI / Android
Synthesis-Based Enhancement for GUI Test Case Migration.
Yakun Zhang 0001, Qihao Zhu, Jiwei Yan, Chen Liu 0041, Wenjie Zhang 0007		ISSTA2024Testing / QA; Maintenance / Evolution / Refactoring / Review; Mobile / Web / GUI / Android
Sleuth: A Switchable Dual-Mode Fuzzer to Investigate Bug Impacts Following a Single PoC.
Haolai Wei, Liwei Chen, Zhijie Zhang, Gang Shi, Dan Meng 0002		ISSTA2024Testing / QA
Shaping Test Inputs in Grammar-Based Fuzzing.
José Antonio Zamudio Amaya		ISSTA2024Testing / QA
Semantic Constraint Inference for Web Form Test Generation.
Parsa Alian, Noor Nashid, Mobina Shahbandeh, Ali Mesbah 0001		ISSTA2024Testing / QA; Mobile / Web / GUI / Android
Segment-Based Test Case Prioritization: A Multi-objective Approach.
Hieu Huynh, Nhu Pham, Tien N. Nguyen, Vu Nguyen 0003		ISSTA2024Testing / QA
See the Forest, not Trees: Unveiling and Escaping the Pitfalls of Error-Triggering Inputs in Neural Network Testing.
Yuanyuan Yuan 0001, Shuai Wang 0011, Zhendong Su 0001		ISSTA2024Testing / QA; AI / LLM for SE
SMBugFinder: An Automated Framework for Testing Protocol Implementations for State Machine Bugs.
Paul Fiterau-Brostean, Bengt Jonsson 0001, Konstantinos Sagonas, Fredrik Tåquist		ISSTA2024Testing / QA
Revisiting Test-Case Prioritization on Long-Running Test Suites.
Runxiang Cheng, Shuai Wang 0035, Reyhaneh Jabbarvand, Darko Marinov		ISSTA2024Testing / QA
Reproducing Timing-Dependent GUI Flaky Tests in Android Apps via a Single Event Delay.
Xiaobao Cai, Zhen Dong, Yongjiang Wang, Abhishek Tiwari 0001, Xin Peng 0001		ISSTA2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release; Mobile / Web / GUI / Android
Prospector: Boosting Directed Greybox Fuzzing for Large-Scale Target Sets with Iterative Prioritization.
Zhijie Zhang, Liwei Chen, Haolai Wei, Gang Shi, Dan Meng 0002		ISSTA2024Testing / QA
Practitioners' Expectations on Automated Test Generation.
Xiao Yu 0008, Lei Liu 0062, Xing Hu 0008, Jacky Keung, Xin Xia 0001		ISSTA2024Testing / QA
Policy Testing with MDPFuzz (Replicability Study).
Quentin Mazouni, Helge Spieker, Arnaud Gotlieb, Mathieu Acher		ISSTA2024Testing / QA; Human / Empirical / Socio-technical
Oracle-Guided Program Selection from Large Language Models.
Zhiyu Fan, Haifeng Ruan, Sergey Mechtaev, Abhik Roychoudhury		ISSTA2024Testing / QA
Neurosymbolic Repair of Test Flakiness.
Yang Chen 0059, Reyhaneh Jabbarvand		ISSTA2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Midas: Mining Profitable Exploits in On-Chain Smart Contracts via Feedback-Driven Fuzzing and Differential Analysis.
Mingxi Ye, Xingwei Lin, Yuhong Nan, Jiajing Wu, Zibin Zheng		ISSTA2024Testing / QA
Ma11y: A Mutation Framework for Web Accessibility Testing.
Mahan Tafreshipour, Anmol Vilas Deshpande, Forough Mehralian, Iftekhar Ahmed 0001, Sam Malek		ISSTA2024Testing / QA; Mobile / Web / GUI / Android
Logos: Log Guided Fuzzing for Protocol Implementations.
Feifan Wu, Zhengxiong Luo 0002, Yanyang Zhao, Qingpeng Du, Junze Yu		ISSTA2024Testing / QA
LLM4Fin: Fully Automating LLM-Powered Test Case Generation for FinTech Software Acceptance Testing.
Zhiyi Xue, Liangguo Li, Senyue Tian, Xiaohong Chen 0007, Pingping Li		ISSTA2024Testing / QA; AI / LLM for SE
Integrating Mutation Techniques to Keep Specification and Source Code in Sync.
Kerstin Jacob		ISSTA2024Testing / QA; Program Analysis / Verification / Formal Methods
How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation.
Cen Zhang, Yaowen Zheng, Mingqiang Bai, Yeting Li, Wei Ma 0014		ISSTA2024Testing / QA; AI / LLM for SE
Generalized Concurrency Testing Tool for Distributed Systems.
Ege Berkay Gulcan, João Neto 0001, Burcu Kulahcioglu Ozkan		ISSTA2024Testing / QA; Cloud / Microservices / Distributed Systems
Fuzzing MLIR Compiler Infrastructure via Operation Dependency Analysis.
Chenyao Suo, Junjie Chen 0003, Shuang Liu 0007, Jiajun Jiang, Yingquan Zhao		ISSTA2024Testing / QA
Fuzzing JavaScript Interpreters with Coverage-Guided Reinforcement Learning for LLM-Based Mutation.
Jueon Eom, Seyeon Jeong, Taekyoung Kwon 0002		ISSTA2024Testing / QA; AI / LLM for SE
FRIES: Fuzzing Rust Library Interactions via Efficient Ecosystem-Guided Target Generation.
Xizhe Yin, Yang Feng 0003, Qingkai Shi, Zixi Liu, Hongwang Liu		ISSTA2024Testing / QA
FRAFOL: FRAmework FOr Learning mutation testing.
Pedro Tavares, Ana C. R. Paiva, Domenico Amalfitano, René Just		ISSTA2024Testing / QA
Enhancing ROS System Fuzzing through Callback Tracing.
Yuheng Shen, Jianzhong Liu, Yiru Xu, Hao Sun 0021, Mingzhe Wang		ISSTA2024Testing / QA
Enhancing Multi-agent System Testing with Diversity-Guided Exploration and Adaptive Critical State Exploitation.
Xuyan Ma, Yawen Wang, Junjie Wang 0001, Xiaofei Xie, Boyu Wu		ISSTA2024Testing / QA
Domain Adaptation for Code Model-Based Unit Test Case Generation.
Jiho Shin, Sepehr Hashtroudi, Hadi Hemmati, Song Wang 0009		ISSTA2024Testing / QA; AI / LLM for SE
DistillSeq: A Framework for Safety Alignment Testing in Large Language Models using Knowledge Distillation.
Mingke Yang, Yuqi Chen 0001, Yi Liu 0069, Ling Shi 0002		ISSTA2024Testing / QA
Distance-Aware Test Input Selection for Deep Neural Networks.
Zhong Li, Zhengfeng Xu, Ruihua Ji, Minxue Pan, Tian Zhang 0001		ISSTA2024Testing / QA; AI / LLM for SE
DiaVio: LLM-Empowered Diagnosis of Safety Violations in ADS Simulation Testing.
You Lu 0005, Yifan Tian, Yuyang Bi, Bihuan Chen 0001, Xin Peng 0001		ISSTA2024Testing / QA; AI / LLM for SE
Decomposition of Deep Neural Networks into Modules via Mutation Analysis.
Ali Ghanbari 0001		ISSTA2024Testing / QA; AI / LLM for SE
Dance of the ADS: Orchestrating Failures through Historically-Informed Scenario Fuzzing.
Tong Wang 0042, Taotao Gu, Huan Deng, Hu Li, Xiaohui Kuang		ISSTA2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
DDGF: Dynamic Directed Greybox Fuzzing with Path Profiling.
Haoran Fang, Kaikai Zhang, Donghui Yu, Yuanyuan Zhang 0002		ISSTA2024Testing / QA
DBStorm: Generating Various Effective Workloads for Testing Isolation Levels.
Keqiang Li 0006, Siyang Weng, Lyu Ni, Chengcheng Yang, Rong Zhang 0002		ISSTA2024Testing / QA
CooTest: An Automated Testing Approach for V2X Communication Systems.
An Guo 0002, Xinyu Gao, Zhenyu Chen 0001, Yuan Xiao 0003, Jiakai Liu		ISSTA2024Testing / QA
Certified Continual Learning for Neural Network Regression.
Long H. Pham, Jun Sun 0001		ISSTA2024Testing / QA; AI / LLM for SE
Beyond Pairwise Testing: Advancing 3-wise Combinatorial Interaction Testing for Highly Configurable Systems.
Chuan Luo 0002, Shuangyu Lyu, Qiyuan Zhao, Wei Wu 0011, Hongyu Zhang 0002		ISSTA2024Testing / QA
Automated Testing of Networked Systems Reliability.
Michal Rozsíval		ISSTA2024Testing / QA; Performance / Energy / Reliability
Atlas: Automating Cross-Language Fuzzing on Android Closed-Source Libraries.
Hao Xiong, Qinming Dai, Rui Chang, Mingran Qiu, Renxiang Wang		ISSTA2024Testing / QA; Mobile / Web / GUI / Android
AsFuzzer: Differential Testing of Assemblers with Error-Driven Grammar Inference.
Hyungseok Kim 0002, Soomin Kim 0002, Jungwoo Lee, Sang Kil Cha		ISSTA2024Testing / QA
An In-Depth Study of Runtime Verification Overheads during Software Testing.
Kevin Guan, Owolabi Legunsen		ISSTA2024Testing / QA; Program Analysis / Verification / Formal Methods; Human / Empirical / Socio-technical
An Empirical Examination of Fuzzer Mutator Performance.
James Kukucka, Luís Pina, Paul Ammann, Jonathan Bell 0001		ISSTA2024Testing / QA; Human / Empirical / Socio-technical; Performance / Energy / Reliability
Translation Validation for JIT Compiler in the V8 JavaScript Engine.
Seungwan Kwon, Jaeseong Kwon, Wooseok Kang, Juneyoung Lee, Kihong Heo		ICSE2024Testing / QA
Towards Reliable AI: Adequacy Metrics for Ensuring the Quality of System-level Testing of Autonomous Vehicles.
Neelofar, Aldeida Aleti		ICSE2024Testing / QA
Testing the Limits: Unusual Text Inputs Generation for Mobile App Crash Detection with Large Language Model.
Zhe Liu 0025, Chunyang Chen 0001, Junjie Wang 0001, Mengzhuo Chen, Boyu Wu		ICSE2024Testing / QA; AI / LLM for SE; Debugging / Fault Localization / Diagnosis / Repair; Mobile / Web / GUI / Android
Testing Graph Database Systems via Equivalent Query Rewriting.
Qiuyang Mang, Aoyang Fang, Boxi Yu, Hanfei Chen, Pinjia He		ICSE2024Testing / QA
SpecBCFuzz: Fuzzing LTL Solvers with Boundary Conditions.
Luiz Carvalho, Renzo Degiovanni, Maxime Cordy, Nazareno Aguirre, Yves Le Traon		ICSE2024Testing / QA
Sedar: Obtaining High-Quality Seeds for DBMS Fuzzing via Cross-DBMS SQL Transfer.
Jingzhou Fu, Jie Liang 0006, Zhiyong Wu 0010, Yu Jiang 0001		ICSE2024Testing / QA
Safeguarding DeFi Smart Contracts against Oracle Deviations.
Xun Deng, Sidi Mohamed Beillahi, Cyrus Minwalla, Han Du, Andreas G. Veneris		ICSE2024Testing / QA
SCTrans: Constructing a Large Public Scenario Dataset for Simulation Testing of Autonomous Driving Systems.
Jiarun Dai, Bufan Gao, Mingyuan Luo, Zongan Huang, Zhongrui Li		ICSE2024Testing / QA
S3C: Spatial Semantic Scene Coverage for Autonomous Vehicles.
Trey Woodlief, Felipe Toledo, Sebastian G. Elbaum, Matthew B. Dwyer		ICSE2024Testing / QA
Ripples of a Mutation - An Empirical Study of Propagation Effects in Mutation Testing.
Hang Du, Vijay Krishna Palepu, James A. Jones		ICSE2024Testing / QA; Human / Empirical / Socio-technical
RPG: Rust Library Fuzzing with Pool-based Fuzz Target Generation and Generic Support.
Zhiwu Xu 0001, Bohao Wu, Cheng Wen 0002, Bin Zhang, Shengchao Qin		ICSE2024Testing / QA
Property-Based Testing in Practice.
Harrison Goldstein, Joseph W. Cutler, Daniel Dickstein, Benjamin C. Pierce, Andrew Head		ICSE2024Testing / QA
Practical Non-Intrusive GUI Exploration Testing with Visual-based Robotic Arms.
Shengcheng Yu, Chunrong Fang, Mingzhe Du, Yuchen Ling, Zhenyu Chen 0001		ICSE2024Testing / QA; Mobile / Web / GUI / Android
PS3: Precise Patch Presence Test based on Semantic Symbolic Signature.
Qi Zhan, Xing Hu 0008, Zhiyang Li, Xin Xia 0001, David Lo 0001		ICSE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Program Analysis / Verification / Formal Methods
PPT4J: Patch Presence Test for Java Binaries.
Zhiyuan Pan, Xing Hu 0008, Xin Xia 0001, Xian Zhan, David Lo 0001		ICSE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
MultiTest: Physical-Aware Object Insertion for Testing Multi-sensor Fusion Perception Systems.
Xinyu Gao, Zhijie Wang 0014, Yang Feng 0003, Lei Ma 0003, Zhenyu Chen 0001		ICSE2024Testing / QA; Human / Empirical / Socio-technical
Make LLM a Testing Expert: Bringing Human-like Interaction to Mobile GUI Testing via Functionality-aware Decisions.
Zhe Liu 0025, Chunyang Chen 0001, Junjie Wang 0001, Mengzhuo Chen, Boyu Wu		ICSE2024Testing / QA; AI / LLM for SE; Human / Empirical / Socio-technical; Mobile / Web / GUI / Android
MUT: Human-in-the-Loop Unit Test Migration.
Yi Gao, Xing Hu 0008, Tongtong Xu, Xin Xia 0001, David Lo 0001		ICSE2024Testing / QA; Human / Empirical / Socio-technical; Maintenance / Evolution / Refactoring / Review
MAFT: Efficient Model-Agnostic Fairness Testing for Deep Neural Networks via Zero-Order Gradient Search.
Zhaohui Wang, Min Zhang 0007, Jingran Yang, Bojie Shao, Min Zhang 0002		ICSE2024Testing / QA; AI / LLM for SE
Learning-based Widget Matching for Migrating GUI Test Cases.
Yakun Zhang 0001, Wenjie Zhang 0007, Dezhi Ran, Qihao Zhu, Chengfeng Dou		ICSE2024Testing / QA; AI / LLM for SE; Mobile / Web / GUI / Android
Learning and Repair of Deep Reinforcement Learning Policies from Fuzz-Testing Data.
Martin Tappler, Andrea Pferscher, Bernhard K. Aichernig, Bettina Könighofer		ICSE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Large Language Models for Test-Free Fault Localization.
Aidan Z. H. Yang, Claire Le Goues, Ruben Martins, Vincent J. Hellendoorn		ICSE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Large Language Models are Edge-Case Generators: Crafting Unusual Programs for Fuzzing Deep Learning Libraries.
Yinlin Deng, Chunqiu Steven Xia, Chenyuan Yang, Shizhuo Dylan Zhang, Shujing Yang		ICSE2024Testing / QA; AI / LLM for SE
Knowledge Graph Driven Inference Testing for Question Answering Software.
Jun Wang 0151, Yanhui Li, Zhifei Chen, Lin Chen 0015, Xiaofang Zhang		ICSE2024Testing / QA
Improving Testing Behavior by Gamifying IntelliJ.
Philipp Straubinger, Gordon Fraser 0001		ICSE2024Testing / QA
Hypertesting of Programs: Theoretical Foundation and Automated Test Generation.
Michele Pasqua, Mariano Ceccato, Paolo Tonella		ICSE2024Testing / QA
FuzzSlice: Pruning False Positives in Static Analysis Warnings through Function-Level Fuzzing.
Aniruddhan Murali, Noble Saji Mathews, Mahmoud Alfadel, Meiyappan Nagappan, Meng Xu 0025		ICSE2024Testing / QA; Program Analysis / Verification / Formal Methods
FuzzInMem: Fuzzing Programs via In-memory Structures.
Xuwei Liu, Wei You 0001, Yapeng Ye, Zhuo Zhang 0002, Jianjun Huang 0001		ICSE2024Testing / QA
Fuzz4All: Universal Fuzzing with Large Language Models.
Chunqiu Steven Xia, Matteo Paltenghi, Jia Le Tian, Michael Pradel, Lingming Zhang 0001		ICSE2024Testing / QA
FlakeSync: Automatically Repairing Async Flaky Tests.
Shanto Rahman, August Shi		ICSE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Finding XPath Bugs in XML Document Processors via Differential Testing.
Shuxin Li, Manuel Rigger		ICSE2024Testing / QA
Extrapolating Coverage Rate in Greybox Fuzzing.
Danushka Liyanage, Seongmin Lee 0001, Chakkrit Tantithamthavorn, Marcel Böhme		ICSE2024Testing / QA
Exploiting Library Vulnerability via Migration Based Automating Test Generation.
Zirui Chen, Xing Hu 0008, Xin Xia 0001, Yi Gao, Tongtong Xu		ICSE2024Testing / QA; Maintenance / Evolution / Refactoring / Review
Enhancing Exploratory Testing by Large Language Model and Knowledge Graph.
Yanqi Su, Dianshu Liao, Zhenchang Xing, Qing Huang, Mulong Xie		ICSE2024Testing / QA; AI / LLM for SE
ECFuzz: Effective Configuration Fuzzing for Large-Scale Systems.
Junqiang Li, Senyi Li, Keyao Li, Falin Luo, Hongfang Yu		ICSE2024Testing / QA; DevOps / CI / Build / Release
Do Automatic Test Generation Tools Generate Flaky Tests?
Martin Gruber, Muhammad Firhard Roslan, Owain Parry, Fabian Scharnböck, Phil McMinn		ICSE2024Testing / QA
Deeply Reinforcing Android GUI Testing with Deep Reinforcement Learning.
Yuanhong Lan, Yifei Lu, Zhong Li, Minxue Pan, Wenhua Yang 0001		ICSE2024Testing / QA; Mobile / Web / GUI / Android
DeepSample: DNN sampling-based testing for operational accuracy assessment.
Antonio Guerriero, Roberto Pietrantuono, Stefano Russo 0001		ICSE2024Testing / QA
Curiosity-Driven Testing for Sequential Decision-Making Process.
Junda He, Zhou Yang 0003, Jieke Shi, Chengran Yang, Kisub Kim		ICSE2024Testing / QA
Crossover in Parametric Fuzzing.
Katherine Hough, Jonathan Bell 0001		ICSE2024Testing / QA
Comprehensive Semantic Repair of Obsolete GUI Test Scripts for Mobile Applications.
Shaoheng Cao, Minxue Pan, Yu Pei 0001, Wenhua Yang 0001, Tian Zhang 0001		ICSE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Mobile / Web / GUI / Android
CIT4DNN: Generating Diverse and Rare Inputs for Neural Networks Using Latent Space Combinatorial Testing.
Swaroopa Dola, Rory McDaniel, Matthew B. Dwyer, Mary Lou Soffa		ICSE2024Testing / QA; AI / LLM for SE
A First Look at the Inheritance-Induced Redundant Test Execution.
Dong Jae Kim, Jinqiu Yang 0001, Tse-Hsun Chen		ICSE2024Testing / QA
Static Application Security Testing (SAST) Tools for Smart Contracts: How Far Are We?
Kaixuan Li 0002; Yue Xue; Sen Chen 0001; Han Liu 0012; Kairan Sun; Ming Hu 0003; Haijun Wang 0002; Yang Liu 0003; Yixiang Chen 0001		FSE2024Testing / QA; Security / Privacy / Vulnerability
Semi-supervised Crowdsourced Test Report Clustering via Screenshot-Text Binding Rules.
Shengcheng Yu; Chunrong Fang; Quanjun Zhang; Mingzhe Du; Jia Liu 0015; Zhenyu Chen 0001		FSE2024Testing / QA
Natural Symbolic Execution-Based Testing for Big Data Analytics.
Yaoxuan Wu; Ahmad Humayun; Muhammad Ali Gulzar; Miryung Kim		FSE2024Testing / QA; Program Analysis / Verification / Formal Methods
Misconfiguration Software Testing for Failure Emergence in Autonomous Driving Systems.
Yuntianyi Chen; Yuqi Huai; Shilong Li 0002; Changnam Hong; Joshua Garcia		FSE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Metamorphic Testing of Secure Multi-party Computation (MPC) Compilers.
Yichen Li 0004; Dongwei Xiao; Zhibo Liu 0001; Qi Pang; Shuai Wang 0011		FSE2024Testing / QA
Maximizing Patch Coverage for Testing of Highly-Configurable Software without Exploding Build Times.
Necip Fazil Yildiran; Jeho Oh; Julia Lawall; Paul Gazzillo		FSE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release
Java JIT Testing with Template Extraction.
Zhiqiang Zang; Fu-Yao Yu; Aditya Thimmaiah; August Shi; Milos Gligoric 0001		FSE2024Testing / QA
How Does Simulation-Based Testing for Self-Driving Cars Match Human Perception?
Christian Birchler; Tanzil Kombarabettu Mohammed; Pooja Rani 0001; Teodora Nechita; Timo Kehrer; Sebastiano Panichella		FSE2024Testing / QA; Human / Empirical / Socio-technical
Evaluating and Improving ChatGPT for Unit Test Generation.
Zhiqiang Yuan; Mingwei Liu 0002; Shiji Ding; Kaixin Wang; Yixuan Chen 0012; Xin Peng 0001; Yiling Lou		FSE2024Testing / QA; AI / LLM for SE
DTD: Comprehensive and Scalable Testing for Debuggers.
Hongyi Lu; Zhibo Liu 0001; Shuai Wang 0011; Fengwei Zhang		FSE2024Testing / QA
Code-Aware Prompting: A Study of Coverage-Guided Test Generation in Regression Setting using LLM.
Gabriel Ryan; Siddhartha Jain 0001; Mingyue Shang; Shiqi Wang 0002; Xiaofei Ma 0001; Murali Krishna Ramanathan; Baishakhi Ray		FSE2024Testing / QA; AI / LLM for SE; Human / Empirical / Socio-technical
COSTELLO: Contrastive Testing for Embedding-Based Large Language Model as a Service Embeddings.
Weipeng Jiang; Juan Zhai; Shiqing Ma; Xiaoyu Zhang 0013; Chao Shen 0001		FSE2024Testing / QA; AI / LLM for SE
Bounding Random Test Set Size with Computational Learning Theory.
Neil Walkinshaw; Michael Foster 0001; José Miguel Rojas; Robert M. Hierons		FSE2024Testing / QA
BRF: Fuzzing the eBPF Runtime.
Hsin-Wei Hung; Ardalan Amiri Sani		FSE2024Testing / QA
An Empirical Study on Focal Methods in Deep-Learning-Based Approaches for Assertion Generation.
Yibo He; Jiaming Huang; Hao Yu 0016; Tao Xie 0001		FSE2024Testing / QA; AI / LLM for SE; Human / Empirical / Socio-technical
A Miss Is as Good as A Mile: Metamorphic Testing for Deep Learning Operators.
Jinyin Chen; Chengyu Jia 0001; Yunjie Yan; Jie Ge; Haibin Zheng; Yao Cheng 0002		FSE2024Testing / QA; AI / LLM for SE
Visualizing and Understanding the Internals of Fuzzing.
Sriteja Kummita, Zenong Zhang, Eric Bodden, Shiyi Wei		ASE2024Testing / QA
Using LLM for Mining and Testing Constraints in API Testing.
Hieu Huynh, Quoc-Tri Le, Tien N. Nguyen, Vu Nguyen 0003		ASE2024Testing / QA; AI / LLM for SE
Towards a Robust Waiting Strategy for Web GUI Testing for an Industrial Software System.
Haonan Zhang 0006, Lizhi Liao, Zishuo Ding, Weiyi Shang, Nidhi Narula		ASE2024Testing / QA; Mobile / Web / GUI / Android; Performance / Energy / Reliability
Towards Understanding the Effectiveness of Large Language Models on Directed Test Input Generation.
Zongze Jiang, Ming Wen 0001, Jialun Cao, Xuanhua Shi, Hai Jin 0001		ASE2024Testing / QA
Toward Individual Fairness Testing with Data Validity.
Takashi Kitamura 0001, Sousuke Amasaki, Jun Inoue 0001, Yoshinao Isobe, Takahisa Toda		ASE2024Testing / QA
The Importance of Accounting for Execution Failures when Predicting Test Flakiness.
Guillaume Haben, Sarra Habchi, John Micco, Mark Harman, Mike Papadakis		ASE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Test-Driven Development and LLM-based Code Generation.
Noble Saji Mathews, Meiyappan Nagappan		ASE2024Testing / QA; AI / LLM for SE
Test Case Generation for Simulink Models using Model Fuzzing and State Solving.
Zhuo Su 0005, Zehong Yu, Dongyan Wang, Wanli Chang 0001, Bin Gu 0006		ASE2024Testing / QA
Syntactic Resilience in Greybox Fuzzing: Automated Error Recovery.
Bachir Bendrissou		ASE2024Testing / QA
Spotting Code Mutation for Predictive Mutation Testing.
Yifan Zhao, Yizhou Chen, Zeyu Sun 0004, Qingyuan Liang, Guoqing Wang 0004		ASE2024Testing / QA
SoVAR: Build Generalizable Scenarios from Accident Reports for Autonomous Driving Testing.
An Guo 0002, Yuan Zhou 0005, Haoxiang Tian 0001, Chunrong Fang, Yunjian Sun		ASE2024Testing / QA; DevOps / CI / Build / Release
Seeding and Mocking in White-Box Fuzzing Enterprise RPC APIs: An Industrial Case Study.
Man Zhang 0001, Andrea Arcuri, Piyun Teng, Kaiming Xue, Wenhao Wang		ASE2024Testing / QA; Human / Empirical / Socio-technical
Rust-twins: Automatic Rust Compiler Testing through Program Mutation and Dual Macros Generation.
Wenzhang Yang, Cuifeng Gao, Xiaoyuan Liu, Yuekang Li, Yinxing Xue		ASE2024Testing / QA
Reducing Test Runtime by Transforming Test Fixtures.
Chengpeng Li 0002, Abdelrahman Baz, August Shi		ASE2024Testing / QA
ROCAS: Root Cause Analysis of Autonomous Driving Accidents via Cyber-Physical Co-mutation.
Shiwei Feng 0002, Yapeng Ye, Qingkai Shi, Zhiyuan Cheng 0010, Xiangzhe Xu		ASE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
REACT: IR-Level Patch Presence Test for Binary.
Qi Zhan, Xing Hu 0008, Xin Xia 0001, Shanping Li		ASE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Quantum Program Testing Through Commuting Pauli Strings on IBM's Quantum Computers.
Asmar Muqeet, Shaukat Ali 0001, Paolo Arcaini		ASE2024Testing / QA
Prioritizing Tests for Improved Runtime.
Abdelrahman Baz, Minchao Huang, August Shi		ASE2024Testing / QA
Prioritizing Test Inputs for DNNs Using Training Dynamics.
Jian Shen, Zhong Li, Minxue Pan, Xuandong Li		ASE2024Testing / QA
Oracle-Guided Vulnerability Diversity and Exploit Synthesis of Smart Contracts Using LLMs.
Mojtaba Eshghie, Cyrille Artho		ASE2024Testing / QA; Security / Privacy / Vulnerability
On the Evaluation of Large Language Models in Unit Test Generation.
Lin Yang 0030, Chen Yang, Shutao Gao, Weijing Wang, Bo Wang 0050		ASE2024Testing / QA
Olympia: Fuzzer Benchmarking for Solidity.
Jana Chadt, Christoph Hochrainer, Valentin Wüstholz, Maria Christakis		ASE2024Testing / QA
Navigating Mobile Testing Evaluation: A Comprehensive Statistical Analysis of Android GUI Testing Metrics.
Yuanhong Lan, Yifei Lu, Minxue Pan, Xuandong Li		ASE2024Testing / QA; Mobile / Web / GUI / Android
Mutation-Based Deep Learning Framework Testing Method in JavaScript Environment.
Yinglong Zou, Juan Zhai, Chunrong Fang, Jiawei Liu, Tao Zheng		ASE2024Testing / QA; AI / LLM for SE
Model-based GUI Testing For HarmonyOS Apps.
Yige Chen, Sinan Wang, Yida Tao, Yepang Liu 0001		ASE2024Testing / QA; Mobile / Web / GUI / Android
Mining for Mutation Operators for Reduction of Information Flow Control Violations.
Ilya Kosorukov, Daniel Blackwell, David Clark 0001, Myra B. Cohen, Justyna Petke		ASE2024Testing / QA
Magneto: A Step-Wise Approach to Exploit Vulnerabilities in Dependent Libraries via LLM-Empowered Directed Fuzzing.
Zhuotong Zhou, Yongzhuo Yang, Susheng Wu, Yiheng Huang, Bihuan Chen 0001		ASE2024Testing / QA; AI / LLM for SE; Security / Privacy / Vulnerability
MR-Adopt: Automatic Deduction of Input Transformation Function for Metamorphic Testing.
Congying Xu, Songqiang Chen, Jiarong Wu, Shing-Chi Cheung, Valerio Terragni		ASE2024Testing / QA
MLOLET - Machine Learning Optimized Load and Endurance Testing: An industrial experience report.
Arthur Vitui, Tse-Hsun Chen		ASE2024Testing / QA; AI / LLM for SE
LLMs and Prompting for Unit Test Generation: A Large-Scale Evaluation.
Wendkûuni C. Ouédraogo, Abdoul Kader Kaboré, Haoye Tian, Yewei Song, Anil Koyuncu		ASE2024Testing / QA
Interrogation Testing of Program Analyzers for Soundness and Precision Issues.
David Kaindlstorfer, Anastasia Isychev, Valentin Wüstholz, Maria Christakis		ASE2024Testing / QA
Integrating Mutation Testing Into Developer Workflow: An Industrial Case Study.
Stefan Alexander van Heijningen, Theo Wiik, Francisco Gomes de Oliveira Neto, Gregory Gay 0002, Kim Viggedal		ASE2024Testing / QA; Human / Empirical / Socio-technical
Industry Practice of Directed Kernel Fuzzing for Open-source Linux Distribution.
Heyuan Shi, Shijun Chen, Runzhe Wang, Yuhan Chen, Weibo Zhang		ASE2024Testing / QA
In-Simulation Testing of Deep Learning Vision Models in Autonomous Robotic Manipulators.
Dmytro Humeniuk, Houssem Ben Braiek, Thomas Reid, Foutse Khomh		ASE2024Testing / QA; AI / LLM for SE
Hybrid Regression Test Selection by Integrating File and Method Dependences.
Guofeng Zhang 0005, Luyao Liu, Zhenbang Chen, Ji Wang 0001		ASE2024Testing / QA
HITS: High-coverage LLM-based Unit Test Generation via Method Slicing.
Zejun Wang, Kaibo Liu, Ge Li 0001, Zhi Jin 0001		ASE2024Testing / QA; AI / LLM for SE; Program Analysis / Verification / Formal Methods
General and Practical Property-based Testing for Android Apps.
Yiheng Xiong, Ting Su 0001, Jue Wang, Jingling Sun, Geguang Pu		ASE2024Testing / QA; Mobile / Web / GUI / Android
GUI Test Repair Based on Test-Extension.
Yonghao Long, Yuanyuan Chen 0017, Xiangping Chen		ASE2024Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Mobile / Web / GUI / Android
FIPSER: Improving Fairness Testing of DNN by Seed Prioritization.
Junwei Chen, Yueling Zhang, Lingfeng Zhang, Min Zhang 0007, Chengcheng Wan 0001		ASE2024Testing / QA
FAST: Boosting Uncertainty-based Test Prioritization Methods for Neural Networks via Feature Selection.
Jialuo Chen, Jingyi Wang 0004, Xiyue Zhang 0001, Youcheng Sun, Marta Kwiatkowska		ASE2024Testing / QA; AI / LLM for SE; DevOps / CI / Build / Release
Evaluating Terminology Translation in Machine Translation Systems via Metamorphic Testing.
Yihui Xu, Yanhui Li, Jun Wang 0151, Xiaofang Zhang		ASE2024Testing / QA
Enabling Cost-Effective UI Automation Testing with Retrieval-Based LLMs: A Case Study in WeChat.
Sidong Feng, Haochuan Lu, Jianqin Jiang, Ting Xiong, Likun Huang		ASE2024Testing / QA; Human / Empirical / Socio-technical; Mobile / Web / GUI / Android; Performance / Energy / Reliability
Efficient Incremental Code Coverage Analysis for Regression Test Suites.
Jiale Amber Wang, Kaiyuan Wang, Pengyu Nie 0001		ASE2024Testing / QA; DevOps / CI / Build / Release
Efficient Detection of Test Interference in C Projects.
Florian Eder, Stefan Winter 0001		ASE2024Testing / QA
Effective Unit Test Generation for Java Null Pointer Exceptions.
Myungho Lee, Jiseong Bak, Seokhyeon Moon, Yoonchan Jhi, Hakjoo Oh		ASE2024Testing / QA; Program Analysis / Verification / Formal Methods
DroneWiS: Automated Simulation Testing of small Unmanned Aerial System in Realistic Windy Conditions.
Bohan Zhang, Ankit Agrawal 0002		ASE2024Testing / QA
Differential Fuzzing for Data Distribution Service Programs with Dynamic Configuration.
Dohyun Ryu, Giyeol Kim, Daeun Lee, Seongjin Kim, Seungjin Bae		ASE2024Testing / QA; DevOps / CI / Build / Release
DevMuT: Testing Deep Learning Framework via Developer Expertise-Based Mutation.
Yanzhou Mu, Juan Zhai, Chunrong Fang, Xiang Chen 0005, Zhixiang Cao		ASE2024Testing / QA; AI / LLM for SE; Human / Empirical / Socio-technical
DeepREST: Automated Test Case Generation for REST APIs Exploiting Deep Reinforcement Learning.
Davide Corradini, Zeno Montolli, Michele Pasqua, Mariano Ceccato		ASE2024Testing / QA
Constructing Surrogate Models in Machine Learning Using Combinatorial Testing and Active Learning.
Sunny Shree, Krishna Khadka, Yu Lei 0001, Raghu N. Kacker, D. Richard Kuhn		ASE2024Testing / QA; AI / LLM for SE
Constraint-Based Test Oracles for Program Analyzers.
Markus Fleischmann, David Kaindlstorfer, Anastasia Isychev, Valentin Wüstholz, Maria Christakis		ASE2024Testing / QA
Compiler Bug Isolation via Enhanced Test Program Mutation.
Yujie Liu 0005, Mingxuan Zhu, Jinhao Dong, Junzhe Yu, Dan Hao 0001		ASE2024Testing / QA
Combining Coverage and Expert Features with Semantic Representation for Coincidental Correctness Detection.
Huan Xie 0002, Yan Lei, Maojin Li, Meng Yan 0001, Sheng Zhang		ASE2024Testing / QA
Can Cooperative Multi-Agent Reinforcement Learning Boost Automatic Web Testing? An Exploratory Study.
Yujia Fan, Sinan Wang, Zebang Fei, Yao Qin, Huaxuan Li		ASE2024Testing / QA; Human / Empirical / Socio-technical; Mobile / Web / GUI / Android
Bridging the Gap between Real-world and Synthetic Images for Testing Autonomous Driving Systems.
Mohammad Hossein Amini, Shiva Nejati 0001		ASE2024Testing / QA
B4: Towards Optimal Assessment of Plausible Code Solutions with Plausible Tests.
Mouxiang Chen, Zhongxin Liu 0002, He Tao, Yusu Hong, David Lo 0001		ASE2024Testing / QA
Automated Validation of COBOL to Java Transformation.
Atul Kumar 0002, Diptikalyan Saha, Toshiaki Yasue, Kohichi Ono, Saravanan Krishnan		ASE2024Testing / QA
Assessing Open Source Software Survivability using Kaplan-Meier Survival Function and Polynomial Regression.
Sohee Park, Ryeonggu Kwon, Gihwon Kwon		ASE2024Testing / QA; Human / Empirical / Socio-technical
Approximation-guided Fairness Testing through Discriminatory Space Analysis.
Zhenjiang Zhao 0002, Takahisa Toda, Takashi Kitamura 0001		ASE2024Testing / QA
Applying Fuzz Driver Generation to Native C/C++ Libraries of OEM Android Framework: Obstacles and Solutions.
Shiyan Peng, Yuan Zhang 0009, Jiarun Dai, Yue Gu, Zhuoxiang Shen		ASE2024Testing / QA; Mobile / Web / GUI / Android
AgoneTest: Automated creation and assessment of Unit tests leveraging Large Language Models.
Andrea Lops, Fedelucio Narducci, Azzurra Ragone, Michelantonio Trizio		ASE2024Testing / QA
ARUS: A Tool for Automatically Removing Unnecessary Stubbings from Test Suites.
Mengzhen Li, Mattia Fazzini		ASE2024Testing / QA
AI-driven Java Performance Testing: Balancing Result Quality with Testing Time.
Luca Traini, Federico Di Menna, Vittorio Cortellessa		ASE2024Testing / QA; AI / LLM for SE; Performance / Energy / Reliability
ωTest: WebView-Oriented Testing for Android Applications.
Jiajun Hu, Lili Wei 0001, Yepang Liu 0001, Shing-Chi Cheung		ISSTA2023Testing / QA; Mobile / Web / GUI / Android
Who Judges the Judge: An Empirical Study on Online Judge Tests.
Kaibo Liu, Yudong Han 0001, Jie M. Zhang, Zhenpeng Chen, Federica Sarro		ISSTA2023Testing / QA; Human / Empirical / Socio-technical
Virtual Reality (VR) Automated Testing in the Wild: A Case Study on Unity-Based VR Applications.
Dhia Elhaq Rzig, Nafees Iqbal, Isabella Attisano, Xue Qin, Foyzul Hassan		ISSTA2023Testing / QA; Human / Empirical / Socio-technical
Vectorizing Program Ingredients for Better JVM Testing.
Tianchang Gao, Junjie Chen 0003, Yingquan Zhao, Yuqun Zhang, Lingming Zhang 0001		ISSTA2023Testing / QA
TreeLine and SlackLine: Grammar-Based Performance Fuzzing on Coffee Break.
Ziyad Alsaeed, Michal Young		ISSTA2023Testing / QA; Performance / Energy / Reliability
Transforming Test Suites into Croissants.
Yang Chen 0059, Alperen Yildiz, Darko Marinov, Reyhaneh Jabbarvand		ISSTA2023Testing / QA
Towards More Realistic Evaluation for Neural Test Oracle Generation.
Zhongxin Liu 0002, Kui Liu 0001, Xin Xia 0001, Xiaohu Yang 0001		ISSTA2023Testing / QA; AI / LLM for SE
To Kill a Mutant: An Empirical Study of Mutation Testing Kills.
Hang Du, Vijay Krishna Palepu, James A. Jones		ISSTA2023Testing / QA; Human / Empirical / Socio-technical
Testing the Compiler for a New-Born Programming Language: An Industrial Case Study (Experience Paper).
Yingquan Zhao, Junjie Chen 0003, Ruifeng Fu, Haojie Ye, Zan Wang		ISSTA2023Testing / QA; Human / Empirical / Socio-technical
Testing Graph Database Engines via Query Partitioning.
Matteo Kamm, Manuel Rigger, Chengyu Zhang 0001, Zhendong Su 0001		ISSTA2023Testing / QA
Testing Automated Driving Systems by Breaking Many Laws Efficiently.
Xiaodong Zhang 0036, Wei Zhao, Yang Sun 0008, Jun Sun 0001, Yulong Shen 0001		ISSTA2023Testing / QA
Systematically Producing Test Orders to Detect Order-Dependent Flaky Tests.
Chengpeng Li 0002, Mohammad Mahdi Khosravi, Wing Lam, August Shi		ISSTA2023Testing / QA; DevOps / CI / Build / Release
Systematic Testing of the Data-Poisoning Robustness of KNN.
Yannan Li 0002, Jingbo Wang 0006, Chao Wang 0001		ISSTA2023Testing / QA
Synthesizing Speech Test Cases with Text-to-Speech? An Empirical Study on the False Alarms in Automated Speech Recognition Testing.
Julia Kaiwen Lau, Kelvin Kai Wen Kong, Julian Hao Yong, Per Hoong Tan, Zhou Yang 0003		ISSTA2023Testing / QA; Human / Empirical / Socio-technical
SlipCover: Near Zero-Overhead Code Coverage for Python.
Juan Altmayer Pizzorno, Emery D. Berger		ISSTA2023Testing / QA
Simulation-Based Validation for Autonomous Driving Systems.
Changwen Li, Joseph Sifakis, Qiang Wang 0020, Rongjie Yan, Jian Zhang 0001		ISSTA2023Testing / QA
SBDT: Search-Based Differential Testing of Certificate Parsers in SSL/TLS Implementations.
Chu Chen, Pinghong Ren, Zhenhua Duan, Cong Tian 0001, Xu Lu 0003		ISSTA2023Testing / QA
RustSmith: Random Differential Compiler Testing for Rust.
Mayank Sharma, Pingshi Yu, Alastair F. Donaldson		ISSTA2023Testing / QA
RobotBT: Behavior-Tree-Based Test-Case Specification for the Robot Framework.
Sven Peldszus, Noubar Akopian, Thorsten Berger		ISSTA2023Testing / QA; Program Analysis / Verification / Formal Methods
Rare Path Guided Fuzzing.
Seemanta Saha, Laboni Sarker, Md Shafiuzzaman, Chaofan Shou, Albert Li		ISSTA2023Testing / QA
ROME: Testing Image Captioning Systems via Recursive Object Melting.
Boxi Yu, Zhiqing Zhong, Jiaqi Li, Yixing Yang, Shilin He		ISSTA2023Testing / QA
Precise and Efficient Patch Presence Test for Android Applications against Code Obfuscation.
Zifan Xie, Ming Wen 0001, Haoxiang Jia, Xiaochen Guo, Xiaotong Huang		ISSTA2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Mobile / Web / GUI / Android
PhysCov: Physical Test Coverage for Autonomous Vehicles.
Carl Hildebrandt, Meriel von Stein, Sebastian G. Elbaum		ISSTA2023Testing / QA
Pattern-Based Peephole Optimizations with Java JIT Tests.
Zhiqiang Zang, Aditya Thimmaiah, Milos Gligoric 0001		ISSTA2023Testing / QA
More Precise Regression Test Selection via Reasoning about Semantics-Modifying Changes.
Yu Liu 0079, Jiyang Zhang 0003, Pengyu Nie 0001, Milos Gligoric 0001, Owolabi Legunsen		ISSTA2023Testing / QA; DevOps / CI / Build / Release; Maintenance / Evolution / Refactoring / Review
MetaData262: Automatic Test Suite Selection for Partial JavaScript Implementations.
Frederico Ramos, Diogo Costa Reis, Miguel Trigo, António Morgado 0001, José Fragoso Santos		ISSTA2023Testing / QA
Latent Imitator: Generating Natural Individual Discriminatory Instances for Black-Box Fairness Testing.
Yisong Xiao, Aishan Liu, Tianlin Li, Xianglong Liu 0001		ISSTA2023Testing / QA
Large Language Models Are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Models.
Yinlin Deng, Chunqiu Steven Xia, Haoran Peng, Chenyuan Yang, Lingming Zhang 0001		ISSTA2023Testing / QA
KeenTune: Automated Tuning Tool for Cloud Application Performance Testing and Optimization.
Qinglong Wang 0003, Runzhe Wang, Yuxi Hu, Xiaohai Shi, Zheng Liu		ISSTA2023Testing / QA; Cloud / Microservices / Distributed Systems; Performance / Energy / Reliability
KDAlloc: The KLEE Deterministic Allocator: Deterministic Memory Allocation during Symbolic Execution and Test Case Replay.
Daniel Schemmel, Julian Büning, Frank Busse, Martin Nowack, Cristian Cadar		ISSTA2023Testing / QA; Program Analysis / Verification / Formal Methods
In Defense of Simple Techniques for Neural Network Test Case Selection.
Shenglin Bao, Chaofeng Sha, Bihuan Chen 0001, Xin Peng 0001, Wenyun Zhao		ISSTA2023Testing / QA; AI / LLM for SE
Improving Spectrum-Based Localization of Multiple Faults by Iterative Test Suite Reduction.
Dylan Callaghan, Bernd Fischer 0002		ISSTA2023Testing / QA
Icicle: A Re-designed Emulator for Grey-Box Firmware Fuzzing.
Michael Chesser, Surya Nepal, Damith C. Ranasinghe		ISSTA2023Testing / QA
Harnessing Large Language Models for Simulink Toolchain Testing and Developing Diverse Open-Source Corpora of Simulink Models for Metric and Evolution Analysis.
Sohil Lal Shrestha		ISSTA2023Testing / QA; Maintenance / Evolution / Refactoring / Review
Guiding Greybox Fuzzing with Mutation Testing.
Vasudev Vikram, Isabella Laybourn, Ao Li 0009, Nicole Nair, Kelton OBrien		ISSTA2023Testing / QA
Green Fuzzing: A Saturation-Based Stopping Criterion using Vulnerability Prediction.
Stephan Lipp, Daniel Elsner, Severin Kacianka, Alexander Pretschner, Marcel Böhme		ISSTA2023Testing / QA
GrayC: Greybox Fuzzing of Compilers and Analysers for C.
Karine Even-Mendoza, Arindam Sharma, Alastair F. Donaldson, Cristian Cadar		ISSTA2023Testing / QA
GenCoG: A DSL-Based Approach to Generating Computation Graphs for TVM Testing.
Zihan Wang, Pengbo Nie, Xinyuan Miao, Yuting Chen 0001, Chengcheng Wan 0001		ISSTA2023Testing / QA
GPUHarbor: Testing GPU Memory Consistency at Large (Experience Paper).
Reese Levine, Mingun Cho, Devon McKee, Andrew Quinn 0001, Tyler Sorensen 0001		ISSTA2023Testing / QA
Fuzzing Embedded Systems using Debug Interfaces.
Max Eisele, Daniel Ebert, Christopher Huth, Andreas Zeller		ISSTA2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Fuzzing Deep Learning Compilers with HirGen.
Haoyang Ma, Qingchao Shen, Yongqiang Tian 0001, Junjie Chen 0003, Shing-Chi Cheung		ISSTA2023Testing / QA; AI / LLM for SE
Fairness Testing for Recommender Systems.
Huizhong Guo 0001		ISSTA2023Testing / QA
FairRec: Fairness Testing for Deep Recommender Systems.
Huizhong Guo 0001, Jinfeng Li, Jingyi Wang 0004, Xiangyu Liu, Dongxia Wang 0002		ISSTA2023Testing / QA
Extracting Inline Tests from Unit Tests.
Yu Liu 0079, Pengyu Nie 0001, Anna Guo, Milos Gligoric 0001, Owolabi Legunsen		ISSTA2023Testing / QA
Enhancing REST API Testing with NLP Techniques.
Myeongsoo Kim, Davide Corradini, Saurabh Sinha 0003, Alessandro Orso, Michele Pasqua		ISSTA2023Testing / QA
ECSTATIC: Automatic Configuration-Aware Testing and Debugging of Static Analysis Tools.
Austin Mordahl, Dakota Soles, Miao Miao 0001, Zenong Zhang, Shiyi Wei		ISSTA2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Program Analysis / Verification / Formal Methods; DevOps / CI / Build / Release
Detecting State Inconsistency Bugs in DApps via On-Chain Transaction Replay and Fuzzing.
Mingxi Ye, Yuhong Nan, Zibin Zheng, Dongpeng Wu, Huizhong Li		ISSTA2023Testing / QA
Dependency-Aware Metamorphic Testing of Datalog Engines.
Muhammad Numair Mansur, Valentin Wüstholz, Maria Christakis		ISSTA2023Testing / QA
DeepAtash: Focused Test Generation for Deep Learning Systems.
Tahereh Zohdinasab, Vincenzo Riccio, Paolo Tonella		ISSTA2023Testing / QA; AI / LLM for SE
CydiOS: A Model-Based Testing Framework for iOS Apps.
Shuohan Wu, Jianfeng Li 0006, Hao Zhou 0043, Yongsheng Fang, Kaifa Zhao		ISSTA2023Testing / QA; Mobile / Web / GUI / Android
Building Critical Testing Scenarios for Autonomous Driving from Real Accidents.
Xudong Zhang 0007, Yan Cai 0001		ISSTA2023Testing / QA
BehAVExplor: Behavior Diversity Guided Testing for Autonomous Driving Systems.
Mingfei Cheng, Yuan Zhou 0005, Xiaofei Xie		ISSTA2023Testing / QA
Back Deduction Based Testing for Word Sense Disambiguation Ability of Machine Translation Systems.
Jun Wang 0151, Yanhui Li, Xiang Huang, Lin Chen 0015, Xiaofang Zhang		ISSTA2023Testing / QA
Automatic Testing and Benchmarking for Configurable Static Analysis Tools.
Austin Mordahl		ISSTA2023Testing / QA; Program Analysis / Verification / Formal Methods
Automated Program Repair from Fuzzing Perspective.
Youngjae Kim, Seungheon Han, Askar Yeltayuly Khamit, Jooyong Yi		ISSTA2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
AGORA: Automated Generation of Test Oracles for REST APIs.
Juan C. Alonso, Sergio Segura, Antonio Ruiz-Cortés		ISSTA2023Testing / QA
ACETest: Automated Constraint Extraction for Testing Deep Learning Operators.
Jingyi Shi, Yang Xiao 0011, Yuekang Li, Yeting Li, Dongsong Yu		ISSTA2023Testing / QA; AI / LLM for SE
1dFuzz: Reproduce 1-Day Vulnerabilities with Directed Differential Fuzzing.
Songtao Yang, Yubo He, Kaixiang Chen, Zheyu Ma, Xiapu Luo		ISSTA2023Testing / QA
When and Why Test Generators for Deep Learning Produce Invalid Inputs: an Empirical Study.
Vincenzo Riccio, Paolo Tonella		ICSE2023Testing / QA; AI / LLM for SE; Human / Empirical / Socio-technical
Testing Database Systems via Differential Query Execution.
Jiansen Song, Wensheng Dou, Ziyu Cui, Qianwang Dai, Wei Wang 0049		ICSE2023Testing / QA
Testing Database Engines via Query Plan Guidance.
Jinsheng Ba, Manuel Rigger		ICSE2023Testing / QA
Testability Refactoring in Pull Requests: Patterns and Trends.
Pavel Reich, Walid Maalej		ICSE2023Testing / QA; Maintenance / Evolution / Refactoring / Review
Test Selection for Unified Regression Testing.
Shuai Wang 0035, Xinyu Lian, Darko Marinov, Tianyin Xu		ICSE2023Testing / QA; DevOps / CI / Build / Release
Revisiting Neuron Coverage for DNN Testing: A Layer-Wise and Distribution-Aware Criterion.
Yuanyuan Yuan 0001, Qi Pang, Shuai Wang 0011		ICSE2023Testing / QA
Responsibility in Context: On Applicability of Slicing in Semantic Regression Analysis.
Sahar Badihi, Khaled Ahmed 0004, Yi Li 0008, Julia Rubin		ICSE2023Testing / QA; Program Analysis / Verification / Formal Methods
Regression Fuzzing for Deep Learning Systems.
Hanmo You, Zan Wang, Junjie Chen 0003, Shuang Liu 0007, Shuochuan Li		ICSE2023Testing / QA; AI / LLM for SE
Reachable Coverage: Estimating Saturation in Fuzzing.
Danushka Liyanage, Marcel Böhme, Chakkrit Tantithamthavorn, Stephan Lipp		ICSE2023Testing / QA
Operand-Variation-Oriented Differential Analysis for Fuzzing Binding Calls in PDF Readers.
Suyue Guo, Xinyu Wan, Wei You 0001, Bin Liang 0002, Wenchang Shi		ICSE2023Testing / QA
MorphQ: Metamorphic Testing of the Qiskit Quantum Computing Platform.
Matteo Paltenghi, Michael Pradel		ICSE2023Testing / QA
Metamorphic Shader Fusion for Testing Graphics Shader Compilers.
Dongwei Xiao, Zhibo Liu, Shuai Wang 0011		ICSE2023Testing / QA
Measuring and Mitigating Gaps in Structural Testing.
Soneya Binta Hossain, Matthew B. Dwyer, Sebastian G. Elbaum, Anh Nguyen-Tuong		ICSE2023Testing / QA
Many-Objective Reinforcement Learning for Online Testing of DNN-Enabled Systems.
Fitash Ul Haq, Donghwan Shin 0001, Lionel C. Briand		ICSE2023Testing / QA
MTTM: Metamorphic Testing for Textual Content Moderation Software.
Wenxuan Wang 0001, Jen-tse Huang 0001, Weibin Wu 0002, Jianping Zhang 0002, Yizhan Huang		ICSE2023Testing / QA
Lightweight Approaches to DNN Regression Error Reduction: An Uncertainty Alignment Perspective.
Zenan Li, Maorun Zhang, Jingwei Xu 0001, Yuan Yao 0001, Chun Cao		ICSE2023Testing / QA
Learning Seed-Adaptive Mutation Strategies for Greybox Fuzzing.
Myungho Lee, Sooyoung Cha, Hakjoo Oh		ICSE2023Testing / QA
Learning Deep Semantics for Test Completion.
Pengyu Nie 0001, Rahul Banerjee, Junyi Jessy Li, Raymond J. Mooney, Milos Gligoric 0001		ICSE2023Testing / QA
Large Language Models are Few-shot Testers: Exploring LLM-based General Bug Reproduction.
Sungmin Kang, Juyeon Yoon, Shin Yoo		ICSE2023Testing / QA; AI / LLM for SE
JITfuzz: Coverage-guided Fuzzing for JVM Just-in-Time Compilers.
Mingyuan Wu, Minghai Lu, Heming Cui, Junjie Chen 0003, Yuqun Zhang		ICSE2023Testing / QA
Information-Theoretic Testing and Debugging of Fairness Defects in Deep Neural Networks.
Verya Monjezi, Ashutosh Trivedi 0001, Gang Tan, Saeid Tizpaz-Niari		ICSE2023Testing / QA; AI / LLM for SE; Debugging / Fault Localization / Diagnosis / Repair
Generating Test Databases for Database-Backed Applications.
Cong Yan, Suman Nath, Shan Lu 0001		ICSE2023Testing / QA
Generating Realistic and Diverse Tests for LiDAR-Based Perception Systems.
Garrett Christian, Trey Woodlief, Sebastian G. Elbaum		ICSE2023Testing / QA; Human / Empirical / Socio-technical
GameRTS: A Regression Testing Framework for Video Games.
Jiongchi Yu, Yuechen Wu, Xiaofei Xie, Wei Le, Lei Ma 0003		ICSE2023Testing / QA; DevOps / CI / Build / Release
Fuzzing Automatic Differentiation in Deep-Learning Libraries.
Chenyuan Yang, Yinlin Deng, Jiayi Yao, Yuxing Tu, Hanchi Li		ICSE2023Testing / QA
Finding Causally Different Tests for an Industrial Control System.
Christopher M. Poskitt, Yuqi Chen 0001, Jun Sun 0001, Yu Jiang 0001		ICSE2023Testing / QA
Fill in the Blank: Context-aware Automated Text Input Generation for Mobile GUI Testing.
Zhe Liu 0025, Chunyang Chen 0001, Junjie Wang 0001, Xing Che, Yuekai Huang		ICSE2023Testing / QA; Mobile / Web / GUI / Android
Evaluating and Improving Hybrid Fuzzing.
Ling Jiang, Hengchen Yuan, Mingyuan Wu, Lingming Zhang 0001, Yuqun Zhang		ICSE2023Testing / QA
Efficiency Matters: Speeding Up Automated Testing with GUI Rendering Inference.
Sidong Feng, Mulong Xie, Chunyang Chen 0001		ICSE2023Testing / QA; Mobile / Web / GUI / Android; Performance / Energy / Reliability
ECSTATIC: An Extensible Framework for Testing and Debugging Configurable Static Analysis.
Austin Mordahl, Zenong Zhang, Dakota Soles, Shiyi Wei		ICSE2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Program Analysis / Verification / Formal Methods
Doppelgänger Test Generation for Revealing Bugs in Autonomous Driving Software.
Yuqi Huai, Yuntianyi Chen, Sumaya Almanee, Tuan Ngo, Xiang Liao		ICSE2023Testing / QA
Diver: Oracle-Guided SMT Solver Testing with Unrestricted Random Mutations.
Jongwook Kim, Sunbeom So, Hakjoo Oh		ICSE2023Testing / QA
Detecting Isolation Bugs via Transaction Oracle Construction.
Wensheng Dou, Ziyu Cui, Qianwang Dai, Jiansen Song, Dong Wang 0048		ICSE2023Testing / QA
Coverage Guided Fault Injection for Cloud Systems.
Yu Gao 0002, Wensheng Dou, Dong Wang 0048, Wenhan Feng, Jun Wei 0001		ICSE2023Testing / QA; Cloud / Microservices / Distributed Systems
Compiler Test-Program Generation via Memoized Configuration Search.
Junjie Chen 0003, Chenyao Suo, Jiajun Jiang, Peiqi Chen, Xingjian Li 0007		ICSE2023Testing / QA; DevOps / CI / Build / Release
Columbus: Android App Testing Through Systematic Callback Exploration.
Priyanka Bose, Dipanjan Das 0002, Saastha Vasan, Sebastiano Mariani, Ilya Grishchenko		ICSE2023Testing / QA; Mobile / Web / GUI / Android
CodaMosa: Escaping Coverage Plateaus in Test Generation with Pre-trained Large Language Models.
Caroline Lemieux, Jeevana Priya Inala, Shuvendu K. Lahiri, Siddhartha Sen 0001		ICSE2023Testing / QA
Carving UI Tests to Generate API Tests and API Specification.
Rahulkrishna Yandrapally, Saurabh Sinha 0003, Rachel Tzoref-Brill, Ali Mesbah 0001		ICSE2023Testing / QA; Program Analysis / Verification / Formal Methods; Mobile / Web / GUI / Android
CCTEST: Testing and Repairing Code Completion Systems.
Zongjie Li, Chaozheng Wang, Zhibo Liu, Haoxuan Wang, Dong Chen		ICSE2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
CC: Causality-Aware Coverage Criterion for Deep Neural Networks.
Zhenlan Ji, Pingchuan Ma 0004, Yuanyuan Yuan 0001, Shuai Wang 0011		ICSE2023Testing / QA; AI / LLM for SE
Better Automatic Program Repair by Using Bug Reports and Tests Together.
Manish Motwani, Yuriy Brun		ICSE2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Balancing Effectiveness and Flakiness of Non-Deterministic Machine Learning Tests.
Chunqiu Steven Xia, Saikat Dutta 0001, Sasa Misailovic, Darko Marinov, Lingming Zhang 0001		ICSE2023Testing / QA; AI / LLM for SE
Badge: Prioritizing UI Events with Hierarchical Multi-Armed Bandits for Automated UI Testing.
Dezhi Ran, Hao Wang 0112, Wenyu Wang, Tao Xie 0001		ICSE2023Testing / QA; Mobile / Web / GUI / Android
Automated Black-Box Testing of Mass Assignment Vulnerabilities in RESTful APIs.
Davide Corradini, Michele Pasqua, Mariano Ceccato		ICSE2023Testing / QA
Aries: Efficient Testing of Deep Neural Networks via Labeling-Free Accuracy Estimation.
Qiang Hu, Yuejun Guo 0001, Xiaofei Xie, Maxime Cordy, Mike Papadakis		ICSE2023Testing / QA; AI / LLM for SE
ATM: Black-box Test Case Minimization based on Test Code Similarity and Evolutionary Search.
Rongqi Pan, Taher Ahmed Ghaleb, Lionel C. Briand		ICSE2023Testing / QA
µAkka: Mutation Testing for Actor Concurrency in Akka using Real-World Bugs.
Mohsen Moradi-Moghadam, Mehdi Bagherzadeh 0001, Raffi Khatchadourian, Hamid Bagheri		FSE2023Testing / QA
Towards Strengthening Formal Specifications with Mutation Model Checking.
Maxime Cordy, Sami Lazreg, Axel Legay, Pierre-Yves Schobbens		FSE2023Testing / QA; Program Analysis / Verification / Formal Methods
Testing Real-World Healthcare IoT Application: Experiences and Lessons Learned.
Hassan Sartaj, Shaukat Ali 0001, Tao Yue 0002, Kjetil Moberg		FSE2023Testing / QA
Testing Coreference Resolution Systems without Labeled Test Sets.
Jialun Cao, Yaojie Lu 0001, Ming Wen 0001, Shing-Chi Cheung		FSE2023Testing / QA
Test Case Generation for Drivability Requirements of an Automotive Cruise Controller: An Experience with an Industrial Simulator.
Federico Formica, Nicholas Petrunti, Lucas Bruck, Vera Pantelic, Mark Lawford		FSE2023Testing / QA; Requirements / Modeling / Architecture
Statfier: Automated Testing of Static Analyzers via Semantic-Preserving Program Transformations.
Huaien Zhang, Yu Pei 0001, Junjie Chen 0003, Shin Hwei Tan		FSE2023Testing / QA
Semantic Test Repair for Web Applications.
Xiaofang Qi, Xiang Qian, Yanhui Li		FSE2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Mobile / Web / GUI / Android
SJFuzz: Seed and Mutator Scheduling for JVM Fuzzing.
Mingyuan Wu, Yicheng Ouyang, Minghai Lu, Junjie Chen 0003, Yingquan Zhao		FSE2023Testing / QA
Rotten Green Tests in Google Test.
Paul Robinson		FSE2023Testing / QA
Revisiting Neural Program Smoothing for Fuzzing.
Maria-Irina Nicolae, Max Eisele, Andreas Zeller		FSE2023Testing / QA; AI / LLM for SE
Property-Based Fuzzing for Finding Data Manipulation Errors in Android Apps.
Jingling Sun, Ting Su 0001, Jiayi Jiang, Jue Wang, Geguang Pu		FSE2023Testing / QA; Mobile / Web / GUI / Android
Prioritizing Natural Language Test Cases Based on Highly-Used Game Features.
Markos Viggiato, Dale Paas, Cor-Paul Bezemer		FSE2023Testing / QA
Neural-Based Test Oracle Generation: A Large-Scale Evaluation and Lessons Learned.
Soneya Binta Hossain, Antonio Filieri, Matthew B. Dwyer, Sebastian G. Elbaum, Willem Visser		FSE2023Testing / QA; AI / LLM for SE
NaNofuzz: A Usable Tool for Automatic Test Generation.
Matthew C. Davis, Sangheon Choi, Sam Estep, Brad A. Myers, Joshua Sunshine		FSE2023Testing / QA
Metamong: Detecting Render-Update Bugs in Web Browsers through Fuzzing.
Suhwan Song, Byoungyoung Lee		FSE2023Testing / QA; Mobile / Web / GUI / Android
Mate! Are You Really Aware? An Explainability-Guided Testing Framework for Robustness of Malware Detectors.
Ruoxi Sun 0001, Minhui Xue 0001, Gareth Tyson, Tian Dong, Shaofeng Li 0001		FSE2023Testing / QA; Security / Privacy / Vulnerability
MASC: A Tool for Mutation-Based Evaluation of Static Crypto-API Misuse Detectors.
Amit Seal Ami, Syed Yusuf Ahmed, Radowan Mahmud Redoy, Nathan Cooper, Kaushal Kafle		FSE2023Testing / QA
Leveraging Hardware Probes and Optimizations for Accelerating Fuzz Testing of Heterogeneous Applications.
Jiyuan Wang, Qian Zhang 0020, Hongbo Rong, Guoqing Harry Xu, Miryung Kim		FSE2023Testing / QA
LazyCow: A Lightweight Crowdsourced Testing Tool for Taming Android Fragmentation.
Xiaoyu Sun 0002, Xiao Chen 0002, Yonghui Liu 0001, John C. Grundy, Li Li 0029		FSE2023Testing / QA; Mobile / Web / GUI / Android
LLM-Based Code Generation Method for Golang Compiler Testing.
Qiuhan Gu		FSE2023Testing / QA; AI / LLM for SE
Keeping Mutation Test Suites Consistent and Relevant with Long-Standing Mutants.
Milos Ojdanic, Mike Papadakis, Mark Harman		FSE2023Testing / QA
Issue Report Validation in an Industrial Context.
Ethem Utku Aktas, Ebru Cakmak, Mete Inan, Cemal Yilmaz 0001		FSE2023Testing / QA
Heterogeneous Testing for Coverage Profilers Empowered with Debugging Support.
Yibiao Yang, Maolin Sun, Yang Wang 0165, Qingyang Li 0006, Ming Wen 0001		FSE2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Helion: Enabling Natural Testing of Smart Homes.
Prianka Mandal, Sunil Manandhar, Kaushal Kafle, Kevin Moran, Denys Poshyvanyk		FSE2023Testing / QA
Getting pwn'd by AI: Penetration Testing with Large Language Models.
Andreas Happe, Jürgen Cito		FSE2023Testing / QA
EtherDiffer: Differential Testing on RPC Services of Ethereum Nodes.
Shinhae Kim, Sungjae Hwang		FSE2023Testing / QA
Enhancing Coverage-Guided Fuzzing via Phantom Program.
Mingyuan Wu, Kunqiu Chen, Qi Luo, Jiahong Xiang, Ji Qi 0002		FSE2023Testing / QA
DistXplore: Distribution-Guided Testing for Evaluating and Enhancing Deep Learning Systems.
Longtian Wang, Xiaofei Xie, Xiaoning Du 0001, Meng Tian, Qing Guo 0005		FSE2023Testing / QA; AI / LLM for SE
Contextual Predictive Mutation Testing.
Kush Jain, Uri Alon 0002, Alex Groce, Claire Le Goues		FSE2023Testing / QA
Comparison and Evaluation on Static Application Security Testing (SAST) Tools for Java.
Kaixuan Li 0002, Sen Chen 0001, Lingling Fan 0003, Ruitao Feng, Han Liu 0012		FSE2023Testing / QA; Security / Privacy / Vulnerability
Code Coverage Criteria for Asynchronous Programs.
Mohammad Ganji, Saba Alimadadi, Frank Tip		FSE2023Testing / QA
Co-dependence Aware Fuzzing for Dataflow-Based Big Data Analytics.
Ahmad Humayun, Miryung Kim, Muhammad Ali Gulzar		FSE2023Testing / QA; Program Analysis / Verification / Formal Methods
Automated Testing and Improvement of Named Entity Recognition Systems.
Boxi Yu, Yiyan Hu, Qiuyang Mang, Wenhan Hu, Pinjia He		FSE2023Testing / QA
Automated Test Generation for Medical Rules Web Services: A Case Study at the Cancer Registry of Norway.
Christoph Laaber, Tao Yue 0002, Shaukat Ali 0001, Thomas Schwitalla, Jan Nygård		FSE2023Testing / QA; Human / Empirical / Socio-technical; Mobile / Web / GUI / Android
Automata-Based Trace Analysis for Aiding Diagnosing GUI Testing Tools for Android.
Enze Ma, Shan Huang, Weigang He, Ting Su 0001, Jue Wang		FSE2023Testing / QA; Mobile / Web / GUI / Android
Accelerating Continuous Integration with Parallel Batch Testing.
Emad Fallahzadeh, Amir Hossein Bavand, Peter C. Rigby		FSE2023Testing / QA; DevOps / CI / Build / Release
API-Knowledge Aware Search-Based Software Testing: Where, What, and How.
Xiaoxue Ren, Xinyuan Ye, Yun Lin 0001, Zhenchang Xing, Shuqing Li 0001		FSE2023Testing / QA
A Unified Framework for Mini-game Testing: Experience on WeChat.
Chaozheng Wang, Haochuan Lu, Cuiyun Gao 0001, Zongjie Li, Ting Xiong		FSE2023Testing / QA
A Language Model of Java Methods with Train/Test Deduplication.
Chia-Yi Su, Aakash Bansal, Vijayanta Jain, Sepideh Ghanavati, Collin McMillan		FSE2023Testing / QA
A Generative and Mutational Approach for Synthesizing Bug-Exposing Test Cases to Guide Compiler Fuzzing.
Guixin Ye, Tianmin Hu, Zhanyong Tang, Zhenye Fan, Shin Hwei Tan		FSE2023Testing / QA; AI / LLM for SE
Zero-Config Fuzzing for Microservices.
Wei Wang, Andrei Benea, Franjo Ivancic		ASE2023Testing / QA
WADIFF: A Differential Testing Framework for WebAssembly Runtimes.
Shiyao Zhou, Muhui Jiang, Weimin Chen, Hao Zhou 0043, Haoyu Wang 0001		ASE2023Testing / QA
Vision-Based Widget Mapping for Test Migration Across Mobile Platforms: Are We There Yet?
Ruihua Ji, Tingwei Zhu, Xiaoqing Zhu, Chunyang Chen 0001, Minxue Pan		ASE2023Testing / QA; Maintenance / Evolution / Refactoring / Review; Mobile / Web / GUI / Android
VRGuide: Efficient Testing of Virtual Reality Scenes via Dynamic Cut Coverage.
Xiaoyin Wang, Tahmid Rafi, Na Meng 0001		ASE2023Testing / QA
VD-Guard: DMA Guided Fuzzing for Hypervisor Virtual Device.
Yuwei Liu 0001, Siqi Chen, Yuchong Xie, Yanhao Wang, Libo Chen 0001		ASE2023Testing / QA
Towards Autonomous Testing Agents via Conversational Large Language Models.
Robert Feldt, Sungmin Kang, Juyeon Yoon, Shin Yoo		ASE2023Testing / QA
To Share, or Not to Share: Exploring Test-Case Reusability in Fork Ecosystems.
Mukelabai Mukelabai, Christoph Derks, Jacob Krüger, Thorsten Berger		ASE2023Testing / QA
TEASER: Simulation-Based CAN Bus Regression Testing for Self-Driving Cars Software.
Christian Birchler, Cyrill Rohrbach, Hyeongkyun Kim, Alessio Gambi, Tianhai Liu		ASE2023Testing / QA
Systematically Detecting Packet Validation Vulnerabilities in Embedded Network Stacks.
Paschal C. Amusuo, Ricardo Andrés Calvo Méndez, Zhongwei Xu, Aravind Machiry, James C. Davis 0001		ASE2023Testing / QA
SpecFuzzer: A Tool for Inferring Class Specifications via Grammar-Based Fuzzing.
Facundo Molina, Marcelo d'Amorim, Nazareno Aguirre		ASE2023Testing / QA
Semantic Data Augmentation for Deep Learning Testing Using Generative AI.
Sondess Missaoui, Simos Gerasimou, Nicholas Matragkas		ASE2023Testing / QA; AI / LLM for SE
Scalable Industrial Control System Analysis via XAI-Based Gray-Box Fuzzing.
Justin Kur, Jingshu Chen, Jun Huang 0001		ASE2023Testing / QA
SMT Solver Validation Empowered by Large Pre-Trained Language Models.
Maolin Sun, Yibiao Yang, Yang Wang 0165, Ming Wen 0001, Haoxiang Jia		ASE2023Testing / QA
Revisiting and Improving Retrieval-Augmented Deep Assertion Generation.
Weifeng Sun 0004, Hongyan Li, Meng Yan 0001, Yan Lei, Hongyu Zhang 0002		ASE2023Testing / QA
Revealing Performance Issues in Server-Side WebAssembly Runtimes Via Differential Testing.
Shuyao Jiang, Ruiying Zeng, Zihao Rao, Jiazhen Gu, Yangfan Zhou 0002		ASE2023Testing / QA; Performance / Energy / Reliability
QuraTest: Integrating Quantum Specific Features in Quantum Program Testing.
Jiaming Ye, Shangzhou Xia, Fuyuan Zhang, Paolo Arcaini, Lei Ma 0003		ASE2023Testing / QA
QuCAT: A Combinatorial Testing Tool for Quantum Software.
Xinyi Wang 0004, Paolo Arcaini, Tao Yue 0002, Shaukat Ali 0001		ASE2023Testing / QA
Provengo: A Tool Suite for Scenario Driven Model-Based Testing.
Michael Bar-Sinai, Achiya Elyasaf, Gera Weiss, Yeshayahu Weiss		ASE2023Testing / QA
Precise Data-Driven Approximation for Program Analysis via Fuzzing.
Nikhil Parasaram, Earl T. Barr, Sergey Mechtaev, Marcel Böhme		ASE2023Testing / QA; Program Analysis / Verification / Formal Methods
PhyFu: Fuzzing Modern Physics Simulation Engines.
Dongwei Xiao, Zhibo Liu, Shuai Wang 0011		ASE2023Testing / QA
PURLTL: Mining LTL Specification from Imperfect Traces in Testing.
Bo Peng, Pingjia Liang, Tingchen Han, Weilin Luo, Jianfeng Du		ASE2023Testing / QA; Program Analysis / Verification / Formal Methods
Nuances are the Key: Unlocking ChatGPT to Find Failure-Inducing Tests with Differential Prompting.
Tsz On Li, Wenxi Zong, Yibo Wang 0008, Haoye Tian, Ying Wang 0038		ASE2023Testing / QA; AI / LLM for SE; Debugging / Fault Localization / Diagnosis / Repair
Mutation-based Fault Localization of Deep Neural Networks.
Ali Ghanbari 0001, Deepak-George Thomas, Muhammad Arbab Arshad, Hridesh Rajan		ASE2023Testing / QA; AI / LLM for SE; Debugging / Fault Localization / Diagnosis / Repair
MLIRSmith: Random Program Generation for Fuzzing MLIR Compiler Infrastructure.
Haoyu Wang 0017, Junjie Chen 0003, Chuyue Xie, Shuang Liu 0007, Zan Wang		ASE2023Testing / QA
LIV: Loop-Invariant Validation Using Straight-Line Programs.
Dirk Beyer 0001, Martin Spiessl		ASE2023Testing / QA; Program Analysis / Verification / Formal Methods
LEAP: Efficient and Automated Test Method for NLP Software.
Mingxuan Xiao, Yan Xiao 0002, Hai Dong, Shunhui Ji, Pengcheng Zhang 0001		ASE2023Testing / QA
Identify and Update Test Cases When Production Code Changes: A Transformer-Based Approach.
Xing Hu 0008, Zhuang Liu, Xin Xia 0001, Zhongxin Liu 0002, Tongtong Xu		ASE2023Testing / QA; AI / LLM for SE; Maintenance / Evolution / Refactoring / Review
ICTDroid: Parameter-Aware Combinatorial Testing for Components of Android Apps.
Shixin Zhang, Shanna Li, Xi Deng, Jiwei Yan, Jun Yan 0009		ASE2023Testing / QA; Mobile / Web / GUI / Android
Generative Model-Based Testing on Decision-Making Policies.
Zhuo Li 0021, Xiongfei Wu, Derui Zhu, Mingfei Cheng, Siyuan Chen		ASE2023Testing / QA; AI / LLM for SE
Fuzzing for CPS Mutation Testing.
Jaekwon Lee, Enrico Viganò, Oscar Cornejo 0001, Fabrizio Pastore, Lionel C. Briand		ASE2023Testing / QA
FLUX: Finding Bugs with LLVM IR Based Unit Test Crossovers.
Eric Liu, Shengjie Xu, David Lie		ASE2023Testing / QA
ExpressAPR: Efficient Patch Validation for Java Automated Program Repair Systems.
Yuan-an Xiao, Chenyang Yang 0002, Bo Wang 0050, Yingfei Xiong 0001		ASE2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Effective Concurrency Testing for Go via Directional Primitive-Constrained Interleaving Exploration.
Zongze Jiang, Ming Wen 0001, Yixin Yang 0006, Chao Peng 0002, Ping Yang		ASE2023Testing / QA
DroneReqValidator: Facilitating High Fidelity Simulation Testing for Uncrewed Aerial Systems Developers.
Bohan Zhang, Yashaswini Shivalingaiah, Ankit Agrawal 0002		ASE2023Testing / QA; Human / Empirical / Socio-technical
CoMSA: A Modeling-Driven Sampling Approach for Configuration Performance Testing.
Yuanjie Xia 0002, Zishuo Ding, Weiyi Shang		ASE2023Testing / QA; DevOps / CI / Build / Release; Requirements / Modeling / Architecture; Performance / Energy / Reliability
Characterizing Flaky Tests in Node.js Applications.
Xiaoning Chang, Zheheng Liang, Guoquan Wu, Yu Gao 0002, Wei Chen 0018		ASE2023Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release
CAT-LM Training Language Models on Aligned Code And Tests.
Nikitha Rao, Kush Jain, Uri Alon 0002, Claire Le Goues, Vincent J. Hellendoorn		ASE2023Testing / QA
Automating Bias Testing of LLMs.
Sergio Morales 0001, Robert Clarisó, Jordi Cabot		ASE2023Testing / QA
Automated Fixing of Web UI Tests via Iterative Element Matching.
Yuanzhang Lin, Guoyao Wen, Xiang Gao 0012		ASE2023Testing / QA; Mobile / Web / GUI / Android
AutoConf: Automated Configuration of Unsupervised Learning Systems Using Metamorphic Testing and Bayesian Optimization.
Lwin Khin Shar, Arda Goknil, Erik Johannes Husom, Sagar Sen, Yan Naing Tun		ASE2023Testing / QA; DevOps / CI / Build / Release; Performance / Energy / Reliability
An Image is Worth a Thousand Toxic Words: A Metamorphic Testing Framework for Content Moderation Software.
Wenxuan Wang 0001, Jingyuan Huang, Jen-tse Huang 0001, Chang Chen, Jiazhen Gu		ASE2023Testing / QA
Adaptive REST API Testing with Reinforcement Learning.
Myeongsoo Kim, Saurabh Sinha 0003, Alessandro Orso		ASE2023Testing / QA
ATOM: Automated Black-Box Testing of Multi-Label Image Classification Systems.
Shengyou Hu, Huayao Wu, Peng Wang 0125, Jing Chang, Yongjun Tu		ASE2023Testing / QA
ASTER: Automatic Speech Recognition System Accessibility Testing for Stutterers.
Yi Liu 0069, Yuekang Li, Gelei Deng, Felix Juefei-Xu, Yao Du 0002		ASE2023Testing / QA; Mobile / Web / GUI / Android
UniRLTest: universal platform-independent testing with reinforcement learning via image understanding.
Ziqian Zhang, Yulei Liu, Shengcheng Yu, Xin Li 0034, Yexiao Yun		ISSTA2022Testing / QA
Testing Dafny (experience paper).
Ahmed Irfan, Sorawee Porncharoenwase, Zvonimir Rakamaric, Neha Rungta, Emina Torlak		ISSTA2022Testing / QA
Test mimicry to assess the exploitability of library vulnerabilities.
Hong Jin Kang, Truong Giang Nguyen, Bach Le 0001, Corina S. Pasareanu, David Lo 0001		ISSTA2022Testing / QA
TensileFuzz: facilitating seed input generation in fuzzing via string constraint solving.
Xuwei Liu, Wei You 0001, Zhuo Zhang 0002, Xiangyu Zhang 0001		ISSTA2022Testing / QA
SnapFuzz: high-throughput fuzzing of network applications.
Anastasios Andronidis, Cristian Cadar		ISSTA2022Testing / QA
Simple techniques work surprisingly well for neural network test prioritization and active learning (replicability study).
Michael Weiss 0004, Paolo Tonella		ISSTA2022Testing / QA; AI / LLM for SE; Human / Empirical / Socio-technical; DevOps / CI / Build / Release
SLIME: program-sensitive energy allocation for fuzzing.
Chenyang Lyu, Hong Liang, Shouling Ji, Xuhong Zhang 0002, Binbin Zhao		ISSTA2022Testing / QA; Performance / Energy / Reliability
RegMiner: towards constructing a large regression dataset from code evolution history.
Xuezhi Song, Yun Lin 0001, Siang Hwee Ng, Yijian Wu, Xin Peng 0001		ISSTA2022Testing / QA; Maintenance / Evolution / Refactoring / Review
QMutPy: a mutation testing tool for Quantum algorithms and applications in Qiskit.
Daniel Fortunato, José Campos 0001, Rui Abreu 0001		ISSTA2022Testing / QA
Pytest-Smell: a smell detection tool for Python unit tests.
Alexandru Bodea		ISSTA2022Testing / QA
PrIntFuzz: fuzzing Linux drivers via automated virtual device simulation.
Zheyu Ma, Bodong Zhao, Letu Ren, Zheming Li, Siqi Ma		ISSTA2022Testing / QA
PermDroid: automatically testing permission-related behaviour of Android applications.
Shuaihao Yang, Zigang Zeng, Wei Song 0003		ISSTA2022Testing / QA; Security / Privacy / Vulnerability; Mobile / Web / GUI / Android
Patch correctness assessment in automated program repair based on the impact of patches on production and test code.
Ali Ghanbari 0001, Andrian Marcus		ISSTA2022Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
One step further: evaluating interpreters using metamorphic testing.
Ming Fan 0002, Jiali Wei, Wuxia Jin, Zhou Xu 0003, Wenying Wei		ISSTA2022Testing / QA
On the use of mutation analysis for evaluating student test suite quality.
James Perretta, Andrew DeOrio, Arjun Guha, Jonathan Bell 0001		ISSTA2022Testing / QA; Education / Program Comprehension
Metamorphic relations via relaxations: an approach to obtain oracles for action-policy testing.
Hasan Ferit Eniser, Timo P. Gros, Valentin Wüstholz, Jörg Hoffmann 0001, Maria Christakis		ISSTA2022Testing / QA
MDPFuzz: testing models solving Markov decision processes.
Qi Pang, Yuanyuan Yuan 0001, Shuai Wang 0011		ISSTA2022Testing / QA
LiRTest: augmenting LiDAR point clouds for automated testing of autonomous driving systems.
An Guo 0002, Yang Feng 0003, Zhenyu Chen 0001		ISSTA2022Testing / QA
Human-in-the-loop oracle learning for semantic bugs in string processing programs.
Charaka Geethal Kapugama, Van-Thuan Pham, Aldeida Aleti, Marcel Böhme		ISSTA2022Testing / QA; Human / Empirical / Socio-technical
Finding bugs in Gremlin-based graph database systems via Randomized differential testing.
Yingying Zheng, Wensheng Dou, Yicheng Wang, Zheng Qin, Lei Tang		ISSTA2022Testing / QA
Faster mutation analysis with MeMu.
Ali Ghanbari 0001, Andrian Marcus		ISSTA2022Testing / QA
FDG: a precise measurement of fault diagnosability gain of test cases.
Gabin An, Shin Yoo		ISSTA2022Testing / QA
Evolution-aware detection of order-dependent flaky tests.
Chengpeng Li 0002, August Shi		ISSTA2022Testing / QA; DevOps / CI / Build / Release; Maintenance / Evolution / Refactoring / Review
Efficient greybox fuzzing of applications in Linux-based IoT devices via enhanced user-mode emulation.
Yaowen Zheng, Yuekang Li, Cen Zhang, Hongsong Zhu, Yang Liu 0003		ISSTA2022Testing / QA
DocTer: documentation-guided fuzzing for testing deep learning API functions.
Danning Xie, Yitong Li, Mijung Kim, Hung Viet Pham, Lin Tan 0001		ISSTA2022Testing / QA; AI / LLM for SE
BET: black-box efficient testing for convolutional neural networks.
Jialai Wang, Han Qiu 0001, Yi Rong, Hengkai Ye, Qi Li 0002		ISSTA2022Testing / QA; AI / LLM for SE
Automatic generation of smoke test suites for kubernetes.
Cecilio Cannavacciuolo, Leonardo Mariani		ISSTA2022Testing / QA; Cloud / Microservices / Distributed Systems
Automated testing of image captioning systems.
Boxi Yu, Zhiqing Zhong, Xinran Qin, Jiayi Yao, Yuancheng Wang		ISSTA2022Testing / QA
Automated test generation for REST APIs: no time to rest yet.
Myeongsoo Kim, Qi Xin, Saurabh Sinha 0003, Alessandro Orso		ISSTA2022Testing / QA
Almost correct invariants: synthesizing inductive invariants by fuzzing proofs.
Sumit Lahiri, Subhajit Roy 0001		ISSTA2022Testing / QA
ATUA: an update-driven app testing tool.
Chanh Duc Ngo, Fabrizio Pastore, Lionel C. Briand		ISSTA2022Testing / QA; Mobile / Web / GUI / Android
ASRTest: automated testing for deep-neural-network-driven speech recognition systems.
Pin Ji, Yang Feng 0003, Jia Liu 0008, Zhihong Zhao, Zhenyu Chen 0001		ISSTA2022Testing / QA; AI / LLM for SE
AEON: a method for automatic evaluation of NLP test cases.
Jen-tse Huang 0001, Jianping Zhang 0002, Wenxuan Wang 0001, Pinjia He, Yuxin Su 0001		ISSTA2022Testing / QA
Windranger: A Directed Greybox Fuzzer driven by Deviation Basic Blocks.
Zhengjie Du, Yuekang Li, Yang Liu 0003, Bing Mao 0001		ICSE2022Testing / QA
Using Reinforcement Learning for Load Testing of Video Games.
Rosalia Tufano, Simone Scalabrino, Luca Pascarella, Emad Aghajani, Rocco Oliveto		ICSE2022Testing / QA
Use of Test Doubles in Android Testing: An In-Depth Investigation.
Mattia Fazzini, Chase Choi, Juan Manuel Copia, Gabriel Lee, Yoshiki Kakehi		ICSE2022Testing / QA; Mobile / Web / GUI / Android
Testing Time Limits in Screener Questions for Online Surveys with Programmers.
Anastasia Danilova, Stefan Horstmann, Matthew Smith 0001, Alena Naiakshina		ICSE2022Testing / QA
TOGA: A Neural Method for Test Oracle Generation.
Elizabeth Dinella, Gabriel Ryan, Todd Mytkowicz, Shuvendu K. Lahiri		ICSE2022Testing / QA; AI / LLM for SE
Semantic Image Fuzzing of AI Perception Systems.
Trey Woodlief, Sebastian G. Elbaum, Kevin Sullivan		ICSE2022Testing / QA; AI / LLM for SE; Human / Empirical / Socio-technical
Repairing Order-Dependent Flaky Tests via Test Generation.
Chengpeng Li 0002, Chenguang Zhu 0002, Wenxi Wang, August Shi		ICSE2022Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
R2Z2: Detecting Rendering Regressions in Web Browsers through Differential Fuzz Testing.
Suhwan Song, Jaewon Hur, Sunwoo Kim, Philip Rogers, Byoungyoung Lee		ICSE2022Testing / QA; Mobile / Web / GUI / Android
Prioritizing Mutants to Guide Mutation Testing.
Samuel J. Kaufman, Ryan Featherman, Justin Alvin, Bob Kurtz, Paul Ammann		ICSE2022Testing / QA
Preempting Flaky Tests via Non-Idempotent-Outcome Tests.
Anjiang Wei, Pu Yi 0001, Zhengxi Li, Tao Xie 0001, Darko Marinov		ICSE2022Testing / QA; DevOps / CI / Build / Release
Path Transitions Tell More: Optimizing Fuzzing Schedules via Runtime Program States.
Kunpeng Zhang, Xi Xiao, Xiaogang Zhu 0001, Ruoxi Sun 0001, Minhui Xue 0001		ICSE2022Testing / QA
One Fuzzing Strategy to Rule Them All.
Mingyuan Wu, Ling Jiang, Jiahong Xiang, Yanwei Huang, Heming Cui		ICSE2022Testing / QA
On the Reliability of Coverage-Based Fuzzer Benchmarking.
Marcel Böhme, László Szekeres, Jonathan Metzman		ICSE2022Testing / QA; Performance / Energy / Reliability
NeuronFair: Interpretable White-Box Fairness Testing through Biased Neuron Identification.
Haibin Zheng, Zhiqing Chen, Tianyu Du, Xuhong Zhang 0002, Yao Cheng 0002		ICSE2022Testing / QA
Nessie: Automatically Testing JavaScript APIs with Asynchronous Callbacks.
Ellen Arteca, Sebastian Harner, Michael Pradel, Frank Tip		ICSE2022Testing / QA
NPEX: Repairing Java Null Pointer Exceptions without Tests.
Junhee Lee, Seongjoon Hong, Hakjoo Oh		ICSE2022Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Program Analysis / Verification / Formal Methods
Muffin: Testing Deep Learning Libraries via Neural Architecture Fuzzing.
Jiazhen Gu, Xuchuan Luo, Yangfan Zhou 0002, Xin Wang 0002		ICSE2022Testing / QA; AI / LLM for SE; Requirements / Modeling / Architecture
Morest: Model-based RESTful API Testing with Execution Feedback.
Yi Liu 0069, Yuekang Li, Gelei Deng, Yang Liu 0003, Ruiyuan Wan		ICSE2022Testing / QA
Linear-time Temporal Logic guided Greybox Fuzzing.
Ruijie Meng, Zhen Dong, Jialin Li 0001, Ivan Beschastnikh, Abhik Roychoudhury		ICSE2022Testing / QA
Inference and Test Generation Using Program Invariants in Chemical Reaction Networks.
Michael C. Gerten, Alexis L. Marsh, James I. Lathrop, Myra B. Cohen, Andrew S. Miner		ICSE2022Testing / QA
History-Driven Test Program Synthesis for JVM Testing.
Yingquan Zhao, Zan Wang, Junjie Chen 0003, Mengdi Liu, Mingyuan Wu		ICSE2022Testing / QA
GraphFuzz: Library API Fuzzing with Lifetime-aware Dataflow Graphs.
Harrison Green, Thanassis Avgerinos		ICSE2022Testing / QA; Program Analysis / Verification / Formal Methods
Fuzzing Class Specifications.
Facundo Molina, Marcelo d'Amorim, Nazareno Aguirre		ICSE2022Testing / QA
Free Lunch for Testing: Fuzzing Deep-Learning Libraries from Open Source.
Anjiang Wei, Yinlin Deng, Chenyuan Yang, Lingming Zhang 0001		ICSE2022Testing / QA; Human / Empirical / Socio-technical
FlakiMe: Laboratory-Controlled Test Flakiness Impact Assessment.
Maxime Cordy, Renaud Rwemalika, Adriano Franci, Mike Papadakis, Mark Harman		ICSE2022Testing / QA
FADATest: Fast and Adaptive Performance Regression Testing of Dynamic Binary Translation Systems.
Jin Wu, Jian Dong 0010, Ruili Fang, Wen Zhang, Wenwen Wang 0001		ICSE2022Testing / QA; DevOps / CI / Build / Release; Performance / Energy / Reliability
Explanation-Guided Fairness Testing through Genetic Algorithm.
Ming Fan 0002, Wenying Wei, Wuxia Jin, Zijiang Yang 0006, Ting Liu 0002		ICSE2022Testing / QA
Evaluating and Improving Neural Program-Smoothing-based Fuzzing.
Mingyuan Wu, Ling Jiang, Jiahong Xiang, Yuqun Zhang, Guowei Yang 0001		ICSE2022Testing / QA; AI / LLM for SE
Efficient Online Testing for DNN-Enabled Systems using Surrogate-Assisted and Many-Objective Optimization.
Fitash Ul Haq, Donghwan Shin 0001, Lionel C. Briand		ICSE2022Testing / QA; Performance / Energy / Reliability
EREBA: Black-box Energy Testing of Adaptive Neural Networks.
Mirazul Haque, Yaswanth Yadlapalli, Wei Yang 0013, Cong Liu 0005		ICSE2022Testing / QA; AI / LLM for SE; Performance / Energy / Reliability
EAGLE: Creating Equivalent Graphs to Test Deep Learning Libraries.
Jiannan Wang 0002, Thibaud Lutellier, Shangshu Qian, Hung Viet Pham, Lin Tan 0001		ICSE2022Testing / QA; AI / LLM for SE
Demystifying the Dependency Challenge in Kernel Fuzzing.
Yu Hao 0006, Hang Zhang 0012, Guoren Li, Xingyun Du, Zhiyun Qian		ICSE2022Testing / QA
DeepState: Selecting Test Suites to Enhance the Robustness of Recurrent Neural Networks.
Zixi Liu, Yang Feng 0003, Yining Yin, Zhenyu Chen 0001		ICSE2022Testing / QA; AI / LLM for SE
Controlled Concurrency Testing via Periodical Scheduling.
Cheng Wen 0002, Mengda He, Bohao Wu, Zhiwu Xu 0001, Shengchao Qin		ICSE2022Testing / QA
Combinatorial Testing of RESTful APIs.
Huayao Wu, Lixin Xu, Xintao Niu, Changhai Nie		ICSE2022Testing / QA
CONFETTI: Amplifying Concolic Guidance for Fuzzers.
James Kukucka, Luís Pina, Paul Ammann, Jonathan Bell 0001		ICSE2022Testing / QA; Program Analysis / Verification / Formal Methods
Buildsheriff: Change-Aware Test Failure Triage for Continuous Integration Builds.
Chen Zhang, Bihuan Chen 0001, Xin Peng 0001, Wenyun Zhao		ICSE2022Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release; Maintenance / Evolution / Refactoring / Review
BEDIVFUZZ: Integrating Behavioral Diversity into Generator-based Fuzzing.
Hoang Lam Nguyen, Lars Grunske		ICSE2022Testing / QA
Automated Testing of Software that Uses Machine Learning APIs.
Chengcheng Wan 0001, Shicheng Liu, Sophie Xie, Yifan Liu, Henry Hoffmann		ICSE2022Testing / QA; AI / LLM for SE
Automated Assertion Generation via Information Retrieval and Its Integration with Deep learning.
Hao Yu 0016, Yiling Lou, Ke Sun 0017, Dezhi Ran, Tao Xie 0001		ICSE2022Testing / QA; AI / LLM for SE
Adaptive Test Selection for Deep Neural Networks.
Xinyu Gao, Yang Feng 0003, Yining Yin, Zixi Liu, Zhenyu Chen 0001		ICSE2022Testing / QA; AI / LLM for SE; DevOps / CI / Build / Release
A Scalable t-wise Coverage Estimator.
Eduard Baranov, Sourav Chakraborty 0001, Axel Legay, Kuldeep S. Meel, N. Variyam Vinodchandran		ICSE2022Testing / QA
$\mu AFL$: Non-intrusive Feedback-driven Fuzzing for Microcontroller Firmware.
Wenqiang Li, Jiameng Shi, Fengjun Li, Jingqiang Lin 0001, Wei Wang 0314		ICSE2022Testing / QA
Testing of machine learning models with limited samples: an industrial vacuum pumping application.
Ayan Chatterjee, Bestoun S. Ahmed, Erik Hallin, Anton Engman		FSE2022Testing / QA; AI / LLM for SE
Testing of autonomous driving systems: where are we and where should we go?
Guannan Lou, Yao Deng, Xi Zheng 0001, Mengshi Zhang, Tianyi Zhang 0001		FSE2022Testing / QA
SemCluster: a semi-supervised clustering tool for crowdsourced test reports with deep image understanding.
Mingzhe Du, Shengcheng Yu, Chunrong Fang, Tongyu Li, Heyuan Zhang		FSE2022Testing / QA
Scenario-based test reduction and prioritization for multi-module autonomous driving systems.
Yao Deng, Xi Zheng 0001, Mengshi Zhang, Guannan Lou, Tianyi Zhang 0001		FSE2022Testing / QA
SamplingCA: effective and efficient sampling-based pairwise testing for highly configurable software systems.
Chuan Luo 0002, Qiyuan Zhao, Shaowei Cai 0001, Hongyu Zhang 0002, Chunming Hu		FSE2022Testing / QA
SEDiff: scope-aware differential fuzzing to test internal function models in symbolic execution.
Penghui Li 0001, Wei Meng 0001, Kangjie Lu		FSE2022Testing / QA; Program Analysis / Verification / Formal Methods
RoboFuzz: fuzzing robotic systems over robot operating system (ROS) for finding correctness bugs.
Seulbae Kim, Taesoo Kim		FSE2022Testing / QA
RegMiner: mining replicable regression dataset from code repositories.
Xuezhi Song, Yun Lin 0001, Yijian Wu, Yifan Zhang 0019, Siang Hwee Ng		FSE2022Testing / QA
Putting them under microscope: a fine-grained approach for detecting redundant test cases in natural language.
Zhiyuan Chang, Mingyang Li 0005, Junjie Wang 0001, Qing Wang 0001, Shoubin Li		FSE2022Testing / QA
Perfect is the enemy of test oracle.
Ali Reza Ibrahimzada, Yigit Varli, Dilara Tekinoglu, Reyhaneh Jabbarvand		FSE2022Testing / QA
Online testing of RESTful APIs: promises and challenges.
Alberto Martin-Lopez, Sergio Segura, Antonio Ruiz-Cortés		FSE2022Testing / QA
NMTSloth: understanding and testing efficiency degradation of neural machine translation systems.
Simin Chen, Cong Liu 0005, Mirazul Haque, Zihe Song, Wei Yang 0013		FSE2022Testing / QA; AI / LLM for SE; Performance / Energy / Reliability
Minerva: browser API fuzzing with dynamic mod-ref analysis.
Chijin Zhou, Quan Zhang 0003, Mingzhe Wang, Lihua Guo, Jie Liang 0006		FSE2022Testing / QA; Mobile / Web / GUI / Android
Machine learning and natural language processing for automating software testing (tutorial).
Mauro Pezzè		FSE2022Testing / QA; AI / LLM for SE
Leveraging test plan quality to improve code review efficacy.
Lawrence Chen 0002, Rui Abreu 0001, Tobi Akomolede, Peter C. Rigby, Satish Chandra 0001		FSE2022Testing / QA; Maintenance / Evolution / Refactoring / Review
JSIMutate: understanding performance results through mutations.
Thomas Laurent 0003, Paolo Arcaini, Catia Trubiani, Anthony Ventresque		FSE2022Testing / QA; Performance / Energy / Reliability
Input splitting for cloud-based static application security testing platforms.
Maria Christakis, Thomas Cottenier, Antonio Filieri, Linghui Luo, Muhammad Numair Mansur		FSE2022Testing / QA; Security / Privacy / Vulnerability; Cloud / Microservices / Distributed Systems
Improving ML-based information retrieval software with user-driven functional testing and defect class analysis.
Junjie Zhu, Teng Long 0003, Wei Wang, Atif M. Memon		FSE2022Testing / QA
Group-based corpus scheduling for parallel fuzzing.
Taotao Gu, Xiang Li 0078, Shuaibing Lu, Jianwen Tian, Yuanping Nie		FSE2022Testing / QA
Fuzzing deep-learning libraries via automated relational API inference.
Yinlin Deng, Chenyuan Yang, Anjiang Wei, Lingming Zhang 0001		FSE2022Testing / QA
FlakeRepro: automated and efficient reproduction of concurrency-related flaky tests.
Tanakorn Leesatapornwongsa, Xiang Ren 0003, Suman Nath		FSE2022Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release
FIM: fault injection and mutation for Simulink.
Ezio Bartocci, Leonardo Mariani, Dejan Nickovic, Drishti Yadav		FSE2022Testing / QA
Detecting Simulink compiler bugs via controllable zombie blocks mutation.
Shikai Guo, He Jiang 0001, Zhihao Xu, Xiaochen Li, Zhilei Ren		FSE2022Testing / QA
Change-aware mutation testing for evolving systems.
Milos Ojdanic		FSE2022Testing / QA; Maintenance / Evolution / Refactoring / Review
CLIFuzzer: mining grammars for command-line invocations.
Abhilash Gupta, Rahul Gopinath, Andreas Zeller		FSE2022Testing / QA
Avgust: automating usage-based test generation from videos of app executions.
Yixue Zhao, Saghar Talebipour, Kesina Baral, Hyojae Park, Leon Yee		FSE2022Testing / QA; Mobile / Web / GUI / Android
Automated generation of test oracles for RESTful APIs.
Juan C. Alonso		FSE2022Testing / QA
VITAS : Guided Model-based VUI Testing of VPA Apps.
Suwan Li, Lei Bu, Guangdong Bai, Zhixiu Guo, Kai Chen 0012		ASE2022Testing / QA; Mobile / Web / GUI / Android
Unveiling Hidden DNN Defects with Decision-Based Metamorphic Testing.
Yuanyuan Yuan 0001, Qi Pang, Shuai Wang 0011		ASE2022Testing / QA
Towards Agent-Based Testing of 3D Games using Reinforcement Learning.
Raihana Ferdous, Fitsum Meshesha Kifetew, Davide Prandi, Angelo Susi		ASE2022Testing / QA
Test-Driven Multi-Task Learning with Functionally Equivalent Code Transformation for Neural Code Generation.
Xin Wang 0114, Xiao Liu 0004, Pingyi Zhou, Qixia Liu, Jin Liu 0016		ASE2022Testing / QA; AI / LLM for SE
SymFusion: Hybrid Instrumentation for Concolic Execution.
Emilio Coppa, Heng Yin 0001, Camil Demetrescu		ASE2022Testing / QA; Program Analysis / Verification / Formal Methods
Sorry, I don't Understand: Improving Voice User Interface Testing.
Emanuela Guglielmi, Giovanni Rosa, Simone Scalabrino, Gabriele Bavota, Rocco Oliveto		ASE2022Testing / QA
So Many Fuzzers, So Little Time✱: Experience from Evaluating Fuzzers on the Contiki-NG Network (Hay)Stack.
Clement Poncelet, Konstantinos Sagonas, Nicolas Tsiftes		ASE2022Testing / QA
SelfAPR: Self-supervised Program Repair with Test Execution Diagnostics.
He Ye, Matias Martinez, Xiapu Luo, Tao Zhang 0001, Martin Monperrus		ASE2022Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Selectively Combining Multiple Coverage Goals in Search-Based Unit Test Generation.
Zhichao Zhou, Yuming Zhou, Chunrong Fang, Zhenyu Chen 0001, Yutian Tang		ASE2022Testing / QA
Research on Test Flakiness: from Unit to System Testing.
Kiet Ngo, Vu Nguyen 0003, Tien N. Nguyen		ASE2022Testing / QA
QATest: A Uniform Fuzzing Framework for Question Answering Systems.
Zixi Liu, Yang Feng 0003, Yining Yin, Jingyu Sun, Zhenyu Chen 0001		ASE2022Testing / QA
Provably Tightest Linear Approximation for Robustness Verification of Sigmoid-like Neural Networks.
Zhaodi Zhang, Yiting Wu, Si Liu 0003, Jing Liu 0012, Min Zhang 0002		ASE2022Testing / QA; AI / LLM for SE; Program Analysis / Verification / Formal Methods
PredART: Towards Automatic Oracle Prediction of Object Placements in Augmented Reality Testing.
Tahmid Rafi, Xueling Zhang, Xiaoyin Wang		ASE2022Testing / QA
Neuroevolution-Based Generation of Tests and Oracles for Games.
Patric Feldmeier, Gordon Fraser 0001		ASE2022Testing / QA
Natural Test Generation for Precise Testing of Question Answering Software.
Qingchao Shen, Junjie Chen 0003, Jie M. Zhang, Haoyu Wang 0017, Shuang Liu 0007		ASE2022Testing / QA
Morest: Industry Practice of Automatic RESTful API Testing.
Yi Liu 0069, Yuekang Li, Yang Liu 0003, Ruiyuan Wan, Runchao Wu		ASE2022Testing / QA
Mining Android API Usage to Generate Unit Test Cases for Pinpointing Compatibility Issues.
Xiaoyu Sun 0002, Xiao Chen 0002, Yanjie Zhao 0001, Pei Liu, John Grundy 0001		ASE2022Testing / QA; Maintenance / Evolution / Refactoring / Review; Mobile / Web / GUI / Android
Maktub: Lightweight Robot System Test Creation and Automation.
Amr Moussa, John-Paul Ore		ASE2022Testing / QA
Learning to Construct Better Mutation Faults.
Zhao Tian, Junjie Chen 0003, Qihao Zhu, Junjie Yang 0004, Lingming Zhang 0001		ASE2022Testing / QA
LawBreaker: An Approach for Specifying Traffic Laws and Fuzzing Autonomous Vehicles.
Yang Sun 0008, Christopher M. Poskitt, Jun Sun 0001, Yuqi Chen 0001, Zijiang Yang 0006		ASE2022Testing / QA
Inline Tests.
Yu Liu 0079, Pengyu Nie 0001, Owolabi Legunsen, Milos Gligoric 0001		ASE2022Testing / QA
How Useful is Code Change Information for Fault Localization in Continuous Integration?
An Ran Chen, Tse-Hsun (Peter) Chen, Junjie Chen 0003		ASE2022Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release; Maintenance / Evolution / Refactoring / Review
Horntinuum: Autonomous Testing using Constrained Horn Clauses.
Ilia Zlatkin, Grigory Fedyukovich		ASE2022Testing / QA
HTFuzz: Heap Operation Sequence Sensitive Fuzzing.
Yuanping Yu, Xiangkun Jia, Yuwei Liu 0001, Yanhao Wang, Qian Sang		ASE2022Testing / QA
Griffin : Grammar-Free DBMS Fuzzing.
Jingzhou Fu, Jie Liang 0006, Zhiyong Wu 0010, Mingzhe Wang, Yu Jiang 0001		ASE2022Testing / QA
Generating Critical Test Scenarios for Autonomous Driving Systems via Influential Behavior Patterns.
Haoxiang Tian 0001, Guoquan Wu, Jiren Yan, Yan Jiang, Jun Wei 0001		ASE2022Testing / QA
Fuzzle: Making a Puzzle for Fuzzers.
Haeun Lee, Soomin Kim 0002, Sang Kil Cha		ASE2022Testing / QA
FuzzerAid: Grouping Fuzzed Crashes Based On Fault Signatures.
Ashwin Kallingal Joshy, Wei Le		ASE2022Testing / QA
Fastbot2: Reusable Automated Model-based GUI Testing for Android Enhanced by Reinforcement Learning.
Zhengwei Lv, Chao Peng 0002, Zhao Zhang, Ting Su 0001, Kai Liu		ASE2022Testing / QA; Mobile / Web / GUI / Android
Execution Path Detection through Dynamic Analysis in Black-Box Testing Environments.
Frank Dixon Whitworth		ASE2022Testing / QA; Program Analysis / Verification / Formal Methods
Enriching Compiler Testing with Real Program from Bug Report.
Hao Zhong 0001		ASE2022Testing / QA
Efficient Synthesis of Method Call Sequences for Test Generation and Bounded Verification.
Yunfan Zhang, Ruidong Zhu, Yingfei Xiong 0001, Tao Xie 0001		ASE2022Testing / QA; Program Analysis / Verification / Formal Methods
Efficient Greybox Fuzzing to Detect Memory Errors.
Jinsheng Ba, Gregory J. Duck, Abhik Roychoudhury		ASE2022Testing / QA
Effectively Generating Vulnerable Transaction Sequences in Smart Contracts with Reinforcement Learning-guided Fuzzing.
Jianzhong Su, Hong-Ning Dai, Lingjun Zhao, Zibin Zheng, Xiapu Luo		ASE2022Testing / QA
DyTRec: A Dynamic Testing Recommendation tool for Unity-based Virtual Reality Software.
Xue Qin, Foyzul Hassan		ASE2022Testing / QA
Differentially Testing Database Transactions for Fun and Profit.
Ziyu Cui, Wensheng Dou, Qianwang Dai, Jiansen Song, Wei Wang 0049		ASE2022Testing / QA
DeepPerform: An Efficient Approach for Performance Testing of Resource-Constrained Neural Networks.
Simin Chen, Mirazul Haque, Cong Liu 0005, Wei Yang 0013		ASE2022Testing / QA; AI / LLM for SE; Performance / Energy / Reliability
Coverage-based Greybox Fuzzing with Pointer Monitoring for C Programs.
Haibo Chen 0005, Jinfu Chen 0001		ASE2022Testing / QA; Program Analysis / Verification / Formal Methods
Constructing a System Knowledge Graph of User Tasks and Failures from Bug Reports to Support Soap Opera Testing.
Yanqi Su, Zheming Han, Zhenchang Xing, Xin Xia 0001, Xiwei Xu 0001		ASE2022Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Compiler Testing using Template Java Programs.
Zhiqiang Zang, Nathan Wiatrek, Milos Gligoric 0001, August Shi		ASE2022Testing / QA
Call Me Maybe: Using NLP to Automatically Generate Unit Test Cases Respecting Temporal Constraints.
Arianna Blasi, Alessandra Gorla, Michael D. Ernst, Mauro Pezzè		ASE2022Testing / QA
Boosting the Revealing of Detected Violations in Deep Learning Testing: A Diversity-Guided Method.
Xiaoyuan Xie, Pengbo Yin, Songqiang Chen		ASE2022Testing / QA; AI / LLM for SE
Automatically Tagging the "AAA" Pattern in Unit Test Cases Using Machine Learning Models.
Chenhao Wei, Lu Xiao 0001, Tingting Yu 0001, Xinyu Chen, Xiao Wang 0030		ASE2022Testing / QA; AI / LLM for SE
Auto Off-Target: Enabling Thorough and Scalable Testing for Complex Software Systems.
Tomasz Kuchta, Bartosz Zator		ASE2022Testing / QA
Application of Natural Language Processing Towards Autonomous Software Testing.
Khang Pham, Vu Nguyen 0003, Tien N. Nguyen		ASE2022Testing / QA
Accelerating OCR-Based Widget Localization for Test Automation of GUI Applications.
Ju Qian, Yingwei Ma, Chenghao Lin, Lin Chen 0015		ASE2022Testing / QA; Mobile / Web / GUI / Android
ADEPT: A Testing Platform for Simulated Autonomous Driving.
Sen Wang, Zhuheng Sheng, Jingwei Xu 0001, Taolue Chen 0001, Junjun Zhu		ASE2022Testing / QA
A Scenario Distribution Model for Effective and Efficient Testing of Autonomous Driving Systems.
Qunying Song, Per Runeson, Stefan Persson		ASE2022Testing / QA
A Review of AI-augmented End-to-End Test Automation Tools.
Phuoc Pham, Vu Nguyen 0003, Tien N. Nguyen		ASE2022Testing / QA; AI / LLM for SE
A Novel Coverage-guided Greybox Fuzzing based on Power Schedule Optimization with Time Complexity.
Jinfu Chen 0001, Shengran Wang, Saihua Cai, Chi Zhang 0046, Haibo Chen 0005		ASE2022Testing / QA; Performance / Energy / Reliability
A Framework for Testing Chemical Reaction Networks.
Michael C. Gerten		ASE2022Testing / QA
echidna-parade: a tool for diverse multicore smart contract fuzzing.
Alex Groce, Gustavo Grieco		ISSTA2021Testing / QA; Security / Privacy / Vulnerability
Validating static warnings via testing code fragments.
Ashwin Kallingal Joshy, Xueyuan Chen, Benjamin Steenhoek, Wei Le		ISSTA2021Testing / QA
Toward optimal mc/dc test case generation.
Sangharatna Godboley, Joxan Jaffar, Rasool Maghareh, Arpita Dutta		ISSTA2021Testing / QA
Test-case prioritization for configuration testing.
Runxiang Cheng, Lingming Zhang 0001, Darko Marinov, Tianyin Xu		ISSTA2021Testing / QA; DevOps / CI / Build / Release
TauMed: test augmentation of deep learning in medical diagnosis.
Yunhan Hou, Jiawei Liu, Daiwei Wang, Jiawei He, Chunrong Fang		ISSTA2021Testing / QA; AI / LLM for SE
TERA: optimizing stochastic regression tests in machine learning projects.
Saikat Dutta 0001, Jeeva Selvam, Aryaman Jain, Sasa Misailovic		ISSTA2021Testing / QA; AI / LLM for SE; DevOps / CI / Build / Release
Semantic matching of GUI events for test reuse: are we there yet?
Leonardo Mariani, Ali Mohebbi 0003, Mauro Pezzè, Valerio Terragni		ISSTA2021Testing / QA; Mobile / Web / GUI / Android
Seed selection for successful fuzzing.
Adrian Herrera, Hendra Gunadi, Shane Magrath, Michael Norrish, Mathias Payer		ISSTA2021Testing / QA
RESTest: automated black-box testing of RESTful web APIs.
Alberto Martin-Lopez, Sergio Segura, Antonio Ruiz-Cortés		ISSTA2021Testing / QA; Mobile / Web / GUI / Android
QFuzz: quantitative fuzzing for side channels.
Yannic Noller, Saeid Tizpaz-Niari		ISSTA2021Testing / QA
ProFuzzBench: a benchmark for stateful protocol fuzzing.
Roberto Natella, Van-Thuan Pham		ISSTA2021Testing / QA
Predoo: precision testing of deep learning operators.
Xufan Zhang, Ning Sun, Chunrong Fang, Jiawei Liu, Jia Liu 0015		ISSTA2021Testing / QA; AI / LLM for SE
ModelDiff: testing-based DNN similarity comparison for model reuse detection.
Yuanchun Li, Ziqi Zhang, Bingyan Liu, Ziyue Yang, Yunxin Liu		ISSTA2021Testing / QA
Model-based testing of networked applications.
Yishuai Li, Benjamin C. Pierce, Steve Zdancewic		ISSTA2021Testing / QA
Log-based slicing for system-level test cases.
Salma Messaoudi, Donghwan Shin 0001, Annibale Panichella, Domenico Bianculli, Lionel C. Briand		ISSTA2021Testing / QA; Program Analysis / Verification / Formal Methods; Cloud / Microservices / Distributed Systems
Interval constraint-based mutation testing of numerical specifications.
Clothilde Jeangoudoux, Eva Darulova, Christoph Quirin Lauter		ISSTA2021Testing / QA
Gramatron: effective grammar-aware fuzzing.
Prashast Srivastava, Mathias Payer		ISSTA2021Testing / QA
GUIDER: GUI structure and vision co-guided test script repair for Android apps.
Tongtong Xu, Minxue Pan, Yu Pei 0001, Guiyin Li, Xia Zeng		ISSTA2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Mobile / Web / GUI / Android
Fuzzing SMT solvers via two-dimensional input space exploration.
Peisen Yao, Heqing Huang 0002, Wensheng Tang, Qingkai Shi, Rongxin Wu		ISSTA2021Testing / QA
Empirically evaluating readily available information for regression test optimization in continuous integration.
Daniel Elsner, Florian Hauer 0002, Alexander Pretschner, Silke Reimer		ISSTA2021Testing / QA; DevOps / CI / Build / Release; Performance / Energy / Reliability
Empirical evaluation of smart contract testing: what is the best choice?
Meng Ren, Zijing Yin, Fuchen Ma, Zhenyang Xu, Yu Jiang 0001		ISSTA2021Testing / QA; Security / Privacy / Vulnerability; Human / Empirical / Socio-technical
Efficient white-box fairness testing through gradient search.
Lingfeng Zhang, Yueling Zhang, Min Zhang 0007		ISSTA2021Testing / QA
DialTest: automated testing for recurrent-neural-network-driven dialogue systems.
Zixi Liu, Yang Feng 0003, Zhenyu Chen 0001		ISSTA2021Testing / QA; AI / LLM for SE
DeepCrime: mutation testing of deep learning systems based on real faults.
Nargiz Humbatova, Gunel Jahangirova, Paolo Tonella		ISSTA2021Testing / QA; AI / LLM for SE
Continuous test suite failure prediction.
Cong Pan 0002, Michael Pradel		ISSTA2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Challenges and opportunities: an in-depth empirical study on configuration error injection testing.
Wang Li 0003, Zhouyang Jia, Shanshan Li 0001, Yuanliang Zhang, Teng Wang 0004		ISSTA2021Testing / QA; Human / Empirical / Socio-technical; DevOps / CI / Build / Release
Automatic test suite generation for key-points detection DNNs using many-objective search (experience paper).
Fitash Ul Haq, Donghwan Shin 0001, Lionel C. Briand, Thomas Stifter, Jun Wang 0020		ISSTA2021Testing / QA
An infrastructure approach to improving effectiveness of Android UI testing tools.
Wenyu Wang, Wing Lam, Tao Xie 0001		ISSTA2021Testing / QA; Mobile / Web / GUI / Android
Why Don't Developers Detect Improper Input Validation? '; DROP TABLE Papers; -.
Larissa Braz, Enrico Fregnan, Gül Çalikli, Alberto Bacchelli		ICSE2021Testing / QA; Human / Empirical / Socio-technical
What helped, and what did not? An Evaluation of the Strategies to Improve Continuous Integration.
Xianhao Jin, Francisco Servant		ICSE2021Testing / QA; DevOps / CI / Build / Release
Testing Machine Translation via Referential Transparency.
Pinjia He, Clara Meister, Zhendong Su 0001		ICSE2021Testing / QA
Studying Test Annotation Maintenance in the Wild.
Dong Jae Kim, Nikolaos Tsantalis, Tse-Hsun Peter Chen, Jinqiu Yang 0001		ICSE2021Testing / QA; Maintenance / Evolution / Refactoring / Review
Semantic Web Accessibility Testing via Hierarchical Visual Analysis.
Mohammad Bajammal, Ali Mesbah 0001		ICSE2021Testing / QA; Mobile / Web / GUI / Android
RobOT: Robustness-Oriented Testing for Deep Learning Systems.
Jingyi Wang 0004, Jialuo Chen, Youcheng Sun, Xingjun Ma, Dongxia Wang 0002		ICSE2021Testing / QA; AI / LLM for SE
Prioritizing Test Inputs for Deep Neural Networks via Mutation Analysis.
Zan Wang, Hanmo You, Junjie Chen 0003, Yingyi Zhang, Xuyuan Dong		ICSE2021Testing / QA; AI / LLM for SE
Prioritize Crowdsourced Test Reports via Deep Screenshot Understanding.
Shengcheng Yu, Chunrong Fang, Zhenfei Cao, Xu Wang, Tongyu Li		ICSE2021Testing / QA
MuDelta: Delta-Oriented Mutation Testing at Commit Time.
Wei Ma 0014, Thierry Titcheu Chekam, Mike Papadakis, Mark Harman		ICSE2021Testing / QA; DevOps / CI / Build / Release
Measuring Discrimination to Boost Comparative Testing for Multiple Deep Learning Models.
Linghan Meng, Yanhui Li, Lin Chen 0015, Zhi Wang, Di Wu 0014		ICSE2021Testing / QA; AI / LLM for SE
Layout and Image Recognition Driving Cross-Platform Automated Mobile Testing.
Shengcheng Yu, Chunrong Fang, Yexiao Yun, Yang Feng 0003		ICSE2021Testing / QA; Mobile / Web / GUI / Android
JUSTGen: Effective Test Generation for Unspecified JNI Behaviors on JVMs.
Sungjae Hwang, Sungho Lee, Jihoon Kim, Sukyoung Ryu		ICSE2021Testing / QA
JEST: N+1 -version Differential Testing of Both JavaScript Engines and Specification.
Jihyeok Park, Seungmin An, Dongjun Youn, Gyeongwon Kim, Sukyoung Ryu		ICSE2021Testing / QA; Program Analysis / Verification / Formal Methods
Growing A Test Corpus with Bonsai Fuzzing.
Vasudev Vikram, Rohan Padhye, Koushik Sen		ICSE2021Testing / QA
Graph-based Fuzz Testing for Deep Learning Inference Engines.
Weisi Luo, Dong Chai, Xiaoyue Run, Jiang Wang, Chunrong Fang		ICSE2021Testing / QA; AI / LLM for SE
Fuzzing Symbolic Expressions.
Luca Borzacchiello, Emilio Coppa, Camil Demetrescu		ICSE2021Testing / QA; Program Analysis / Verification / Formal Methods
FlakeFlagger: Predicting Flakiness Without Rerunning Tests.
Abdulrahman Alshammari, Christopher Morris 0003, Michael Hilton, Jonathan Bell 0001		ICSE2021Testing / QA
Fault Localization with Code Coverage Representation Learning.
Yi Li 0048, Shaohua Wang 0002, Tien N. Nguyen		ICSE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Fast and Precise On-the-fly Patch Validation for All.
Lingchao Chen, Yicheng Ouyang, Lingming Zhang 0001		ICSE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Evaluating Unit Testing Practices in R Packages.
Melina C. Vidoni		ICSE2021Testing / QA
Evaluating SZZ Implementations Through a Developer-informed Oracle.
Giovanni Rosa, Luca Pascarella, Simone Scalabrino, Rosalia Tufano, Gabriele Bavota		ICSE2021Testing / QA; Human / Empirical / Socio-technical
Enhancing Genetic Improvement of Software with Regression Test Selection.
Giovani Guizzo, Justyna Petke, Federica Sarro, Mark Harman		ICSE2021Testing / QA; DevOps / CI / Build / Release
Domain-Specific Fixes for Flaky Tests with Wrong Assumptions on Underdetermined Specifications.
Peilun Zhang, Yanjie Jiang, Anjiang Wei, Victoria Stodden, Darko Marinov		ICSE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release
Does mutation testing improve testing practices?
Goran Petrovic, Marko Ivankovic, Gordon Fraser 0001, René Just		ICSE2021Testing / QA
Distribution-Aware Testing of Neural Networks Using Generative Models.
Swaroopa Dola, Matthew B. Dwyer, Mary Lou Soffa		ICSE2021Testing / QA; AI / LLM for SE
Data-Oriented Differential Testing of Object-Relational Mapping Systems.
Thodoris Sotiropoulos, Stefanos Chaliasos, Vaggelis Atlidakis, Dimitris Mitropoulos, Diomidis Spinellis		ICSE2021Testing / QA
Automatic Web Testing Using Curiosity-Driven Reinforcement Learning.
Yan Zheng 0002, Yi Liu 0069, Xiaofei Xie, Yepang Liu 0001, Lei Ma 0003		ICSE2021Testing / QA; Mobile / Web / GUI / Android
Automatic Unit Test Generation for Machine Learning Libraries: How Far Are We?
Song Wang 0009, Nishtha Shrestha, Abarna Kucheri Subburaman, Junjie Wang 0001, Moshi Wei		ICSE2021Testing / QA; AI / LLM for SE
App's Auto-Login Function Security Testing via Android OS-Level Virtualization.
Wenna Song, Jiang Ming 0002, Lin Jiang, Han Yan, Yi Xiang		ICSE2021Testing / QA; Security / Privacy / Vulnerability; Mobile / Web / GUI / Android
An Empirical Analysis of UI-based Flaky Tests.
Alan Romano, Zihe Song, Sampath Grandhi, Wei Yang 0013, Weihang Wang 0001		ICSE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; Human / Empirical / Socio-technical; DevOps / CI / Build / Release; Mobile / Web / GUI / Android
A Differential Testing Approach for Evaluating Abstract Syntax Tree Mapping Algorithms.
Yuanrui Fan, Xin Xia 0001, David Lo 0001, Ahmed E. Hassan, Yuan Wang 0008		ICSE2021Testing / QA
Validation on machine reading comprehension software without annotated labels: a property-based method.
Songqiang Chen, Shuo Jin, Xiaoyuan Xie		FSE2021Testing / QA; Education / Program Comprehension
Skeletal approximation enumeration for SMT solver testing.
Peisen Yao, Heqing Huang 0002, Wensheng Tang, Qingkai Shi, Rongxin Wu		FSE2021Testing / QA
Selecting test inputs for DNNs using differential testing with subspecialized model instances.
Yu-Seung Ma, Shin Yoo, Taeho Kim 0001		FSE2021Testing / QA
Security guarantees for automated software testing.
Danushka Liyanage		FSE2021Testing / QA; Security / Privacy / Vulnerability
SMT solver testing with type and grammar based mutation.
Jiwon Park		FSE2021Testing / QA; Program Analysis / Verification / Formal Methods
Reducing the search space of bug inducing commits using failure coverage.
Gabin An, Shin Yoo		FSE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Quantifying no-fault-found test failures to prioritize inspection of flaky tests at Ericsson.
Maaz Hafeez Ur Rehman, Peter C. Rigby		FSE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair; DevOps / CI / Build / Release
PorkFuzz: testing stateful software-defined network applications with property graphs.
Chaofan Shou		FSE2021Testing / QA
New visions on metamorphic testing after a quarter of a century of inception.
Tsong Yueh Chen, T. H. Tse		FSE2021Testing / QA
Metamorphic testing of Datalog engines.
Muhammad Numair Mansur, Maria Christakis, Valentin Wüstholz		FSE2021Testing / QA
LS-sampling: an effective local search based sampling approach for achieving high t-wise coverage.
Chuan Luo 0002, Binqi Sun, Bo Qiao 0001, Junjie Chen 0003, Hongyu Zhang 0002		FSE2021Testing / QA
How disabled tests manifest in test maintainability challenges?
Dong Jae Kim, Bo Yang 0058, Jinqiu Yang 0001, Tse-Hsun (Peter) Chen		FSE2021Testing / QA
How can manual testing processes be optimized? developer survey, optimization guidelines, and case studies.
Roman Haas, Daniel Elsner, Elmar Jürgens, Alexander Pretschner, Sven Apel		FSE2021Testing / QA; Human / Empirical / Socio-technical; Performance / Energy / Reliability
HeteroFuzz: fuzz testing to detect platform dependent divergence for heterogeneous applications.
Qian Zhang 0020, Jiyuan Wang, Miryung Kim		FSE2021Testing / QA
Graph-based seed object synthesis for search-based unit testing.
Yun Lin 0001, You Sheng Ong, Jun Sun 0001, Gordon Fraser 0001, Jin Song Dong 0001		FSE2021Testing / QA
GLIB: towards automated test oracle for graphically-rich applications.
Ke Chen 0005, Yufei Li 0001, Yingfeng Chen, Changjie Fan, Zhipeng Hu		FSE2021Testing / QA
FuzzBench: an open fuzzer benchmarking platform and service.
Jonathan Metzman, László Szekeres, Laurent Simon 0001, Read Sprabery, Abhishek Arya		FSE2021Testing / QA
Flaky test detection in Android via event order exploration.
Zhen Dong, Abhishek Tiwari 0001, Xiao Liang Yu, Abhik Roychoudhury		FSE2021Testing / QA; DevOps / CI / Build / Release; Mobile / Web / GUI / Android
Fairea: a model behaviour mutation approach to benchmarking bias mitigation methods.
Max Hort, Jie M. Zhang, Federica Sarro, Mark Harman		FSE2021Testing / QA
FLEX: fixing flaky tests in machine learning projects by updating assertion bounds.
Saikat Dutta 0001, August Shi, Sasa Misailovic		FSE2021Testing / QA; AI / LLM for SE; Debugging / Fault Localization / Diagnosis / Repair
Estimating residual risk in greybox fuzzing.
Marcel Böhme, Danushka Liyanage, Valentin Wüstholz		FSE2021Testing / QA
Documenting evidence of a reuse of 'a systematic literature review of techniques and metrics to reduce the cost of mutation testing'.
Andre Lustosa, Tim Menzies		FSE2021Testing / QA; Performance / Energy / Reliability
Data-driven test selection at scale.
Sonu Mehta, Farima Farmahinifarahani, Ranjita Bhagwan, Suraj Guptha, Sina Jafari		FSE2021Testing / QA; DevOps / CI / Build / Release
CrossASR++: a modular differential testing framework for automatic speech recognition.
Muhammad Hilmi Asyrofi, Zhou Yang 0003, David Lo 0001		FSE2021Testing / QA
Code integrity attestation for PLCs using black box neural network predictions.
Yuqi Chen 0001, Christopher M. Poskitt, Jun Sun 0001		FSE2021Testing / QA; AI / LLM for SE
Boosting static analysis accuracy with instrumented test executions.
Tianyi Chen, Kihong Heo, Mukund Raghothaman		FSE2021Testing / QA; Program Analysis / Verification / Formal Methods
Boosting coverage-based fault localization via graph-based representation learning.
Yiling Lou, Qihao Zhu, Jinhao Dong, Xia Li 0009, Zeyu Sun 0004		FSE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Benchmarking automated GUI testing for Android against real-world bugs.
Ting Su 0001, Jue Wang, Zhendong Su 0001		FSE2021Testing / QA; Mobile / Web / GUI / Android
Automated generation of realistic test inputs for web APIs.
Juan C. Alonso		FSE2021Testing / QA; Mobile / Web / GUI / Android
An automatic refactoring framework for replacing test-production inheritance by mocking mechanism.
Xiao Wang 0030, Lu Xiao 0001, Tingting Yu 0001, Anne Woepse, Sunny Wong 0001		FSE2021Testing / QA; Maintenance / Evolution / Refactoring / Review
A replication of 'DeepBugs: a learning approach to name-based bug detection'.
Jordan Winkler, Abhimanyu Agarwal, Caleb Tung, Dario Rios Ugalde, Young Jin Jung		FSE2021Testing / QA
UI Test Migration Across Mobile Platforms.
Saghar Talebipour, Yixue Zhao, Luka Dojcilovic, Chenggang Li, Nenad Medvidovic		ASE2021Testing / QA; Maintenance / Evolution / Refactoring / Review; Mobile / Web / GUI / Android
Training Automated Test Oracles to Identify Semantic Bugs.
Charaka Geethal		ASE2021Testing / QA
Towards Systematic and Dynamic Task Allocation for Collaborative Parallel Fuzzing.
Van-Thuan Pham, Manh-Dung Nguyen, Quang-Trung Ta, Toby Murray, Benjamin I. P. Rubinstein		ASE2021Testing / QA
Testing Your Question Answering Software via Asking Recursively.
Songqiang Chen, Shuo Jin, Xiaoyuan Xie		ASE2021Testing / QA
Tackling Flaky Tests: Understanding the Problem and Providing Practical Solutions.
Martin Gruber		ASE2021Testing / QA; DevOps / CI / Build / Release
Systematic Testing of Autonomous Driving Systems Using Map Topology-Based Scenario Classification.
Yun Tang 0003, Yuan Zhou 0005, Tianwei Zhang 0004, Fenghua Wu, Yang Liu 0003		ASE2021Testing / QA
Shaker: a Tool for Detecting More Flaky Tests Faster.
Marcello Cordeiro, Denini Silva, Leopoldo Teixeira, Breno Miranda, Marcelo d'Amorim		ASE2021Testing / QA; DevOps / CI / Build / Release
Shake Those System Parameters! On the Need for Parameter Coverage for Decision Systems.
Thomas Laurent 0003, Paolo Arcaini, Fuyuki Ishikawa, Anthony Ventresque		ASE2021Testing / QA
Scalable Fuzzing of Program Binaries with E9AFL.
Xiang Gao 0012, Gregory J. Duck, Abhik Roychoudhury		ASE2021Testing / QA
SMARTIAN: Enhancing Smart Contract Fuzzing with Static and Dynamic Data-Flow Analyses.
Jaeseung Choi 0002, Doyeon Kim, Soomin Kim 0002, Gustavo Grieco, Alex Groce		ASE2021Testing / QA; Security / Privacy / Vulnerability
Reducing Time-To-Fix For Fuzzer Bugs.
Rui Abreu 0001, Franjo Ivancic, Filip Niksic, Hadi Ravanbakhsh, Ramesh Viswanathan		ASE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
RULF: Rust Library Fuzzing via API Dependency Graph Traversal.
Jianfeng Jiang, Hui Xu 0009, Yangfan Zhou 0002		ASE2021Testing / QA
Quito: a Coverage-Guided Test Generator for Quantum Programs.
Xinyi Wang 0004, Paolo Arcaini, Tao Yue 0002, Shaukat Ali 0001		ASE2021Testing / QA
QDiff: Differential Testing of Quantum Software Stacks.
Jiyuan Wang, Qian Zhang 0020, Guoqing Harry Xu, Miryung Kim		ASE2021Testing / QA
PyNose: A Test Smell Detector For Python.
Tongjie Wang, Yaroslav Golubev, Oleg Smirnov, Jiawei Li 0013, Timofey Bryksin		ASE2021Testing / QA
Property-based Test for Part-of-Speech Tagging Tool.
Shuo Jin, Songqiang Chen, Xiaoyuan Xie		ASE2021Testing / QA
Performance Testing for Cloud Computing with Dependent Data Bootstrapping.
Sen He 0002, Tianyi Liu, Palden Lama, Jaewoo Lee, In Kee Kim		ASE2021Testing / QA; Cloud / Microservices / Distributed Systems; Performance / Energy / Reliability
Nekara: Generalized Concurrency Testing.
Udit Agarwal, Pantazis Deligiannis, Cheng Huang, Kumseok Jung, Akash Lal		ASE2021Testing / QA
Muskit: A Mutation Analysis Tool for Quantum Software Testing.
Eñaut Mendiluze, Shaukat Ali 0001, Paolo Arcaini, Tao Yue 0002		ASE2021Testing / QA
Metamorphic Testing on Multi-module UAV Systems.
Rui Li 0013, Huai Liu, Guannan Lou, James Xi Zheng, Xiao Liu 0004		ASE2021Testing / QA
JTDog: a Gradle Plugin for Dynamic Test Smell Detection.
Masayuki Taniguchi, Shinsuke Matsumoto, Shinji Kusumoto		ASE2021Testing / QA
InstruGuard: Find and Fix Instrumentation Errors for Coverage-based Greybox Fuzzing.
Yuwei Liu 0001, Yanhao Wang, Purui Su, Yuanping Yu, Xiangkun Jia		ASE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Improving Test Case Generation for REST APIs Through Hierarchical Clustering.
Dimitri Michel Stallenberg, Mitchell Olsthoorn, Annibale Panichella		ASE2021Testing / QA
Improving Mutation-Based Fault Localization with Plausible-code Generating Mutation Operators.
Juyoung Jeon, Shin Hong		ASE2021Testing / QA; Debugging / Fault Localization / Diagnosis / Repair
Improving Configurability of Unit-level Continuous Fuzzing: An Industrial Case Study with SAP HANA.
Hanyoung Yoo, Jingun Hong, Lucas Bader, Dongwon Hwang, Shin Hong		ASE2021Testing / QA; Human / Empirical / Socio-technical
IFIZZ: Deep-State and Efficient Fault-Scenario Generation to Test IoT Firmware.
Peiyu Liu 0003, Shouling Ji, Xuhong Zhang 0002, Qinming Dai, Kangjie Lu		ASE2021Testing / QA
Fuzzing Methods Recommendation Based on Feature Vectors.
Chi Zhang 0046, Jinfu Chen 0001		ASE2021Testing / QA
FinFuzzer: One Step Further in Fuzzing Fintech Systems.
Qingshun Wang, Lihua Xu, Jun Xiao, Qi Guo, Haotian Zhang		ASE2021Testing / QA
Faster Mutation Analysis with Fewer Processes and Smaller Overheads.
Bo Wang 0050, Sirui Lu, Yingfei Xiong 0001, Feng Liu 0061		ASE2021Testing / QA
Efficient state synchronisation in model-based testing through reinforcement learning.
Uraz Cengiz Türker, Robert M. Hierons, Mohammad Reza Mousavi 0001, Ivan Yu. Tyukin		ASE2021Testing / QA
Detecting Adversarial Samples with Graph-Guided Testing.
Zuohui Chen, Renxuan Wang, Jingyang Xiang, Yue Yu 0001, Xin Xia 0001		ASE2021Testing / QA
DeepMetis: Augmenting a Deep Learning Test Set to Increase its Mutation Score.
Vincenzo Riccio, Nargiz Humbatova, Gunel Jahangirova, Paolo Tonella		ASE2021Testing / QA; AI / LLM for SE
DEVIATE: A Deep Learning Variance Testing Framework.
Hung Viet Pham, Mijung Kim, Lin Tan 0001, Yaoliang Yu, Nachiappan Nagappan		ASE2021Testing / QA; AI / LLM for SE
CorbFuzz: Checking Browser Security Policies with Fuzzing.
Chaofan Shou, Ismet Burak Kadron, Qi Su, Tevfik Bultan		ASE2021Testing / QA; Security / Privacy / Vulnerability; Mobile / Web / GUI / Android
BeeSwarm: Enabling Parallel Scaling Performance Measurement in Continuous Integration for HPC Applications.
Jake Tronge, Jieyang Chen, Patricia Grubel, Tim Randles, Rusty Davis		ASE2021Testing / QA; DevOps / CI / Build / Release; Performance / Energy / Reliability
BIFF: Practical Binary Fuzzing Framework for Programs of IoT and Mobile Devices.
Cen Zhang, Yuekang Li, Hongxu Chen 0001, Xiaoxing Luo, Miaohua Li		ASE2021Testing / QA; Mobile / Web / GUI / Android
Automated Testing for Machine Translation via Constituency Invariance.
Pin Ji, Yang Feng 0003, Jia Liu 0008, Zhihong Zhao, Baowen Xu		ASE2021Testing / QA
Automated Approach for System-level Testing of Unmanned Aerial Systems.
Hassan Sartaj		ASE2021Testing / QA
Access Control Tree for Testing and Learning.
Davrondzhon Gafurov, Arne Erik Hurum, Margrete Sunde Grovan		ASE2021Testing / QA
API Compatibility Issue Detection, Testing and Analysis for Android Apps.
Tarek Mahmud		ASE2021Testing / QA; Mobile / Web / GUI / Android
A First Look at the Effect of Deep Learning in Coverage-guided Fuzzing.
Siqi Li, Yun Lin 0001, Xiaofei Xie, Yuekang Li, Xiaohong Li 0001		ASE2021Testing / QA; AI / LLM for SE