The Role of an Empirical Software Engineering Researcher in the Age of Generative AI
Emerson Murphy-Hill, Microsoft
Abstract. Generative AI has brought significant upheaval and uncertainty to how software is developed—and those of us who study software developers face substantial new challenges and questions of our own. When AI-based developer tools evolve every few months, how can we produce research that endures? What can human-centered academics hope to contribute when the big players are relatively token-rich? And why write papers at all when generative AI can both synthesize and peer review them? As someone who has worked on both human-centered and AI-centered problems, in industry and academia alike, I’ll explore these urgent questions facing our community.
Bio. Dr. Emerson Murphy-Hill is a research scientist at Microsoft, where he has studied developer experience and helped build Excel Agent. Previously, he was a research scientist in Engineering Productivity Research at Google, leading efforts to improve diversity and inclusion for software developers. Before Google, he was an Associate Professor at North Carolina State University and led the Developer Liberation Front. His research spans human-computer interaction and software engineering, earning six ACM SIGSOFT Distinguished Paper Awards, an NSF CAREER Award, a VL/HCC Best Paper Award, and a Microsoft Software Engineering Innovation Foundation Award.
From Hallucinations to Helpful Agents: Advancing Trustworthy Automation in Code Review
Patanamon Thongtanunam, University of Melbourne
Abstract. Large language models (LLMs) have demonstrated strong capabilities across software engineering tasks, including code review, and are increasingly embedded in commercial development workflows. Yet, code review is a critical quality and security gate, and reliance on LLMs raises fundamental questions about reliability and risk. This keynote synthesises a multi-year research agenda that investigates where and why LLM-based review automation could break down—and how it can be redesigned to better support developers. Grounded in large-scale mining of software repositories and empirical studies, the talk discusses hallucinations, data quality, and security blind spots in code review automation, and argues for a shift from surface-level text generation toward accountable, goal-driven, and agentic review systems that developers can trust.
Bio. Patanamon Thongtanunam (Pick) is an Associate Professor in the School of Computing and Information Systems at the University of Melbourne. Her research focuses on empirical software engineering, data mining, and data driven techniques to support software engineering tasks. Her work has received numerous prestigious awards, including the MSR 2024 Ric Holt Early Career Achievement Award, an Australian Research Council (ARC) Discovery Early Career Researcher Award (2021–2024), a Japan Society for the Promotion of Science Research Fellowship (2016–2018), the SANER 2025 Most Influential Paper Award, and multiple Distinguished Paper Awards.
Dates
Tracks
This program is tentative and subject to change.
Mon 13 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
Mon 13 Apr
Displayed time zone: Brasilia, Distrito Federal, Brazil change
09:00 - 10:30 | |||
11:00 - 12:30 | |||
11:00 10mResearch paper | Where Do Smart Contract Security Analyzers Fall Short? Technical Papers DOI Pre-print | ||
11:10 10mTalk | An Empirical Study of Vulnerabilities in Python Packages and Their Detection Technical Papers Haowei Quan Monash University, Junjie Wang Tianjin University, Xinzhe Li College of Intelligence and Computing, Tianjin University, Terry Yue Zhuo Monash University and CSIRO's Data61, Xiao Chen University of Newcastle, Xiaoning Du Monash University | ||
11:20 10mTalk | Does Programming Language Matter? An Empirical Study of Fuzzing Bug Detection Technical Papers Tatsuya Shirai Nara Institute of Science and Technology, Olivier Nourry The University of Osaka, Yutaro Kashiwa Nara Institute of Science and Technology, Kenji Fujiwara Nara Women’s University, Hajimu Iida Nara Institute of Science and Technology | ||
11:30 10mTalk | An Empirical Study on Line-Level Software Defect Prediction Technical Papers Enci Zhang Beijing Jiaotong University, Yutong Jiang Beijing Jiaotong University, Tianmeng Zhang Beijing Jiaotong University, Haonan Tong Beijing Jiaotong University | ||
11:40 10mTalk | Characterizing and Modeling the GitHub Security Advisories Review Pipeline Technical Papers Claudio Segal UFF, Paulo Segal UFF, Carlos Eduardo de Schuller Banjar UFRJ, Felipe Paixão UFBA, Hudson Silva Borges UFMS, Paulo Silveira Neto Federal University Rural of Pernambuco, Eduardo Santana de Almeida Federal University of Bahia, Joanna C. S. Santos University of Notre Dame, Anton Kocheturov Siemens Technology, Gaurav Kumar Srivastava Siemens, Daniel Sadoc Menasche UFRJ, Brazil Pre-print | ||
11:50 10mTalk | Linux Kernel Recency Matters, CVE Severity Doesn’t, and History Fades Technical Papers Piotr Przymus Nicolaus Copernicus University in Toruń, Poland, Witold Weiner Nicolaus Copernicus University in Toruń and Adtran Networks Sp. z o.o, Krzysztof Rykaczewski Nicolaus Copernicus University in Toruń, Poland, Gunnar Kudrjavets Amazon Web Services, USA Pre-print | ||
12:00 10mTalk | Beyond Single Code Changes: An Empirical Study of Topic-Based Code Review Practices in Gerrit for OpenStack Technical Papers Moataz Chouchen Concordia University, Mahi Begoug ETS Montreal, Ali Ouni Ecole de Technologie Superieure (ETS) | ||
12:10 10mTalk | LogSieve: Task-Aware CI Log Reduction for Sustainable LLM-Based Analysis Technical Papers Marcus Barnes University of Toronto, Taher A. Ghaleb Trent University, Safwat Hassan University of Toronto Pre-print | ||
12:20 5mTalk | Finding Important Stack Frames in Large Systems Industry Track Aleksandr Khvorov JetBrains; Constructor University Bremen, Yaroslav Golubev JetBrains Research, Denis Sushentsev JetBrains | ||
12:25 5mTalk | Stop Comparing Apples and Oranges: Matching for Better Results in Mining Software Repositories Studies Technical Papers Sabato Nocera University of Salerno, Nyyti Saarimäki University of Luxembourg, Valentina Lenarduzzi University of Southern Denmark and University of Oulu, Davide Taibi University of Southern Denmark and University of Oulu, Sira Vegas Universidad Politecnica de Madrid | ||
14:00 - 15:30 | |||
14:00 90mPoster | Session 2 - Posters MSR Program | ||
14:00 90mTalk | When AI Agents Touch CI/CD Configurations: Frequency and Success Mining Challenge Taher A. Ghaleb Trent University Pre-print | ||
14:00 90mTalk | Fingerprinting AI Coding Agents on GitHub Mining Challenge Taher A. Ghaleb Trent University Pre-print | ||
14:00 90mTalk | When AI Code Doesn’t Stick: An Empirical Study on Reverted Changes Introduced by AI Coding Agents Mining Challenge Issam Oukay Department of Software and IT Engineering, ETS Montreal, University of Quebec, Montreal, Canada, Mahi Begoug ETS Montreal, Moataz Chouchen Concordia University, Ali Ouni Ecole de Technologie Superieure (ETS) | ||
14:00 90mTalk | Characterizing Self-Admitted Technical Debt Generated by AI Coding Agents Mining Challenge Zaki Brahmi ETS Montreal, University of Quebec, Ali Ouni Ecole de Technologie Superieure (ETS), Mohammed Sayagh ETS Montreal, University of Quebec, Mohamed Aymen saied Laval University | ||
14:00 90mTalk | How Do Agents Perform Code Optimization? An Empirical Study Mining Challenge Huiyun Peng Purdue University, Antonio Zhong Qiu Purdue University, Ricardo Andres Calvo Mendez Purdue University, Kelechi G. Kalu Purdue University, James C. Davis Purdue University | ||
14:00 90mTalk | Comparing AI Coding Agents: A Task-Stratified Analysis of Pull Request Acceptance Mining Challenge Giovanni Pinna University of Trieste, Jingzhi Gong University of Leeds, David Williams University College London, Federica Sarro University College London | ||
14:00 90mTalk | More Code, Less Reuse: Investigation on Code Quality and Reviewer Sentiment towards AI-generated Pull Requests Mining Challenge Haoming Huang Institute of Science Tokyo, Pongchai Jaisri Nara Institute of Science and Technology, Shota Shimizu Ritsumeikan University, Lingfeng Chen Kyushu University, Sota Nakashima Kyushu University, Gema Rodríguez-Pérez Department of Computer Science, Mathematics, Physics and Statistics, University of British Columbia, Okanagan Campus DOI Pre-print | ||
14:00 90mShort-paper | On the Adoption of AI Coding Agents in Open-source Android and iOS Development Mining Challenge Muhammad Ahmad Khan Lahore University of Management Sciences, Hasnain Ali Lahore University of Management Sciences, Muneeb Rana Xtra App Studios, Muhammad Saqib Ilyas Lahore University of Management Sciences, Abdul Ali Bangash Lahore University of Management Sciences Pre-print | ||
14:00 90mTalk | Who Writes the Docs in SE 3.0? Agent vs. Human Documentation Pull Requests Mining Challenge Kazuma Yamasaki Nara Institute of Science and Technology, Joseph Ayobami Joshua Nara Institute of Science and Technology, Tasha Settewong Nara Institute of Science and Technology, Mahmoud Alfadel University of Calgary, Kazumasa Shimari Nara Institute of Science and Technology, Kenichi Matsumoto Nara Institute of Science and Technology DOI Pre-print | ||
14:00 90mTalk | Testing with AI Agents: An Empirical Study of Test Generation Frequency, Quality, and Coverage Mining Challenge Suzuka Yoshimoto NARA Institute of Science and Technology, Shun Fujita NARA Institute of Science and Technology, Kosei Horikawa , Daniel Feitosa University of Groningen, Yutaro Kashiwa Nara Institute of Science and Technology, Hajimu Iida Nara Institute of Science and Technology | ||
14:00 90mTalk | Safer Builders, Risky Maintainers: A Comparative Study of Breaking Changes in Human vs Agentic PRs Mining Challenge K M Ferdous Kennesaw State University, Dipayan Banik Quanta Technology, Kowshik Chowdhury Kennesaw State University, Shazibul Islam Shamim Kennesaw State University | ||
14:00 90mTalk | On the Reliability of Agentic AI in Continuous Integration Pipelines Mining Challenge Jasem Khelifi École de technologie supérieure, Mahi Begoug ETS Montreal, Ali Ouni Ecole de Technologie Superieure (ETS), Mohammed Sayagh ETS Montreal, University of Quebec, Mohamed Aymen saied Laval University, Moataz Chouchen Concordia University | ||
14:00 90mTalk | Early-Stage Prediction of Review Effort in AI-Generated Pull Requests Mining Challenge Dao Sy Duy Minh University of Science - VNUHCM, Huynh Trung Kiet University of Science - VNUHCM, Nguyen Lam Phu Quy University of Science - VNUHCM, Pham Phu Hoa University of Science - VNUHCM, Tran Chi Nguyen University of Science - VNUHCM, Nguyen Dinh Ha Duong University of Science - VNUHCM, Truong Bao Tran University of Economics and Law -VNUHCM | ||
14:00 90mTalk | Test Coverage of Code Changes in AI-Generated Pull Requests Mining Challenge Tales Alves Informatics Center, Federal University of Pernambuco, Leopoldo Teixeira Federal University of Pernambuco | ||
14:00 90mTalk | When AI Teammates Meet Code Review: Collaboration Signals Shaping the Integration of Agent-Authored Pull Requests Mining Challenge Pre-print | ||
14:00 90mTalk | Toward Instructions-as-Code: Understanding the Impact of Instruction Files on Agentic Pull Requests Mining Challenge | ||
14:00 90mTalk | An Empirical Study of Code Clone Genealogies in Human–AI Collaborative Development Mining Challenge Denis Sousa State University of Ceara, Brazil, Italo Uchoa State University of Ceará, Matheus Paixao State University of Ceará, Chaiyong Rakhitwetsagul Mahidol University, Thailand, Thiago Lima State University of Ceara, Brazil | ||
14:00 90mTalk | On the Footprints of Reviewer Bots' Feedback on Agentic Pull Requests in OSS GitHub Repositories Mining Challenge Syeda Kaneez Fatima Lahore University of Management Sciences, Yousuf Abrar Lahore University of Management Sciences, Abdul Rehman Lahore University of Management Sciences, Amelia Nawaz Lahore University of Management Sciences, Shamsa Abid National University of Computer and Emerging Sciences, Abdul Ali Bangash Lahore University of Management Sciences | ||
14:00 90mTalk | When Bots Get the Boot: Understanding Pull Request Rejections in the Era of AI Coders Mining Challenge | ||
14:00 90mTalk | Understanding the Rejection of Fixes Generated by Agentic Pull Requests - Insights from the AIDev Dataset Mining Challenge Mahmoud Abujadallah ETS - Québec University, Ali Arabat ETS - Québec University, Mohammed Sayagh ETS Montreal, University of Quebec | ||
14:00 90mTalk | What to Cut? Predicting Unnecessary Methods in Agentic Code Generation Mining Challenge Kan Watanabe Nara Institute of Science and Technology, Tatsuya Shirai Nara Institute of Science and Technology, Yutaro Kashiwa Nara Institute of Science and Technology, Hajimu Iida Nara Institute of Science and Technology | ||
14:00 90mTalk | How AI Coding Agents Modify Code: A Large-Scale Study of GitHub Pull Requests Mining Challenge Daniel Ogenrwot University of Nevada Las Vegas, John Businge University of Antwerp; Flanders Make; University of Nevada at Las Vegas DOI Pre-print | ||
14:00 90mTalk | Reliability of AI Bots Footprints in GitHub Actions CI/CD Workflows Mining Challenge Syed Muhammad Ashhar Shah Lahore University of Management Sciences, Lahore, Sehrish Habib Lahore University of Management Sciences, Lahore, Muizz Ahmed Hussain Lahore University of Management Sciences, Lahore, Maryam Abdul Ghafoor Lahore University of Management Sciences, Lahore, Abdul Ali Bangash Lahore University of Management Sciences | ||
14:00 90mTalk | The Dose Makes the Agent: Therapeutic Index Analysis of AI Coding Contributions Mining Challenge Giuseppe Destefanis University College London, Ronnie de Souza Santos University of Calgary, Marco Ortu University of Cagliari, Mairieli Wessel Radboud University | ||
14:00 90mTalk | Beyond Bug Fixes: An Empirical Investigation of Post-Merge Code Quality Issues in Agent-Generated Pull Requests Mining Challenge Shamse Tasnim Cynthia University of Saskatchewan, Al Muttakin University of Saskatchewan, Banani Roy University of Saskatchewan | ||
14:00 90mTalk | Why Are Agentic Pull Requests Merged or Rejected? An Empirical Study Mining Challenge Sien Reeve O. Peralta Waseda University, Fumika Hoshi Waseda University, Hironori Washizaki Waseda University, Naoyasu Ubayashi Waseda University, Inase Kondo Osaka University, Yoshiki Higo Osaka University, Hiroki Mukai Ritsumeikan University, Norihiro Yoshida Ritsumeikan University, Kazuki Kusama , Hidetake Tanaka Nara Institute of Science and Technology, Youmei Fan Nara Institute of Science and Technology | ||
14:00 90mTalk | Let's Make Every Pull Request Meaningful: An Empirical Analysis of Developer and Agentic Pull Requests Mining Challenge Haruhiko Yoshioka Nara Institute of Science and Technology, Takahiro Monno Nara Institute of Science and Technology, Haruka Tokumasu Kyushu University, Taiki Wakamatsu Kyushu University, Yuki Ota Ritsumeikan University, Nimmi Weeraddana University of Calgary , Kenichi Matsumoto Nara Institute of Science and Technology DOI Pre-print | ||
14:00 90mTalk | Humans Integrate, Agents Fix: How Agent-Authored Pull Requests Are Referenced in Practice Mining Challenge Islem Khemissi Concordia University, Moataz Chouchen Concordia University, Dong Wang Tianjin University, Raula Gaikovina Kula The University of Osaka | ||
14:00 90mShort-paper | How Do Agentic AI Systems Deal With Software Energy Concerns? A Pull Request-Based Study Mining Challenge Tanjum Motin Mitul University of Manitoba, Md. Masud Mazumder University of Manitoba, Md Nahidul Islam Opu University of Manitoba, Shaiful Chowdhury University of Manitoba Pre-print | ||
14:00 90mTalk | When AI Writes Code: Investigating Security Issues in Agentic Software Changes Mining Challenge Esteban Dectot-Le Monnier de Gouville Polytechnique Montréal, Mohammad Hamdaqa Polytechnique Montreal, Moataz Chouchen Concordia University | ||
14:00 90mTalk | Novice Developers Produce Larger Review Overhead for Project Maintainers while Vibe Coding Mining Challenge Syed Ammar Asdaque Lahore University of Management Sciences, Imran Haider Lahore University of Management Sciences, Muhammad Umar Malik Lahore University of Management Sciences, Maryam Abdul Ghafoor Lahore University of Management Sciences, Lahore, Abdul Ali Bangash Lahore University of Management Sciences | ||
14:00 90mTalk | Code Change Characteristics and Description Alignment: A Comparative Study of Agentic versus Human Pull Requests Mining Challenge Pre-print | ||
14:00 90mTalk | A Task-Level Evaluation of AI Agents in Open-Source Projects Mining Challenge Shojibur Rahman Idaho State University, Md Fazle Rabbi Idaho State University, Minhaz Zibran Idaho State University Pre-print | ||
14:00 90mTalk | Behind Agentic Pull Requests: An Empirical Study on Developer Interventions in AI Agent-Authored Pull Requests Mining Challenge Syrine Khelifi École de technologie supérieure (ÉTS) Montréal, Ali Ouni Ecole de Technologie Superieure (ETS), Maha Khemaja ISSAT Sousse, PRINCE Lab, University of Sousse | ||
14:00 90mTalk | Readability of AI-Generated Pull Request Descriptions Across Pull Request Types Mining Challenge Aidan Tobar Bowling Green State University, Joseph Peterson Bowling Green State University, Abbas Heydarnoori Bowling Green State University | ||
14:00 90mShort-paper | The Quiet Contributions: Insights into AI-Generated Silent Pull Requests Mining Challenge S. M. Mahedy Hasan Idaho State University, Md Fazle Rabbi Idaho State University, Minhaz Zibran Idaho State University Pre-print | ||
14:00 90mTalk | AI IDEs or Autonomous Agents? Measuring the Impact of Coding Agents on Software Development Mining Challenge Shyam Agarwal Carnegie Mellon University, Hao He Carnegie Mellon University, Bogdan Vasilescu Carnegie Mellon University Pre-print | ||
14:00 90mTalk | AI builds, We Analyze: An Empirical Study of AI-Generated Build Code Quality Mining Challenge | ||
14:00 90mTalk | Understanding Dominant Themes in Reviewing Agentic AI-authored Code Mining Challenge Md. Asif Haider University of California, Irvine, Thomas Zimmermann University of California, Irvine Pre-print | ||
14:00 90mTalk | Why and When Agentic Pull Requests are (not) Accepted: An Exploratory Study Mining Challenge Marius Christoph Strauss Anhalt University of Applied Sciences, Sandro Schulze Anhalt University of Applied Sciences DOI Pre-print | ||
14:00 90mTalk | Analyzing Message-Code Inconsistency in AI Coding Agent-Authored Pull Requests Mining Challenge Jingzhi Gong University of Leeds, Giovanni Pinna University of Trieste, Yixin Bian Harbin Normal University, Jie M. Zhang King's College London | ||
14:00 90mTalk | How Do Agentic AI Systems Address Performance Optimizations? A BERTopic-Based Analysis of Pull Requests Mining Challenge Md Nahidul Islam Opu University of Manitoba, Md Shahidul Islam University of Manitoba, Muhammad Asaduzzaman University of Windsor, Shaiful Chowdhury University of Manitoba Pre-print | ||
14:00 90mTalk | Mining Type Constructs Using Patterns in AI-Generated Code Mining Challenge Imgyeong Lee University of Alberta, Tayyib Ul Hassan University of Alberta, Abram Hindle University of Alberta | ||
14:00 90mTalk | Bug-Fixing in the Age of AI: Human vs. Agentic Pull Requests Mining Challenge Renato Domingues UFPE, Fernando Castor University of Twente, Fernanda Madeiral Universidade Federal de Pernambuco | ||
14:00 90mTalk | Why Are AI Agent–Involved Pull Requests (Fix-Related) Remain Unmerged? An Empirical Study Mining Challenge Khairul Alam University of Saskatchewan, Saikat Mondal University of Saskatchewan, Banani Roy University of Saskatchewan | ||
14:00 90mTalk | LGTM! Characteristics of Auto-Merged LLM-based Agentic PRs Mining Challenge Ruben Branco LASIGE, Informática, Faculdade de Ciências, Universidade de Lisboa, Paulo Canelas Carnegie Mellon University, Catarina Gamboa Carnegie Mellon University and University of Lisbon, Alcides Fonseca LASIGE; University of Lisbon DOI Pre-print Media Attached | ||
14:00 90mTalk | Do AI-Generated Pull Requests Get Rejected More? (Yes but Why?) Mining Challenge Rosie Wang University of Alberta, Zhou Yang University of Alberta, Alberta Machine Intelligence Institute | ||
14:00 90mTalk | How AI Coding Agents Communicate: A Study of Pull Request Characteristics and Human Review Responses Mining Challenge Kan Watanabe Nara Institute of Science and Technology, Rikuto Tsuchida Nara Institute of Science and Technology, Takahiro Monno Nara Institute of Science and Technology, Bin Huang Nara Institute of Science and Technology, Kazuma Yamasaki Nara Institute of Science and Technology, Youmei Fan Nara Institute of Science and Technology, Kazumasa Shimari Nara Institute of Science and Technology, Kenichi Matsumoto Nara Institute of Science and Technology | ||
14:00 90mTalk | Where Do AI Coding Agents Fail? An Empirical Study of Failed Agentic Pull Requests in GitHub Mining Challenge Ramtin Ehsani Drexel University, Sakshi Pathak Drexel University, Shriya Rawal Drexel University, Abdullah Al Mujahid Missouri University of Science and Technology, Mia Mohammad Imran Missouri University of Science and Technology, Preetha Chatterjee Drexel University, USA Pre-print | ||
14:00 90mTalk | An Empirical Study of Tests in Agentic Pull Requests Mining Challenge Sabrina Haque The University of Texas at Arlington, Sarvesh Ingale The University of Texas at Arlington, Christoph Csallner University of Texas at Arlington DOI Pre-print Media Attached | ||
14:00 90mTalk | Who Said CVE? How Vulnerability Identifiers Are Mentioned by Humans, Bots, and Agents in Pull Requests Mining Challenge Pien Rooijendijk Radboud University, Christoph Treude Singapore Management University, Mairieli Wessel Radboud University | ||
14:00 90mTalk | Behavioral Analysis of AI Code Generation Agents: Edit, Rewrite, and Repetition Mining Challenge Mahdieh Abazar University of Calgary, Reyhaneh Farahmand University of Calgary, Gouri Ginde Schulich School of Engineering, University of Calgary, Calgary, Alberta, Canada, Benjamin Tan University of Calgary, Lorenzo De Carli University of Calgary, Canada | ||
14:00 90mTalk | A Study on Code Clone Lifecycles in Pull Requests Created by AI Agents Mining Challenge Italo Uchoa State University of Ceará, Denis Sousa State University of Ceara, Brazil, Henrique Chuvas State University of Ceará, Matheus Paixao State University of Ceará, Chaiyong Rakhitwetsagul Mahidol University, Thailand, Thiago Lima State University of Ceara, Brazil | ||
14:00 90mTalk | On Autopilot? An Empirical Study of Human–AI Teaming and Review Practices in Open Source Mining Challenge Haoyu Gao The University of Melbourne, Peerachai Banyongrakkul The University of Melbourne, Hao Guan the University of Melbourne, Mansooreh Zahedi The Univeristy of Melbourne, Christoph Treude Singapore Management University | ||
14:00 90mTalk | From Industry Claims to Empirical Reality: An Empirical Study of Code Review Agents in Pull Requests Mining Challenge Kowshik Chowdhury Kennesaw State University, Dipayan Banik Quanta Technology, K M Ferdous Kennesaw State University, Shazibul Islam Shamim Kennesaw State University | ||
14:00 90mTalk | A Study of Library Usage in Agent-Authored Pull Requests Mining Challenge DOI Pre-print | ||
14:00 90mTalk | Studying the Footprints of AI Coding Agents in Blockchain Repositories Mining Challenge Munim Iftikhar Lahore University of Management Sciences, Lahore, Maaz Shahid Lahore University of Management Sciences, Lahore, Shahreyar Ashraf Lahore University of Management Sciences, Lahore, Muhammad Saqib Ilyas Lahore University of Management Sciences, Abdul Ali Bangash Lahore University of Management Sciences | ||
14:00 90mTalk | Human-Agent versus Human Pull Requests: A Testing-Focused Characterization and Comparison Mining Challenge Roberto Milanese Politecnico di Torino, University of Molise, Francesco Salzano University of Molise, Angelica Spina University of Molise, Antonio Vitale Politecnico di Torino, University of Molise, Remo Pareschi University of Molise, Fausto Fasano University of Molise, Mattia Fazzini University of Minnesota DOI Pre-print | ||
14:00 90mTalk | Do AI Agents Really Improve Code Readability? Mining Challenge Kyogo Horikawa National Institute of Technology, Nara College, Kosei Horikawa , Yutaro Kashiwa Nara Institute of Science and Technology, Hidetake Uwano National Institute of Technology, Nara College, Japan, Hajimu Iida Nara Institute of Science and Technology | ||
14:00 90mTalk | When is Generated Code Difficult to Comprehend? Assessing AI Agent Python Code Proficiency in the Wild Mining Challenge Nanthit Temkulkiat Mahidol University, Chaiyong Rakhitwetsagul Mahidol University, Thailand, Morakot Choetkiertikul Mahidol University, Thailand, Ruksit Rojpaisarnkit Nara Institute of Science and Technology, Raula Gaikovina Kula The University of Osaka | ||
14:00 90mTalk | How do Agents Refactor: An Empirical Study Mining Challenge Lukas Ottenhof University of Alberta, Daniel Penner University of Alberta, Abram Hindle University of Alberta, Thibaud Lutellier University of Alberta Pre-print | ||
14:00 90mTalk | An Empirical Analysis of Test Failures in AI-Generated Pull Requests Mining Challenge Alireza Hoseinpour Bowling Green State University, Sajjad Rezvani Boroujeni Bowling Green State University, Jashhvanth Tamilselvan Kunthavai Bowling Green State University, Kyle Cusimano Bowling Green State University, Abbas Heydarnoori Bowling Green State University | ||
16:00 - 17:30 | Session 3-B: Demo and tool & TutorialData and Tool Showcase Track / Tutorials / MSR Program at Oceania IV | ||
16:00 90mTalk | MOOT: a Repository of many Multi-objective Optimization Tasks Data and Tool Showcase Track Tim Menzies North Carolina State University, Tao Chen University of Birmingham, Yulong Ye University of Birmingham, Kishan Kumar Ganguly NC State, Amirali Rayegan NC State, Srinath Srinivasan NC State, Andre Lustosa North Carolina State University | ||
16:00 90mTalk | Mapping Decentralized Autonomous Organization Governance Across Chains: An Updated, Multi-Platform Dataset Data and Tool Showcase Track Mashiat Amin Farin University of Texas at Dallas, Samer Hassan Institute of Knowledge Technology, Universidad Complutense de Madrid, Madrid, Spain & Berkman Klein Center at Harvard University, Cambridge MA, USA, Javier Arroyo Dpt. of Computer Science, Universidad de Alcalá, Madrid, Spain & Institute of Knowledge Technology, Universidad Complutense de Madrid Madrid, Spain | ||
16:00 90mTalk | Assessing Task-based Chatbots: Snapshot and Curated Datasets for Dialogflow Data and Tool Showcase Track Elena Masserini University of Milano - Bicocca, Diego Clerissi University of Milano-Bicocca, Daniela Micucci University of Milano-Bicocca, Italy, Leonardo Mariani University of Milano-Bicocca | ||
16:00 90mTalk | LILA: Decentralized Build Reproducibility Monitoring for the Functional Package Management Model Data and Tool Showcase Track Julien Malka LTCI, Télécom Paris, Institut Polytechnique de Paris, France, Arnout Engelen Independent | ||
16:00 90mTalk | Mining Kubernetes Repositories: The Cloud was Not Built in a Day Data and Tool Showcase Track Giuseppe Destefanis University College London, Silvia Bartolucci University College London, Daniel Feitosa University of Groningen | ||
16:00 90mTalk | RustXec: A Vulnerability Reproduction Dataset for Assessing Security Risks in Open-Source Rust Applications Data and Tool Showcase Track Zhengjie Ji Virginia Tech, Xin Wang Virginia Tech, Wang Lingxiang Unaffiliated, Geng Li Wake Forest University, Fan Yang Wake Forest University, Ying Zhang Wake Forest University | ||
16:00 90mTalk | OSSGameBench: A Large-Scale Dataset of Development Activities in Open-Source Video Games Data and Tool Showcase Track DOI Pre-print | ||
16:00 90mTalk | JavaBackports: A Dataset for Benchmarking Automated Backporting in Java Data and Tool Showcase Track Kaushal Kahapola University of Moratuwa, Sri Lanka, Sharada Galappaththi University of Moratuwa, Sri Lanka, Dinith Ranasinghe University of Moratuwa, Sri Lanka, Ridwan Salihin Shariffdeen SonarSource, Nisansa de Silva University of Moratuwa, Sri Lanka, Srinath Perera WSO2, Sandareka Wickramanayake University of Moratuwa, Sri Lanka | ||
16:00 90mTalk | HackRep: A Large-Scale Dataset of GitHub Hackathon Projects Data and Tool Showcase Track Sjoerd Halmans Eindhoven University of Technology, Lavinia Francesca Paganini Eindhoven University of Technology, Alexander Serebrenik Eindhoven University of Technology, Alexander Nolte Eindhoven University of Technology | ||
16:00 90mTalk | KubeObjects: A Dataset of Real-World Kubernetes Objects Data and Tool Showcase Track Matteo Grella University of Twente, Danil Aliforenko University of Twente, Luca Mariot University of Twente | ||
16:00 90mTalk | IssuePilot: An Agentic Framework for Personalized Issue Recommendation and Onboarding in Open-Source Projects Data and Tool Showcase Track | ||
16:00 90mTalk | DBSecQA: A Curated Dataset of Developer Discussions on Database Security from Stack Exchange Data and Tool Showcase Track Md Rakibul Islam Lamar University, Farha Kamal Lamar University, MD HUMAUN KABIR Lamar University, Md Murad Sharif Lamar University | ||
16:00 90mTalk | PoolinGH: Fast, Efficient, and Robust GitHub Repository Mining Data and Tool Showcase Track Maxime ANDRÉ Namur Digital Institute, University of Namur, Marco Raglianti REVEAL @ Software Institute – USI, Lugano, Switzerland, Souhaila Serbout University of Zurich, Zurich, Switzerland, Anthony Cleve University of Namur, Michele Lanza Software Institute - USI, Lugano Pre-print | ||
16:00 90mTalk | GivenWhenThen: A Dataset of BDD Test Scenarios Mined from Open Source Projects Data and Tool Showcase Track Luciano Belo de Alcântara Júnior UFMG, João Eduardo Montandon Universidade Federal de Minas Gerais (UFMG) | ||
16:00 90mTalk | AnoMod: A Dataset for Anomaly Detection and Root Cause Analysis in Microservice System Data and Tool Showcase Track Ke Ping University of Helsinki, Hamza Bin Mazhar University of Helsinki, Yuqing Wang University of Helsinki, Finland, Ying Song University of Helsinki, Mika Mäntylä University of Helsinki and University of Oulu | ||
16:00 90mTalk | GLiSE: A Prompt-Driven and ML-Powered Tool for Automated Grey Literature Extraction in Software Engineering Data and Tool Showcase Track Brahim Mahmoudi École de technologie supérieure, Zacharie Chenail-Larcher École de technologie supérieure (ÉTS), Houcine Abdelkader Cherief Ecole de Technologie Supérieure, Quentin Stiévenart Université du Québec à Montréal, Naouel Moha École de Technologie Supérieure (ETS), Florent AVELLANEDA Université du Québec à Montréal | ||
16:00 90mTalk | OmniCCG: Agnostic Code Clone Genealogy Extractor Data and Tool Showcase Track Denis Sousa State University of Ceara, Brazil, Matheus Paixao State University of Ceará, Thiago Lima State University of Ceara, Brazil, Adriely Silva State University of Ceara, Brazil, Italo Uchoa State University of Ceará, Chaiyong Ragkhitwetsagul Mahidol University | ||
16:00 90mTalk | GitEvo: Code Evolution Analysis for Git Repositories Data and Tool Showcase Track Andre Hora UFMG Pre-print | ||
16:00 90mTalk | Skyt: Prompt Contracts for Software Repeatability in LLM-Assisted Development Data and Tool Showcase Track Heitor Roriz Filho Massimus, Nasser Jazdi University of Stuttgart, Vicente Lucena Universidade Federal do Amazonas | ||
16:00 90mTalk | InEx-Bug: A Human Annotated Dataset of Intrinsic and Extrinsic Bugs in the NPM Ecosystem Data and Tool Showcase Track Tanner Wright University of British Columbia, Adams Chen University of British Columbia, Gema Rodríguez-Pérez Department of Computer Science, Mathematics, Physics and Statistics, University of British Columbia, Okanagan Campus | ||
16:50 40mTalk | Running Large Language Models at Scale for Mining Software Repositories: Lessons Learned from HPC-Based Batch Inference Tutorials Ruoyu Su , Matteo Esposito University of Oulu, Davide Taibi University of Southern Denmark and University of Oulu, Valentina Lenarduzzi University of Southern Denmark and University of Oulu | ||
Tue 14 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
Tue 14 Apr
Displayed time zone: Brasilia, Distrito Federal, Brazil change
09:00 - 10:30 | |||
14:00 - 15:30 | |||
14:00 10mTalk | How are MLOps Frameworks Used in Open Source Projects? An Empirical Characterization Technical Papers Fiorella Zampetti University of Sannio, Italy, Federico Stocchetti University of Sannio, Italy, Federica Razzano University of Sannio, Italy, Damian Andrew Tamburri University of Sannio - JADS/NXP Semiconductors, Massimiliano Di Penta University of Sannio, Italy Pre-print | ||
14:10 10mTalk | Do We Agree on What an “Audit” Is? Toward Standardized Smart Contract Audit Reporting Technical Papers Ilham Qasse Reykjavik University, Mohammad Hamdaqa Polytechnique Montreal, Gísli Hjálmtýsson Reykjavik University | ||
14:20 10mTalk | AFGNN: API Misuse Detection using Graph Neural Networks and Clustering Technical Papers Ponnampalam Pirapuraj IIT Hyderabad, Tamal Mondal Oracle, Sharanya Gupta Yokogawa Digital, Akash Lal Microsoft Research, Somak Aditya IIT Kharagpur, Jyothi Vedurada IIT Hyderabad | ||
14:30 10mTalk | An Empirical Analysis of Cross-OS Portability Issues in Python Projects Technical Papers Denini Silva Federal University of Pernambuco, MohamadAli Farahat North Carolina State University, Marcelo d'Amorim North Carolina State University Pre-print | ||
14:40 10mTalk | Learning Compiler Fuzzing Mutators from Historical Bugs Technical Papers Lingjun Liu North Carolina State University, Feiran Qin North Carolina State University, Owolabi Legunsen Cornell University, Marcelo d'Amorim North Carolina State University | ||
14:50 40mMeeting | Mining Challenge Finalists MSR Program | ||
14:00 - 15:30 | |||
14:00 10mTalk | Analyzing GitHub Issues and Pull Requests in nf-core Pipelines: Insights into nf-core Pipeline Repositories Technical Papers | ||
14:10 10mTalk | Modeling Sampling Workflows for Code Repositories Technical Papers Romain Lefeuvre University of Rennes, Maiwenn Le Goasteller University of Rennes, Inria, CNRS, IRISA, Jessie Galasso-Carbonnel McGill University, Benoit Combemale University of Rennes, Inria, CNRS, IRISA, Quentin Perez INSA Rennes, Houari Sahraoui DIRO, Université de Montréal | ||
14:20 10mTalk | Quantifying Competitive Relationships Among Open-Source Software Projects Technical Papers Yuki Takei Japan Advanced Institute of Science and Technology, Toshiaki Aoki JAIST, Chaiyong Rakhitwetsagul Mahidol University, Thailand Pre-print | ||
14:30 10mTalk | Role of CI Adoption in Mobile App Success: An Empirical Study of Open-Source Android Projects Technical Papers xiaoxin zhou University of Toronto, Taher A. Ghaleb Trent University, Safwat Hassan University of Toronto Pre-print | ||
14:40 10mTalk | ML in a Box: Analyzing Containerization Practices in Open Source ML Projects Technical Papers Faten Jebari Grand Valley State University, Emna Ksontini University of North Carolina Wilmington, Amine Barrak Oakland University, USA, Wael Kessentini DePaul University | ||
14:50 10mTalk | An Empirical Study of Policy as Code: Adoption, Purpose, and Maintenance Technical Papers Ruben Opdebeeck Vrije Universiteit Brussel, Mahmoud Alfadel University of Calgary, Akond Rahman Auburn University, Yutaro Kashiwa Nara Institute of Science and Technology, João F. Ferreira Faculty of Engineering, University of Porto & INESC-ID, Raula Gaikovina Kula The University of Osaka, Coen De Roover Vrije Universiteit Brussel Pre-print | ||
15:00 10mTalk | Tracing Stereotypes in Pre-trained Transformers: From Biased Neurons to Fairer Models Technical Papers Gianmario Voria University of Salerno, Moses Openja Polytechnique Montreal, Foutse Khomh Polytechnique Montréal, Gemma Catolino University of Salerno, Fabio Palomba University of Salerno Pre-print | ||
15:10 5mIndustry talk | Can Data Mining Help to Survive the Annual Compiler Upgrade? Industry Track Gunnar Kudrjavets Amazon Web Services, USA, Aditya Kumar Google, Piotr Przymus Nicolaus Copernicus University in Toruń, Poland Pre-print | ||
15:15 5mTalk | Underutilization in Research GPU Clusters: SE Challenges Industry Track Krzysztof Kaczmarski Warsaw University of Technology, Jakub Narębski Nicolaus Copernicus University in Toruń, Piotr Przymus Nicolaus Copernicus University in Toruń, Poland | ||
16:00 - 17:30 | |||
Unscheduled Events
| Not scheduled Keynote | From Hallucinations to Helpful Agents: Advancing Trustworthy Automation in Code Review Keynotes Patanamon Thongtanunam The University of Melbourne | ||
| Not scheduled Keynote | The Role of an Empirical Software Engineering Researcher in the Age of Generative AI Keynotes Emerson Murphy-Hill Microsoft |