ROARS πŸ¦– Lab @ GMU

DinoROARS Mascot

Welcome to ROARS (Research on Automated Reasoning Systems) Lab at George Mason University. We develop automated reasoning techniques to formalize, verify, and analyze software and AI systems. See Research for more information.

News

More
  • 12/2025: GMU College of Computing's article on TSE Most Influential Paper Award
  • 12/2025: CSPicks: https://roars.dev/cspicks/ is now live. This webapp explores CS Faculty and PhD programs.
  • 11/2025: πŸŽ‰ Thanksgiving party!!!
  • 11/2025: Azan joined as a undergraduate researcher
  • 9/2025: SSBSE'25 research paper (πŸ… Best Paper Award) on LLM-guided Input Generation (πŸ‘ Didier)
  • 9/2025: Two NeurIPS'25 research papers on compositional DNN verification (πŸ… NeurIPS Spotlight) and certifying DNN verification (πŸ‘ Hai)
  • 9/2025:🎁 Received an NVIDIA Academic Research Grant
  • 11/2025: Phu joined as a undergraduate researcher
  • 8/2025: ASE'25 research paper on generating challenging benchmarks for DNN verification (πŸ‘ Linhan, first research paper as first author)
  • 8/2025: NeuralSAT ranked 2nd overall in VNN-COMP'25 (πŸ‘ Hai).
  • 7/2025: Elevated to ACM Senior Member
  • 4/2025: Serving as an organizer and program (papers) chair of VNN-COMP'25, the annual competition on verifying neural networks. Consider submitting your NNV tools and related papers.
  • 4/2025: CSConfs: https://roars.dev/csconfs/ is now live. This webapp tracks of upcoming CS conferences
  • 4/2025: (Book) Demystifying PhD Admissions in Computer Science is now published and available through Amazon Kindle (the book pdf will always be free through GitHub)
  • 4/2025: Two ISSTA'25 tool papers on LSP support for the COOL language (πŸ‘ Linhan, first paper) and VS Code support for invariant generation and symbolic execution (πŸ‘ Stefania, first paper)
  • 4/2025: Elevated to IEEE Senior Member.
  • 4/2025: CAV'25 paper on the NeuralSAT DNN verification tool (πŸ‘ Hai)
  • 2/2025: TSE paper (50th Anniversary Special Issue) on Evolution of APR
  • 2/2025: πŸ… TSE 10-Year Retrospective Most Influential Paper Award for GenProg work on automatic program repair (with Claire, Wes, and Steph). GMU News
  • 1/2025: NeuralSAT ranked 2nd overall in VNN-COMP'24 (our second participation, πŸ‘ Hai). Press: GMU
    Note: An initial parsing issue in the competition scripts undercounted NeuralSAT's results; the official updated report corrects this and shows NeuralSAT in 2nd place (Table B.1).
  • 1/2025: ICSE'25 NIER paper on LLM-based autoformalization for LEAN (πŸ‘ Long, first paper)
  • 11/2024: πŸŽ‰ Thanksgiving party!!!
  • 8/2024: Appointed Director of the MS Software Engr program
  • 8/2024: Promoted to Associate Professor with tenure
  • 6/2024: 🎁 Received an NSF Collaborative Formal Methods in the Field (FMitF) Grant
  • 5/2024: πŸ… Outstanding Undergraduate Research Award from GMU (πŸ‘ Stefania)
  • 4/2024: Nguyen and Long joined as a PhD student
  • 3/2024: Stefania joined as a undergraduate researcher
  • 2/2024: FSE'24 research paper on new optimizations developed for the NeuralSAT DNN verification tool (πŸ‘ Hai, first research paper as first author)
  • 1/2024: NeuralSAT ranked 4th overall and received the New Participant Award at VNN-COMP'23 (our first participation). It also won the tllverifybench category (πŸ‘ Hai and Linhan)
  • 1/2024: Huong joined as a undergraduate researcher
  • 11/2023: πŸŽ‰ Thanksgiving party!!!
  • 8/2023: NeuralSAT ranked 4th overall in the annual Verifying Neural Network competition VNN-COMP'23 (our first participation, πŸ‘ Hai and Linhan)
  • 8/2023: FSE SRC (Student Research Competition) paper on dynamic complexity analysis (πŸ‘ Didier)
  • 8/2023: FSE'23 Industry paper on fault localization
  • 7/2023: 🎁 Received an NSF Formal Methods in the Field (FMitF) Grant
  • 7/2023: πŸ““ A handbook for demystifying the PhD admission process in Computer Science in the US
  • 6/2023: SIGBED blog on NeuralSAT
  • 5/2023: πŸ… Outstanding Undergraduate Senior Award from UNL CSE (πŸ‘ KimHao)
  • 3/2023: 🎁 Received an Amazon Research Award. Press: Amazon Science, GMU
  • 1/2023: 🎁 Received the NSF CAREER Award to work on DNN verification. Press: GMU, BΓ‘o Thanh NiΓͺn (Vietnamese)
  • 12/2022: ICSE SEIP paper on shift left static analysis (πŸ‘ KimHao)
  • CS GMU People: a webapp for CS GMU directory (faculty and staff).
  • 11/2022: πŸŽ‰ Thanksgiving party!!!
  • 11/2022: SIGMOD'23 research paper on using graph neural networks to analyze IoT interactive bugs
  • 8/2022: πŸŽ‰ Start of the semester party!!!
  • 8/2022: Hai joined as a PhD student
  • 7/2022: ASE'22 research paper on feed-back driven iterative Alloy repair (πŸ‘ Guolong)
  • 4/2022: πŸŽ“ Guolong defended his dissertation on Alloy analysis (first PhD alumni of the group!)
  • 4/2022: ISSTA'22 research paper on template-based Alloy repair (πŸ‘ Guolong)
  • /12022: Two ICSE Tool papers on complex analysis (πŸ‘ Didier) and invariant generation (πŸ‘ KimHao and Hai)
  • 1/2022: ICSE SEIP paper on analyzing CMake build scripts (πŸ‘ KimHao)
  • 1/2022: Linhan joined as a PhD student
  • 12/2021: ICSE NIER paper on Graph Neural Networks analysis
  • 9/2021: OOPSLA'21 research paper on capturing runtime complexity of recursive programs (πŸ‘ Didier and KimHao)
  • 9/2021: TSE'21 journal paper on symbolic states and dynamic invariant inference (πŸ‘ KimHao)
  • 8/2021: 🎁 Received a gift from Meta/Facebook to work on build systems and symbolic execution
  • 8/2021: 🎁 Received an NSF Collaborative (Medium) Grant to dynamically analyze program liveness and safety properties
  • 8/2021: πŸŽ‰ Farewell party!!!
  • 7/2021: Three ASE Tool papers (πŸ‘ KimHao and Guolong)
  • 6/2021: πŸš€ Moving to George Mason University (Fall'21)
  • 5/2021: πŸ… Outstanding Undergraduate Research Assistant Award from UNL CSE (πŸ‘ KimHao)
  • 5/2021: πŸŽ“ Alexey defended his Master's thesis
  • 4/2021: πŸ… KimHao received the Top Presentation Award on analyzing configurable systems at the Nebraska Student Research Days
  • 12/2020: Three research papers accepted at ICSE'21 on inferring interactions in configurable software and debugging and repairing Alloy specifications (πŸ‘ KimHao and Guolong)
  • 12/2020: 🎁 Received a Faculty Seed Grant Award from UNL
  • 10/2020: OOPSLA'20 research paper on using dynamically inferred nonlinear invariants to prove program termination and non-termination
  • 9/2020: 🎁 UCare Award from UNL and the Garmin Scholarship Award (πŸ‘ KimHao)
  • 8/2020: FSE SEAD workshop paper on using recurrence relations to analyze program complexity (πŸ‘ Alexey and Didier)
  • 7/2020: ICSME NIER paper on using symbolic execution to analyze the Linux build system (πŸ‘ KimHao)
  • 7/2020: ICSME Doctoral Symposium paper on Alloy fault localization and repair (πŸ‘ Guolong)
  • 3/2020: 🎁 Received the NSF CISE Research Initiation Initiative (CRII) Award on analyzing the Linux build system. Press: UNL
  • 3/2020: KimHao (freshman) joined as an undergraduate researcher
  • 1/2020: Alexey joined as an M.S. student
  • 9/2019: OOPSLA'19 research paper on using algebraic specifications to aid program synthesis
  • 9/2019: Didier joined as a PhD student
  • 6/2019: πŸ…πŸ… Received an ACM SIGSOFT 10-year Most Influential Paper Award at ICSE (Software Engr) on program repair. Also an ACM SIGEVO 10-year Impact Award at GECCO (Evolutionary Computing) on using genetic programming to fix bugs
  • 3/2019: PLDI'19 research paper on dynamic invariant inference in separation logic (πŸ‘ Guolong)
  • 1/2019: 🎁 Received a 3-year grant from the Army Research Office to work on program errors prediction and avoidance

People

Lab activities/photos

Alumni
  • Stefania Piciorea (B.S., graduated 2025)
  • KimHao Nguyen (B.S., graduated 2023, Jump Trading)
  • Guolong Zheng (PhD, graduated 2022, Minjiang University)
  • Alexey Malyshev (M.S., graduated 2021, Oracle)
Joining us
  • Read about our lab culture and GMU CS dept. Also read "Should you contact a US professor? How to do so correctly?" from the CS PhD Admission Demystify Handbook.
  • Contribute to our open-source projects, e.g., an easy one to work on is csconfs---a webapp to track CS conferences. You can creating Github issues and pull requests for the project. This shows you're serious about working with us and allows us to evaluate your skills.
  • Note: Unless there is a strong match and interest, we will not be able to respond to your emails, especially if they are generic.

Awards

Lab's

PI's

Press Release

Research

Software Engineering; Formal Methods; Automated Reasoning; Program Analysis; Program Verification; AI Safety and Robustness, Dynamic and Static Analysis; SMT/SAT Solving


Publications

Google Scholars for Roars

Full List of Papers

Book and Misc. Writing

  1. πŸ“š Neural Network Verification Textbook: an ongoing work on an introductory textbook for neural network verification
  2. πŸ“š PhD Demystify: a book to help students understand and navigate the PhD admission process in Computer Science in the US
  3. πŸ“ Roars Lab Culture and Advising Guide
  4. πŸ“ realgmucs.github.io/stats: Useful Stats about GMU CS dept
  5. πŸ“ https://roars.dev/phd-cs-us/viet-cs-profs-us: Vietnamese professors in CS

Software

More
  • NLA-Digbench: this SV-COMP benchmark contains various program with nonlinear invariants and properties.
  • Solving NP-Complete problems
    • AntColor: an ant-based heuristics for the graph coloring problem and its generalizations
    • AMC: a fast, parallel ant-based algorithm for the maximum clique problem
    • NP Benchmarks: a comprehensive collection of benchmarks (in DIMACS format) for various NP-Complete problems including graph coloring, maximum clique, vertex cover, and spanning tree