SPLASH 2020
Sun 15 - Sat 21 November 2020 Online Conference
Sun 15 Nov 2020 08:20 - 09:00 at SPLASH-VII - Posters Session 1
Sun 15 Nov 2020 20:20 - 21:00 at SPLASH-VII - Posters Session 1 Mirror

We propose type-aware operator mutation, a simple, but unusually effective approach for testing SMT solvers. The key idea is to mutate operators of conforming types within the seed formulas to generate well-typed mutant formulas. These mutant formulas are then used as the test cases for SMT solvers. We realized type-aware operator mutation within the OpFuzz tool and used it to stress-test Z3 and CVC4, two state-of-the-art SMT solvers. Type-aware operator mutations are unusually effective: During nine months of extensive testing with OpFuzz, we reported 909 bugs in Z3 and CVC4, out of which 632 bugs were confirmed and 531 of the confirmed bugs were fixed by the developers. The detected bugs are highly diverse — we found bugs of many different types (soundness bugs, invalid model bugs, crashes, etc.), logics and solver configurations. We have further conducted an in-depth study on the bugs found by OpFuzz. The study results show that the bugs found by OpFuzz are of high quality. Many of them affect core components of the SMT solvers’ codebases, and some required major changes for the developers to fix. Among the 909 bugs found by OpFuzz, 130 were soundness bugs, the most critical bugs in SMT solvers, and 501 were in the default modes of the solvers. Notably, OpFuzz found 16 critical soundness bugs in CVC4, which has proved to be a very stable SMT solver.

Sun 15 Nov
Times are displayed in time zone: Central Time (US & Canada) change

08:20 - 09:00: Posters Session 1Posters at SPLASH-VII +12h
08:20 - 09:00
Poster
Formulog: Datalog for SMT-based Static AnalysisOOPSLA
Posters
Aaron BembenekHarvard University, Michael GreenbergPomona College, Stephen ChongHarvard University
08:20 - 09:00
Poster
Analogy-Making as a Core Primitive in the Software Engineering ToolboxOnward! Papers
Posters
Matthew SotoudehUniversity of California, Davis, Aditya V. ThakurUniversity of California, Davis
08:20 - 09:00
Poster
Row and Bounded Polymorphism via Disjoint PolymorphismECOOP
Posters
Ningning XieThe University of Hong Kong, Bruno C. d. S. OliveiraUniversity of Hong Kong, Xuan BiThe University of Hong Kong, Tom SchrijversKU Leuven
08:20 - 09:00
Poster
Gradual Verification of Recursive Heap Data StructuresOOPSLA
Posters
Jenna WiseCarnegie Mellon University, Johannes BaderJane Street, Cameron WongJane Street, Jonathan AldrichCarnegie Mellon University, Éric TanterUniversity of Chile, Joshua SunshineCarnegie Mellon University
08:20 - 09:00
Poster
Knowing When to Ask: Sound Scheduling of Name Resolution in Type Checkers Derived from Declarative SpecificationsOOPSLA
Posters
Arjen RouvoetDelft University of Technology, Hendrik van AntwerpenDelft University of Technology, Casper Bach PoulsenDelft University of Technology, Robbert KrebbersRadboud University Nijmegen, Eelco VisserDelft University of Technology
08:20 - 09:00
Poster
Owicki-Gries Reasoning for C11 RARECOOP
Posters
Sadegh DalvandiUniversity of Surrey, Simon DohertyUniversity of Sheffield, Brijesh DongolUniversity of Surrey, Heike WehrheimPaderborn University
08:20 - 09:00
Poster
Demystifying DependenceOnward! Papers
Posters
08:20 - 09:00
Poster
Can Advanced Type Systems Be Usable? An Empirical Study of Ownership, Assets, and Typestate in ObsidianOOPSLA
Posters
Michael CoblenzUniversity of Maryland at College Park, Jonathan AldrichCarnegie Mellon University, Brad A. MyersCarnegie Mellon University, Joshua SunshineCarnegie Mellon University
08:20 - 09:00
Poster
Multiparty Session Programming with Global Protocol CombinatorsECOOP
Posters
Keigo ImaiGifu University, Rumyana NeykovaBrunel University London, Nobuko YoshidaImperial College London, Shoji YuenNagoya University
08:20 - 09:00
Poster
Static Race Detection and Mutex Safety and Liveness for Go ProgramsECOOP
Posters
Julia GabetImperial College London, Nobuko YoshidaImperial College London
08:20 - 09:00
Poster
CAMP: Cost-Aware Multiparty Session ProtocolsOOPSLA
Posters
David Castro-PerezImperial College London, Nobuko YoshidaImperial College London
08:20 - 09:00
Poster
A Case Study in Language-Based Security: Building an I/O Library for WyvernOnward! Papers
Posters
Jennifer FishCarnegie Mellon University, Darya MelicherGoogle, Jonathan AldrichCarnegie Mellon University
08:20 - 09:00
Poster
On the Unusual Effectiveness of Type-aware Operator Mutations for Testing SMT SolversOOPSLA
Posters
Dominik WintererETH Zurich, Chengyu ZhangEast China Normal University, Zhendong SuETH Zurich
08:20 - 09:00
Poster
Reshape Your Layouts, Not Your Programs: A Safe Language Extension for Better Cache LocalityECOOP
Posters
Alexandros TasosImperial College London, Juliana Franco, Sophia DrossopoulouImperial College London, Tobias WrigstadUppsala University, Sweden, Susan EisenbachImperial College London
08:20 - 09:00
Poster
A Type-Directed Operational Semantics for a Calculus with a Merge OperatorECOOP
Posters
Xuejing HuangThe University of Hong Kong, Bruno C. d. S. OliveiraUniversity of Hong Kong
08:20 - 09:00
Poster
Geometry Types for Graphics ProgrammingOOPSLA
Posters
Dietrich GeislerCornell University, Irene YoonUniversity of Pennsylvania, Aditi KabraCarnegie Mellon University, Horace HeCornell University, Yinnon SandersCornell University, Adrian SampsonCornell University
20:20 - 21:00: Posters Session 1 MirrorPosters at SPLASH-VII
20:20 - 21:00
Poster
Analogy-Making as a Core Primitive in the Software Engineering ToolboxOnward! Papers
Posters
Matthew SotoudehUniversity of California, Davis, Aditya V. ThakurUniversity of California, Davis
20:20 - 21:00
Poster
Static Race Detection and Mutex Safety and Liveness for Go ProgramsECOOP
Posters
Julia GabetImperial College London, Nobuko YoshidaImperial College London
20:20 - 21:00
Poster
On the Unusual Effectiveness of Type-aware Operator Mutations for Testing SMT SolversOOPSLA
Posters
Dominik WintererETH Zurich, Chengyu ZhangEast China Normal University, Zhendong SuETH Zurich
20:20 - 21:00
Poster
A Type-Directed Operational Semantics for a Calculus with a Merge OperatorECOOP
Posters
Xuejing HuangThe University of Hong Kong, Bruno C. d. S. OliveiraUniversity of Hong Kong
20:20 - 21:00
Poster
Knowing When to Ask: Sound Scheduling of Name Resolution in Type Checkers Derived from Declarative SpecificationsOOPSLA
Posters
Arjen RouvoetDelft University of Technology, Hendrik van AntwerpenDelft University of Technology, Casper Bach PoulsenDelft University of Technology, Robbert KrebbersRadboud University Nijmegen, Eelco VisserDelft University of Technology
20:20 - 21:00
Poster
A Case Study in Language-Based Security: Building an I/O Library for WyvernOnward! Papers
Posters
Jennifer FishCarnegie Mellon University, Darya MelicherGoogle, Jonathan AldrichCarnegie Mellon University
20:20 - 21:00
Poster
CAMP: Cost-Aware Multiparty Session ProtocolsOOPSLA
Posters
David Castro-PerezImperial College London, Nobuko YoshidaImperial College London
20:20 - 21:00
Poster
Owicki-Gries Reasoning for C11 RARECOOP
Posters
Sadegh DalvandiUniversity of Surrey, Simon DohertyUniversity of Sheffield, Brijesh DongolUniversity of Surrey, Heike WehrheimPaderborn University
20:20 - 21:00
Poster
Formulog: Datalog for SMT-based Static AnalysisOOPSLA
Posters
Aaron BembenekHarvard University, Michael GreenbergPomona College, Stephen ChongHarvard University
20:20 - 21:00
Poster
Demystifying DependenceOnward! Papers
Posters
20:20 - 21:00
Poster
Row and Bounded Polymorphism via Disjoint PolymorphismECOOP
Posters
Ningning XieThe University of Hong Kong, Bruno C. d. S. OliveiraUniversity of Hong Kong, Xuan BiThe University of Hong Kong, Tom SchrijversKU Leuven
20:20 - 21:00
Poster
Reshape Your Layouts, Not Your Programs: A Safe Language Extension for Better Cache LocalityECOOP
Posters
Alexandros TasosImperial College London, Juliana Franco, Sophia DrossopoulouImperial College London, Tobias WrigstadUppsala University, Sweden, Susan EisenbachImperial College London
20:20 - 21:00
Poster
Gradual Verification of Recursive Heap Data StructuresOOPSLA
Posters
Jenna WiseCarnegie Mellon University, Johannes BaderJane Street, Cameron WongJane Street, Jonathan AldrichCarnegie Mellon University, Éric TanterUniversity of Chile, Joshua SunshineCarnegie Mellon University
20:20 - 21:00
Poster
Multiparty Session Programming with Global Protocol CombinatorsECOOP
Posters
Keigo ImaiGifu University, Rumyana NeykovaBrunel University London, Nobuko YoshidaImperial College London, Shoji YuenNagoya University
20:20 - 21:00
Poster
Can Advanced Type Systems Be Usable? An Empirical Study of Ownership, Assets, and Typestate in ObsidianOOPSLA
Posters
Michael CoblenzUniversity of Maryland at College Park, Jonathan AldrichCarnegie Mellon University, Brad A. MyersCarnegie Mellon University, Joshua SunshineCarnegie Mellon University
20:20 - 21:00
Poster
Geometry Types for Graphics ProgrammingOOPSLA
Posters
Dietrich GeislerCornell University, Irene YoonUniversity of Pennsylvania, Aditi KabraCarnegie Mellon University, Horace HeCornell University, Yinnon SandersCornell University, Adrian SampsonCornell University