SPLASH 2020
Sun 15 - Sat 21 November 2020 Online Conference
Wed 18 Nov 2020 07:40 - 08:00 at SPLASH-I - W-1 Chair(s): Karim Ali, Sophia Drossopoulou
Wed 18 Nov 2020 19:40 - 20:00 at SPLASH-I - W-1 Chair(s): Patrick Lam, Julia Belyakova

In courses that involve programming assignments, giving meaningful feedback to students is an important challenge. Human beings can give useful feedback by manually grading the programs but this is a time-consuming, labor intensive, and usually boring process. Automatic graders can be fast and scale well but they usually provide poor feedback. Although there has been research on improving automatic graders, research on scaling and improving human grading is limited.

We propose to scale human grading by augmenting the manual grading process with an equivalence algorithm that can identify the equivalences between student submissions. This enables human graders to give targeted feedback for multiple student submissions at once. Our technique is conservative in two aspects. First, it identifies equivalence between submissions that are algorithmically similar, e.g., it cannot identify the equivalence between quicksort and mergesort. Second, it uses formal methods instead of clustering algorithms from the machine learning literature. This allows us to prove a soundness result that guarantees that submissions will never be clustered together in error. Despite only reporting equivalence when there is algorithmic similarity and the ability to formally prove equivalence, we show that our technique can significantly reduce grading time for thousands of programming submissions from an introductory functional programming course.

Wed 18 Nov
Times are displayed in time zone: Central Time (US & Canada) change

07:00 - 08:20: W-1OOPSLA at SPLASH-I +12h
Chair(s): Karim AliUniversity of Alberta, Sophia DrossopoulouImperial College London
07:00 - 07:20
Talk
OOPSLA
Breanna Devore-McDonaldUniversity of Massachusetts at Amherst, Emery D. BergerUniversity of Massachusetts at Amherst
Link to publication DOI Media Attached
07:20 - 07:40
Talk
OOPSLA
Tongtong XiangUniversity of Waterloo, Jeff Y. LuoUniversity of Waterloo, Werner DietlUniversity of Waterloo
Link to publication DOI Media Attached
07:40 - 08:00
Talk
OOPSLA
Joshua CluneCarnegie Mellon University, Vijay RamamurthyCarnegie Mellon University, Ruben MartinsCarnegie Mellon University, Umut A. AcarCarnegie Mellon University
Link to publication DOI Media Attached
08:00 - 08:20
Talk
OOPSLA
Yaoda ZhouUniversity of Hong Kong, Bruno C. d. S. OliveiraUniversity of Hong Kong, Jinxu ZhaoUniversity of Hong Kong
Link to publication DOI Media Attached
19:00 - 20:20: W-1OOPSLA at SPLASH-I
Chair(s): Patrick LamUniversity of Waterloo, Julia BelyakovaNortheastern University
19:00 - 19:20
Talk
OOPSLA
Breanna Devore-McDonaldUniversity of Massachusetts at Amherst, Emery D. BergerUniversity of Massachusetts at Amherst
Link to publication DOI Media Attached
19:20 - 19:40
Talk
OOPSLA
Tongtong XiangUniversity of Waterloo, Jeff Y. LuoUniversity of Waterloo, Werner DietlUniversity of Waterloo
Link to publication DOI Media Attached
19:40 - 20:00
Talk
OOPSLA
Joshua CluneCarnegie Mellon University, Vijay RamamurthyCarnegie Mellon University, Ruben MartinsCarnegie Mellon University, Umut A. AcarCarnegie Mellon University
Link to publication DOI Media Attached
20:00 - 20:20
Talk
OOPSLA
Yaoda ZhouUniversity of Hong Kong, Bruno C. d. S. OliveiraUniversity of Hong Kong, Jinxu ZhaoUniversity of Hong Kong
Link to publication DOI Media Attached