Sun 15 - Sat 21 November 2020 Online Conference
Tue 17 Nov 2020 10:10 - 10:20 at SPLASH-VI - Keynote & Short Talks Chair(s): Roly Perera

Web automation can help users save time and energy by automatically performing tedious web tasks for them. However, macro scripts can be difficult for users to understand and edit, whether they are a colleague viewing the macro for the first time, or the macro creator trying to edit their macro months after it was first created. A major barrier to understanding macro scripts is that they lack user interface (UI) context. Users cannot look at a macro script and understand exactly what UI elements are being interacted with and what effect commands have on the UI. To explore how we might expand macro representations to include visual context, we built VizMac, a tool that lets users record their actions on a web page to generate a macro script and see their recording as an animation. Users can inspect the animation to see the UI state before and after a given line of code is run, and can see the UI elements corresponding to UI selectors in the code visually highlighted. These features help provide an understanding of the code that has been generated. Through a user study we saw that participants appreciated the animation features, but often still struggled to identify the source of errors when they occurred. We believe providing live feedback of the script’s outcome will help users identify the source of errors more efficiently and effectively, and we present several design goals and challenges.

Tue 17 Nov

Displayed time zone: Central Time (US & Canada) change

09:00 - 10:20
Keynote & Short TalksLIVE at SPLASH-VI
Chair(s): Roly Perera The Alan Turing Institute/University of Bristol

SPLASH-VI YouTube live stream

Liveliness, Reactivity, and Interactivity in the Future of Notebook Programming
K: Mary Beth Kery Carnegie Mellon University
Media Attached
Toward a Multi-Language and Multi-Environment Framework for Live Programming
Hidehiko Masuhara Tokyo Institute of Technology, Shusuke Takahashi Tokyo Institute of Technology, Yusuke Izawa Tokyo Institute of Technology, Youyou Cong Tokyo Institute of Technology
Pre-print Media Attached
Toward Providing Live Feedback in Web Automation IDEs
Rebecca Krosnick University of Michigan, Steve Oney University of Michigan
Media Attached