Small-Step Live Programming by Example

Ferdowsifard, Kasra; Ordookhanians, Allen; Peleg, Hila; Lerner, Sorin; Polikarpova, Nadia

doi:10.1145/3379337.3415869

Cited by 30 publications

(7 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…WebRobot adopts a human-in-theloop interaction model which has shown to be an effective way to incorporate human inputs when training AI systems in the HCI community [19,45]. This model has been used in the context of program synthesis, mostly interactive PBE [23,41,43,51,60,65]. In contrast, our work incorporates human inputs in PBD and proposes a new human-in-the-loop model.…”

Section: Related Workmentioning

confidence: 99%

WebRobot: Web Robotic Process Automation using Interactive Programming-by-Demonstration

Dong¹,

Huang²,

Lam³

et al. 2022

Preprint

View full text Add to dashboard Cite

It is imperative to democratize robotic process automation (RPA), as RPA has become a main driver of the digital transformation but is still technically very demanding to construct, especially for non-experts. In this paper, we study how to automate an important class of RPA tasks, dubbed web RPA, which are concerned with constructing software bots that automate interactions across data and a web browser. Our main contributions are twofold. First, we develop a formal foundation which allows semantically reasoning about web RPA programs and formulate its synthesis problem in a principled manner. Second, we propose a web RPA program synthesis algorithm based on a new idea called speculative rewriting. This leads to a novel speculate-and-validate methodology in the context of rewrite-based program synthesis, which has also shown to be both theoretically simple and practically efficient for synthesizing programs from demonstrations. We have built these ideas in a new interactive synthesizer called WebRobot and evaluate it on 76 web RPA benchmarks. Our results show that WebRobot automated a majority of them effectively. Furthermore, we show that WebRobot compares favorably with a conventional rewrite-based synthesis baseline implemented using egg. Finally, we conduct a small user study demonstrating WebRobot is also usable. CCS Concepts:• Software and its engineering → Automatic programming.

show abstract

Section: Related Workmentioning

confidence: 99%

WebRobot: Web Robotic Process Automation using Interactive Programming-by-Demonstration

Dong¹,

Huang²,

Lam³

et al. 2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Besides, many new interaction models [14,16,21,25,41] are proposed make PBE and PBD tools easier-to-use. As our paper focuses on the synthesis specification and algorithm design, its interaction model is basic.…”

Section: Related Workmentioning

confidence: 99%

Synthesizing Analytical SQL Queries from Computation Demonstration

Zhou,

Bodik,

Cheung

et al. 2022

Preprint

View full text Add to dashboard Cite

Analytical SQL is widely used in modern database applications and data analysis. However, its partitioning and grouping operators are challenging for novice users. Unfortunately, programming by example, shown effective on standard SQL, are less attractive because examples for analytical queries are more laborious to solve by hand.To make demonstrations easier to create, we designed a new end-user specification, programming by computation demonstration, that allows the user to demonstrate the task using a (possibly incomplete) cell-level computation trace. This specification is exploited in a new abstraction-based synthesis algorithm to prove that a partially formed query cannot be completed to satisfy the specification, allowing us to prune the search space.We implemented our approach in a tool named Sickle and tested it on 80 real-world analytical SQL tasks. Results show that even from small demonstrations, Sickle can solve 76 tasks, in 12.8 seconds on average, while the prior approaches can solve only 60 tasks and are on average 22.5× slower. Our user study with 13 participants reveals that our specification increases user efficiency and confidence on challenging tasks.

show abstract

“…In 2013, Tanimoto [40] extended these four initial levels to cover programs that can predict the user's intents. Recently, the intersection of live programming and language synthesis has seen a high interest in the community, for example how part of a program could be generated live using snippets of data [11] or how synthetic data can be created at design time to evaluate a loop [25].…”

Section: Robot Live Programmingmentioning

confidence: 99%

Situated Live Programming for Human-Robot Collaboration

Senft

Hagenow

Radwin

et al. 2021

The 34th Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

Figure 1: This paper presents an end-user programming approach for collaborative robots, called situated live programming (SLP), to perform tasks that require responsiveness and coordination. Left: The user incrementally specifies an assembly task as trigger-action pairs. Right: An example collaborative program created using SLP. The triggers, human actions (blue), and robot actions (green) are mapped on a task timeline.

show abstract

Small-Step Live Programming by Example

Cited by 30 publications

References 32 publications

WebRobot: Web Robotic Process Automation using Interactive Programming-by-Demonstration

WebRobot: Web Robotic Process Automation using Interactive Programming-by-Demonstration

Synthesizing Analytical SQL Queries from Computation Demonstration

Situated Live Programming for Human-Robot Collaboration

Contact Info

Product

Resources

About