Reverseorc: Reverse engineering of resizable user interface layouts with or-constraints

Yue Jiang; Wolfgang Stuerzlinger; Christof Lutteroth

doi:10.1145/3411764.3445043

Reverseorc: Reverse engineering of resizable user interface layouts with or-constraints

Yue Jiang, Wolfgang Stuerzlinger, Christof Lutteroth

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

15 Citations (SciVal)

10 Downloads (Pure)

Abstract

Reverse engineering (RE) of user interfaces (UIs) plays an important role in software evolution. However, the large diversity of UI technologies and the need for UIs to be resizable make this challenging. We propose ReverseORC, a novel RE approach able to discover diverse layout types and their dynamic resizing behaviours independently of their implementation, and to specify them by using OR constraints. Unlike previous RE approaches, ReverseORC infers fexible layout constraint specifcations by sampling UIs at diferent sizes and analyzing the diferences between them. It can create specifcations that replicate even some non-standard layout managers with complex dynamic layout behaviours. We demonstrate that ReverseORC works across diferent platforms with very diferent layout approaches, e.g., for GUIs as well as for the Web. Furthermore, it can be used to detect and fx problems in legacy UIs, extend UIs with enhanced layout behaviours, and support the creation of fexible UI layouts.

Original language	English
Title of host publication	CHI 2021 - Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
Subtitle of host publication	Making Waves, Combining Strengths
Publisher	Association for Computing Machinery
Number of pages	18
ISBN (Electronic)	9781450380966
DOIs	https://doi.org/10.1145/3411764.3445043
Publication status	Published - 6 May 2021
Event	2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths, CHI 2021 - Virtual, Online, Japan Duration: 8 May 2021 → 13 May 2021

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths, CHI 2021
Country/Territory	Japan
City	Virtual, Online
Period	8/05/21 → 13/05/21

Bibliographical note

Publisher Copyright:
© 2021 ACM.

Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.

Keywords

Adaptive user interface
Constraint-based layout
Orc layout
Resizable user interface
Reverse engineering

ASJC Scopus subject areas

Human-Computer Interaction
Computer Graphics and Computer-Aided Design
Software

Access to Document

10.1145/3411764.3445043Licence: CC BY

Cite this

Jiang, Y., Stuerzlinger, W., & Lutteroth, C. (2021). Reverseorc: Reverse engineering of resizable user interface layouts with or-constraints. In CHI 2021 - Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/3411764.3445043

Reverseorc: Reverse engineering of resizable user interface layouts with or-constraints. / Jiang, Yue; Stuerzlinger, Wolfgang; Lutteroth, Christof.
CHI 2021 - Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths. Association for Computing Machinery, 2021. (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter or section in a book/report/conference proceeding › Chapter in a published conference proceeding

Jiang, Y, Stuerzlinger, W & Lutteroth, C 2021, Reverseorc: Reverse engineering of resizable user interface layouts with or-constraints. in CHI 2021 - Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths. Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, 2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths, CHI 2021, Virtual, Online, Japan, 8/05/21. https://doi.org/10.1145/3411764.3445043

Jiang Y, Stuerzlinger W, Lutteroth C. Reverseorc: Reverse engineering of resizable user interface layouts with or-constraints. In CHI 2021 - Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths. Association for Computing Machinery. 2021. (Conference on Human Factors in Computing Systems - Proceedings). doi: 10.1145/3411764.3445043

Jiang, Yue ; Stuerzlinger, Wolfgang ; Lutteroth, Christof. / Reverseorc : Reverse engineering of resizable user interface layouts with or-constraints. CHI 2021 - Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths. Association for Computing Machinery, 2021. (Conference on Human Factors in Computing Systems - Proceedings).

@inproceedings{a8dc43852cd1401e8ac1945196439d76,

title = "Reverseorc: Reverse engineering of resizable user interface layouts with or-constraints",

abstract = "Reverse engineering (RE) of user interfaces (UIs) plays an important role in software evolution. However, the large diversity of UI technologies and the need for UIs to be resizable make this challenging. We propose ReverseORC, a novel RE approach able to discover diverse layout types and their dynamic resizing behaviours independently of their implementation, and to specify them by using OR constraints. Unlike previous RE approaches, ReverseORC infers fexible layout constraint specifcations by sampling UIs at diferent sizes and analyzing the diferences between them. It can create specifcations that replicate even some non-standard layout managers with complex dynamic layout behaviours. We demonstrate that ReverseORC works across diferent platforms with very diferent layout approaches, e.g., for GUIs as well as for the Web. Furthermore, it can be used to detect and fx problems in legacy UIs, extend UIs with enhanced layout behaviours, and support the creation of fexible UI layouts.",

keywords = "Adaptive user interface, Constraint-based layout, Orc layout, Resizable user interface, Reverse engineering",

author = "Yue Jiang and Wolfgang Stuerzlinger and Christof Lutteroth",

note = "Publisher Copyright: {\textcopyright} 2021 ACM. Copyright: Copyright 2021 Elsevier B.V., All rights reserved.; 2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths, CHI 2021 ; Conference date: 08-05-2021 Through 13-05-2021",

year = "2021",

month = may,

day = "6",

doi = "10.1145/3411764.3445043",

language = "English",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

booktitle = "CHI 2021 - Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems",

address = "USA United States",

}

TY - GEN

T1 - Reverseorc

T2 - 2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths, CHI 2021

AU - Jiang, Yue

AU - Stuerzlinger, Wolfgang

AU - Lutteroth, Christof

PY - 2021/5/6

Y1 - 2021/5/6

N2 - Reverse engineering (RE) of user interfaces (UIs) plays an important role in software evolution. However, the large diversity of UI technologies and the need for UIs to be resizable make this challenging. We propose ReverseORC, a novel RE approach able to discover diverse layout types and their dynamic resizing behaviours independently of their implementation, and to specify them by using OR constraints. Unlike previous RE approaches, ReverseORC infers fexible layout constraint specifcations by sampling UIs at diferent sizes and analyzing the diferences between them. It can create specifcations that replicate even some non-standard layout managers with complex dynamic layout behaviours. We demonstrate that ReverseORC works across diferent platforms with very diferent layout approaches, e.g., for GUIs as well as for the Web. Furthermore, it can be used to detect and fx problems in legacy UIs, extend UIs with enhanced layout behaviours, and support the creation of fexible UI layouts.

AB - Reverse engineering (RE) of user interfaces (UIs) plays an important role in software evolution. However, the large diversity of UI technologies and the need for UIs to be resizable make this challenging. We propose ReverseORC, a novel RE approach able to discover diverse layout types and their dynamic resizing behaviours independently of their implementation, and to specify them by using OR constraints. Unlike previous RE approaches, ReverseORC infers fexible layout constraint specifcations by sampling UIs at diferent sizes and analyzing the diferences between them. It can create specifcations that replicate even some non-standard layout managers with complex dynamic layout behaviours. We demonstrate that ReverseORC works across diferent platforms with very diferent layout approaches, e.g., for GUIs as well as for the Web. Furthermore, it can be used to detect and fx problems in legacy UIs, extend UIs with enhanced layout behaviours, and support the creation of fexible UI layouts.

KW - Adaptive user interface

KW - Constraint-based layout

KW - Orc layout

KW - Resizable user interface

KW - Reverse engineering

UR - https://www.scopus.com/pages/publications/85106680158

U2 - 10.1145/3411764.3445043

DO - 10.1145/3411764.3445043

M3 - Chapter in a published conference proceeding

AN - SCOPUS:85106680158

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI 2021 - Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

Y2 - 8 May 2021 through 13 May 2021

ER -

Reverseorc: Reverse engineering of resizable user interface layouts with or-constraints

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA) - 2.0

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)

Cite this

Reverseorc: Reverse engineering of resizable user interface layouts with or-constraints

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Projects

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA) - 2.0

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)

Cite this