Efficient and robust image descriptor for GUI object classification
Dubrovina, Anastasia; Kisilev, Pavel; Freedman, Daniel; Schein, Sagi; Bergman, Ruth
Keyword(s): GUI object classification; image descriptor
Abstract: Graphical User Interface (GUI) object classification is essential for image-based software automation tools. The challenges posed by GUI object classification are significantly different from those in natural image classification. In this paper we present a novel image descriptor developed specifically for GUI objects; it is robust to various changes in the appearance of GUI objects, such as various screen resolution, "skin", as well as various operating system related. We use this image descriptor with Support Vector Machine classifier, and experimentally show the descriptor robustness to the above transformations, and its superior performance compared to existing image descriptors.
External Posting Date: October 22, 2011 [Fulltext]. Approved for External Publication
Internal Posting Date: October 22, 2011 [Fulltext]