Semantic Analysis of Web Pages for Task-based Personal Web Interactions

Abstract

Mobile widgets now form a new paradigm of simplified web. Probably, the best experience of the Web is when a user has a widget for every frequently executed task, and can execute it anytime, anywhere on any device. However, the current method of programmatically creating personally relevant mobile widgets for every user does not scale. Creation of these mobile web widgets requires application programming as well as knowledge of web-related protocols. Furthermore, these mobile widgets are also limited to smart phones with data connectivity and such smart phones form just about 15% of the mobile phones in India. How do we make web accessible on devices that most people can afford? How does one create simple relevant tasks for the numerous diverse needs of every person? In this thesis, we attempt to address these issues and propose a new method of web simplification that enables an end-user to create simple single-click widgets for a complex personal task - without any programming. The proposed solution enables even low-end phones to access personal web tasks over SMS and voice. We propose a system that enables end users to create personal widgets via programming-by-browsing. A new concept called Tasklets to represent a user’s personal interaction, and a notion of programming over websites using a Web Virtual Machine are presented. Ensuring correct execution of these end user widgets posed interesting problems in web data mining and required us to investigate new methods to characterize and semantically model browser-based interactions. In particular, an instruction set for programming over web sites, new domain-specific similarity measures using ontologies, algorithms for frequent-pattern mining of web interactions and change detection with a proof of its NP-completeness are presented. A quantitative metric to measure the interaction complexity of web browsing and a method of classifying relational data using semantics hidden in the schema are introduced as well. This new web architecture to enable multi-device access to user's personal tasks over low-end phones was piloted with real users, as a solution named SiteOnMobile, and has received very positive response.