A benchmark for end-user structured data exploration and search user interfaces
MetadataShow full item record
During the years, it has been possible to assess significant improvements in the computational efficiency of Semantic Web search and exploration systems. However, it has been much harder to assess how well different semantic systems' user interfaces help their users. One of the key factors facilitating
the advancement of research in a particular field is the ability to compare the performance of different approaches. Though there are many such benchmarks in Semantic Web fields that have experienced significant improvements, this is not the case for Semantic Web user interfaces for data exploration. We propose and demonstrate the use of a benchmark for evaluating such user interfaces, which includes a set of typical user tasks and a well-defined procedure for assigning a measure of performance on those tasks to a semantic system. We have applied the benchmark to four such systems. Moreover, all the required resources to apply the benchmark are openly available online. We intend to initiate a community conversation that will lead to a generally accepted framework for comparing systems and for measuring, and thus encouraging, progress towards better semantic search and exploration tools.
Is part ofJournal Of Web Semantics, 2020, vol. 65, p. 1-12
Showing items related by title, author, creator and subject.
Brunetti Fernández, Josep Maria; García González, Roberto; Auer, Sören (IGI Global, 2013)The proliferation of Linked Open Data on the Web has increased the amount of data available for analysis and reuse. However, casual users find it difficult to explore and use Semantic Web Data due to the prevalence of ...
Brunetti Fernández, Josep Maria; García González, Roberto (Emerald, 2014)Purpose: The growing volumes of semantic data available in the web result in the need for handling the information overload phenomenon. The potential of this amount of data is enormous but in most cases it is very difficult ...
González Sánchez, José Luis; García González, Roberto; Brunetti Fernández, Josep Maria; Gil Iranzo, Rosa María; Gimeno Illa, Juan Manuel (Verlag der Technischen Universität Graz, 2013)In order to make Semantic Web tools more appealing to lay-users, a key factor is their Quality in Use, the quality of the user experience when interacting with them. To assess and motivate the improvement of the quality ...