Early Results from Automatic Accessibility Benchmarking of Public European Web Sites from the European Internet Accessibility Observatory (EIAO)

General Information

Download Early Results from Automatic Accessibility Benchmarking of Public European Web Sites from the European Internet Accessibility Observatory (EIAO) as PDF (869 KB) .

Title: Early Results from Automatic Accessibility Benchmarking of Public European Web Sites from the European Internet Accessibility Observatory (EIAO).
Author(s): Nils Ulltveit-Moe, Mikael Snaprud, Annika Nietzio, Morten Goodwin, Christian Thomsen.
Published date: September 2006.
Published at: Europen Design for All e-accessibility Network 2006

Abstract


Benchmarking of web accessibility is performed throughout Europe, to assess and raise awareness of web accessibility. The evaluation is often based on manual assessments with a high cost and with long intervals. The Web Content Accessibility Guidelines from W3C/WAI are the basis of most evaluations. Although the same guidelines are used, a range of different evaluation methodologies and scoring schemes are deployed across the member states. This makes it hard to compare and evaluate the web accessibility between the different countries within Europe. To improve this situation, the Unified Web Evaluation Methodology (UWEM) [1] is being developed as a joint effort between the projects in the Web Accessibility Benchmarking (WAB) cluster[2] to provide a unified way to evaluate web accessibility and ensure that both automatic large scale and manual assessment are possible within the same scheme. The European Internet Accessibility Observatory (EIAO)[3] is currently developing a prototype Observatory to perform large scale automatic accessibility benchmarking compatible with UWEM, with a plan to evaluate and present results from 10 000 public European web sites monthly.
We will in this paper present some initial results, including an analysis of these results, from an early prototype of the Observatory. The results will cover five carefully selected web sites from each EU and EFTA country. These sites are meant to be representative of each country and include the prime minister site, national bank, national library and selected sites among federal organisations such as president/monarchy, ministries, parliaments and national statistics agency. The evaluation results will be presented as scores according to UWEM, based on aggregated barrier probability indicators and also the number of detected barriers for each site and country. Analysis of the numbers shows that it is possible to use the UWEM approach to sample and aggregate indicators from a random set of web pages using automatic assessment until a required error margin has been achieved. In many cases, the variance between samples for a web site is low and thus allows a representative indicator to be based on small fraction of the total number of web pages of the web site.

BIBTEX


@article{moesnanieolstho2006,
author{Nils Ulltveit-Moe, Mikael Snaprud, Annika Nietzio, Morten Goodwin Olsen and Christian Thomsen},
title{Early Results from Automatic Accessibility Benchmarking of Public European Web Sites from the European Internet Accessibility Observatory (EIAO)},
booktitle{DfA},
year{2006},
month{September}
}

The author of this document is:
Morten Goodwin
E-mail address is:
morten.goodwin circle-a uia.no
Phone is:
+47 95 24 86 79