Logo PTI
Polish Information Processing Society
Logo FedCSIS

Annals of Computer Science and Information Systems, Volume 18

Proceedings of the 2019 Federated Conference on Computer Science and Information Systems

Identification of Heuristics for Assessing the Usability of Websites of Public Administration Units


DOI: http://dx.doi.org/10.15439/2019F307

Citation: Proceedings of the 2019 Federated Conference on Computer Science and Information Systems, M. Ganzha, L. Maciaszek, M. Paprzycki (eds). ACSIS, Vol. 18, pages 651657 ()

Full text

Abstract. A very important aspect of modern websites is their usability. Thanks to modern, and constantly developing technologies it is possible to create user-friendly services for each user. The usefulness of online services may be considered in terms of their functionality, clarity, and accessibility. It is particularly important that these criteria are met by public administration websites. The aim of this paper is to present the most common usability errors identified on the websites of public administration units as well as to indicate the links between particular types of problems and traditional heuristics of Jakob Nielsen. The survey was conducted by evaluating the websites of the Public Information Bulletin in Poland (BIP, which stands for ``Biuletyn Informacji Publicznej''), which are supposed to provide universal access to public information by the citizens of the country. A heuristic method (based on J. Nielsen's heuristics) was used to evaluate 60 websites. The errors obtained were grouped into 14 categories. Each of the error groups was assessed by an expert in terms of its importance for the overall assessment of the website's usefulness. The analysis of relations between the identified categories of errors and heuristics of Jakob Nielsen indicates a need for specifying heuristics in the context of evaluating the usability and availability of public administration websites.


  1. ISO 9241-210: 2010. Ergonomics of human-system interaction – Part 210: Human-centred design for interactive systems. https://www.iso.org/obp/ui/#iso:std:iso:9241:-210:ed-1:v1:en:en,%20dostp%20dnia%2013.05.2016 (12.01.2018).
  2. Qui˜nones, D., Rusu, C., 2017. How to develop usability heuristics: A systematic literature review. Computer Standards & Interfaces, vol. 53, pp. 89–122. http://dx.doi.org/10.1016/j.csi.2017.03.009.
  3. Inostroza, R., Rusu, C., Roncagliolo, S., Rusu, V., Collazos, C. A., 2016. Developing SMASH: A set of smartphone’s usability heuristics. Computer Standards & Interfaces, 43, pp. 40-52.
  4. Nielsen, J., 2012. Usability 101: Introduction to Usability. https://www.nngroup.com/articles/usability-101-introduction-to-usability (29.10.2018).
  5. Khalid H., Hedge A., Ahram T., Advances in Ergonomics Modeling and Usability Evaluation, CRC Press 2011.
  6. Paplauskaite, L., 2014. Usability and usufulness in UX Web Design. https://bitzesty.com/2014/05/15/usability-and-usefulness-in-ux-web-design (20.07.2018).
  7. Lawton Henry, S., 2019. Introduction to Web Accessibility. https://www.w3.org/WAI/fundamentals/accessibility-intro (1.05.2019).
  8. Robbins, J. N., 2014. Projektowanie stron internetowych, Przewodnik dla początkujących webmasterów po HTML5, CSS3 i grafice. Wydawnictwo Helion, Gliwice.
  9. Phyo, A., 2003. Web Design, Projektowanie atrakcyjnych stron WWW. Wydawnictwo Helion, Gliwice.
  10. Streich, S., Accessibility is NOT just for people with disabilities. https://vimm.com/website-accessibility (1.05.2019).
  11. Morville, P., 2004. User Experience Design. http://semanticstudios.com/user_experience_design (20.07.2018).
  12. Waddell, C., Regan, B., Lawton Henry, S., Burks, M. R., Thatcher, J., Urban, M. D., Bohman, P., 2002. Constructing Accessible Web Sites. Apress Publishing House.
  13. Lawton Henry, S., Abou-Zahra, S., White, K., 2016. Accessibility, Usability, and Inclusion. https://www.w3.org/WAI /fundamentals/accessibility-usability-inclusion (1.05.2019).
  14. Fernandez, A., Insfran, E., Abrahão, S., 2011. Usability evaluation methods for the web: A systematic mapping study, Information and Software Technology, vol. 53, Issue 8, pp. 789-817. doi.org/10.1016/j.infsof.2011.02.007.
  15. Lazar, J., Feng, J. H., Hochheiser, H., 2010. Research Methods in Human-computer Interaction. John Wiley & Sons.
  16. Paz, F., Pow-Sang, J. A., 2016. A Systematic Mapping Review of Usability Evaluation Methods for Software Development Process. International Journal of Software Engineering and Its Applications, Vol. 10, No. 1 (2016), pp. 165-178. http://dx.doi.org/10.14257/ijseia.2016.10.1.16.
  17. Sikorski, M., 2012. User-system Interaction Design in IT Projects. Gdańsk University of Technology.
  18. Tullis, T., Albert, B., 2008. Measuring the User Experience. Collecting, Analyzing, and Presenting Usability Metrics. Morgan Kaufmann Publishers, Amsterdam.
  19. Scholtz, J., 2004. Usability evaluation. http://notification.etisalat.com.eg/etisalat/templates.backup.16082011/582/Usability%2520Evaluation_rev1%5B1%5D.pdf.
  20. Philips, M., 2017. Elevate Your UX with a Heuristic Analysis – How to Run a Usability Evaluation, https://www.linkedin.com /pulse/elevate-your-ux-heuristic-analysis-how-run-miklos-philips (15.09.2018).
  21. Gerhardt-Powals, J., 1996. Cognitive engineering principles for enhancing human-computer performance. International Journal of Human-Computer Interaction. Volume 8 Issue 2, April-June 1996, pp. 189-211.
  22. Weinschenk, S., Barker, D. T., 2000. Designing Effective Speech Interfaces. Wiley.
  23. Shneiderman, B., 2006. The Eight Golden Rules of Interface Design. Designing the User Interface. 6th Edition, Section 3.3.4.
  24. Inostroza, R., Rusu, C., Roncagliolo, S., Jimenez, C., Rusu, V., 2012. Usability Heuristics for Touchscreen-based Mobile Devices. IEEE Xplore, http://dx.doi.org/10.1109/ITNG.2012.134.
  25. Tognazzini, B., 2014. First Principles of Interaction Design (Revised & Expanded). askTog. https://asktog.com/atc/principles-of-interaction-design (9.05.2019).
  26. Douglas, S., 2017. 7 Usability Heuristics That All UI Designers Should Know. Usability Geek. https://usabilitygeek.com/usability-heuristics-ui-designers-know (19.01.2019).
  27. Jimenez, C., Lozada, P., Rosas, P., 2016. Usability heuristics: A systematic review. In: 11th Colombian Computing Conference, 27-30.09.2016, Popayan, Colombia, http://dx.doi.org/10.1109 /ColumbianCC.2016.7750805.
  28. Dourado, M. A. D., Canedo E. D., 2018. Usability Heuristics for Mobile Applications – A Systematic Review. In: In Proceedings of the 20th International Conference on Enterprise Information Systems (ICEIS’2018), vol. 2, pp. 483-494 http://dx.doi.org/10.5220/0006781404830494.
  29. Section 508 of the Rehabilitation Act. - 29 U.S.C. § 798. Section 508 - Electronic and Information Technology. https://www.fcc.gov/general/section-508-rehabilitation-act (20.02.2019)
  30. Barrierefreie Informationstechnik-Verordnung — BITV 2.0. https://www.barrierefreies-webdesign.de/bitv/bitv-2.0.html (20.02.2019)
  31. Accessibilità siti web. AgID promuove l’accessibilità dei siti web in relazione alla normativa vigente. https://www.agid.gov.it/it/design-servizi/accessibilita-siti-web (20.02.2019)
  32. Miasta największe pod względem liczby ludności. Główny Urząd Statystyczny. https://stat.gov.pl/statystyka-regionalna/rankingi-statystyczne/miasta-najwieksze-pod-wzgledem-liczby-ludnosci (1.02.2019)