Logo PTI
Polish Information Processing Society
Logo FedCSIS

Annals of Computer Science and Information Systems, Volume 11

Proceedings of the 2017 Federated Conference on Computer Science and Information Systems

Measuring dimensions of Software Engineering projects' success in Academic context


DOI: http://dx.doi.org/10.15439/2017F295

Citation: Proceedings of the 2017 Federated Conference on Computer Science and Information Systems, M. Ganzha, L. Maciaszek, M. Paprzycki (eds). ACSIS, Vol. 11, pages 12071210 ()

Full text

Abstract. The notion of success is unsubstantial, complex and domain-specific. Software companies have been exploring its different aspects and aiming to put forward measures to capture and evaluate them. In this paper three main dimensions of success have been elicited based on previous industrial studies: project quality, project efficiency along with social factors and stakeholder's satisfaction. By investigation of their assessment criteria in commercial context a set of metrics and measures was determined and adapted to provide a structured evaluation approach for projects developed in academic setting. Professionalizing teaching and assessment process is an attempt to close a gap between workforce's expectations towards new graduates and the outcomes of their university education.


  1. G. Pierson, "C. Undergraduate Studies: Yale College", Yale Book of Numbers. Historical Statistics of the College and University 1701-1976, New Haven: Yale Office of Institutional Research, 1983
  2. N. Postman, "Technopoly The Surrender of Culture to Technology", New York: Alfred A. Knopf, 1992
  3. P. Ralph, and P. Kelly, "The Dimensions of Software Engineering Success", 2014
  4. E. Kupiainen and M. V. MaÌĹntylaÌĹ and J. Itkonen, "Using metrics in Agile and Lean Software Development âĂŞ A systematic literature review of industrial studies", 2015
  5. M. Unterkalmsteiner and T. Gorschek and A. K. M. Moinul Islam, "Evaluation and Measurement of Software Process Improvement – A Systematic Literature Review", 2011
  6. D. Dalcher and O. Benediktsson and H. Thorbergsson, "Development Life Cycle Management: A Multiproject Experiment", 2005
  7. D. Dalcher, "Life Cycle Design and Management", 2002
  8. F. Macias and M. Holcombe and M. Gheorghe, "A Formal Experiment Comparing Extreme Programming with Traditional Software Construction, 2003
  9. B. Bruegge and S. Krusche and L. Alperowitz, "Software Engineering Project Courses with Industrial Clients", 2015
  10. Z. Naboulsi, "Code Metrics – Cyclomatic Complexity", MSDN Ultimate Visual Studio Tips and Tricks Blog, https://blogs.msdn.microsoft.com/zainnab/2011/05/17/code-metrics-cyclomatic-complexity, 2017
  11. McCabe Associates, "Integrated Quality" as part of CS699 Professional Seminar in Computer Science, 1999
  12. B. Kitchenham and S. L. Pfleeger, "Software Quality: The Elusive Target’, IEEE Software, 1996
  13. L. Rosenberg and T. Hammer, "Software metrics and reliability", NASA GSFC, 1998
  14. L. Rosenberg and T. Hammer, "Metrics for Quality Assurance and Risk Assessment", Proceedings of 11th International Software Quality Week, USA, 1998
  15. C. F. Kemerer and S. R. Chidamber, "A Metrics Suite for Object Oriented Design", IEEE Transactions on Software Engineering 1994
  16. Java Code Geeks, "Java Tools: Source Code Optimization and Analysis", https://www.javacodegeeks.com/2011/07/java-tools-source-code-optimization-and.html, 2017
  17. G. Booch, "Object Oriented Design: With Applications", 1991
  18. M. Olszewska and J. Heidenberg and M. Weijola, "Quantitatively measuring a large-scale agile transformation", Journal of Systems and Software, 2016
  19. M. Hoegl and H. G. Gemuenden, "Teamwork Quality and the Success of Innovative Projects: A Theoretical Concept and Empirical Evidence", Organization Science, vol. 12, 2001
  20. A. Carron and L. Brawley, "Cohesion: Conceptual and Measurement Issues", Small Group Research 31, 2000
  21. E. Salas and R. Grossman, "Measuring Team Cohesion: Observations from the Science", Human Factors, vol. 57, 2015
  22. M. Casey-Campbell and M. L. Martens, "Sticking it all together: A critical assessment of the group cohesion-performance literature", 2008
  23. C. A. Wellington and T. Briggs, "Comparison of Student Experiences with Plan-Driven and Agile Methodologies", 35th ASEE/IEEE Frontiers in Education Conference, 2015
  24. A. V. Carron, L. R. Brawley, "G.E.Q. The Group Environment Questionnaire Test Manual", Fitness Information Technology, Inc., 2002
  25. F. van Boxmeer, C. Verwijs, "A direct measure of Morale in the Netherlands Armed Forces Morale Survey: ’theoretical puzzle, empirical testing and validation", Presented at Internation Military Testing Association Symposium (IMTA), 2007
  26. C. Verwijs, "Agile Teams: Don’t use happiness metrics, measure Team Morale", Agilistic blog, retrieved 05.2017
  27. M. Unterkalmsteiner and T. Gorschek, "Evaluation and Measurement of Software Process Improvement – A Systematic Literature Review", IEEE Transactions on Software Engineering, 2012
  28. S. Ilieva and P. Ivanov and E. Stefanova, "Analyses of an agile methodology implementation", Proceedings of 30th EUROMICRO Conference, 2004
  29. P. Abrahamsson, "Extreme Programming: First Results from a Controlled Case Study", Proceedings of 29th EUROMICRO Conference, 2003
  30. P. Middleton and P. S. Taylor, "Lean principles and techniques for improving the quality and productivity of software development projects: a case study", International Journal of Productivity and Quality Management, 2007
  31. M. Ochodek and J. Nawrocki, "Simplifying effort estimation based on Use Case Points", Information and Software Technology, 2011
  32. R. Chillarege and I. S. Bhandari, "Orthogonal defect classification-a concept for in-process measurements", IEEE Transactions on Software Engineering, 1992
  33. M. Butcher and H. Munro, "Improving Software Testing via ODC: Three Case Studies", IBM Systems Journal, 2002
  34. A. Begel and B. Simon, "Struggles of New College Graduates in their First Software Development Job", Proceedings of 39th SIGCSE, 2008
  35. E. Brechner, "Things They Would Not Teach Me of in College: What Microsoft Developers Learn Later",2003
  36. M. Weuisfeld, "The Importance of Object-Oriented Programming in the Era of Mobile Development", InformtIT, Pearson, http://www.informit.com/articles/article.aspx?p=2036576, 2013, retrieved 05.2017