Logo PTI Logo FedCSIS

Proceedings of the 16th Conference on Computer Science and Intelligence Systems

Annals of Computer Science and Information Systems, Volume 25

Artificial Intelligence Project Success Factors: Moral Decision-Making with Algorithms

DOI: http://dx.doi.org/10.15439/2021F26

Citation: Proceedings of the 16th Conference on Computer Science and Intelligence Systems, M. Ganzha, L. Maciaszek, M. Paprzycki, D. Ślęzak (eds). ACSIS, Vol. 25, pages 379–390 ()

Full text

Abstract. The algorithms implemented through artificial intelligence (AI) and big data projects are used in life-and-death situations. While research exists to address varying aspects of moral decision-making with algorithms, the definition of project success is not readily available. Nevertheless, researchers place the burden of responsibility for ethical decisions from AI systems on the system developers. Using a systematic literature review, this research identified 70 AI project success factors in 14 groups related to moral decision-making with algorithms. It contributes to project management literature, specifically for AI projects. Project managers and sponsors can use the results during project planning and execution.

References

  1. N. Helberger, T. Araujo, and C. H. de Vreese, "Who is the fairest of them all? Public attitudes and expectations regarding automated decision-making," Computer Law & Security Review, vol. 39, pp. 1–16, Nov 2020.
  2. S. Garfinkel, J. Matthews, S. S. Shapiro, and J. M. Smith, "Toward algorithmic transparency and accountability," Commununicaions of the ACM, vol. 60, p. 5, 2017.
  3. J. A. Sherer, "When Is a Chair Not a Chair?: Big Data Algorithms, Disparate Impact, and Considerations of Modular Programming," Computer and Internet Lawyer, vol. 34, pp. 6–10, Aug 2017.
  4. S. Baruffaldi, B. v. Beuzekom, H. Dernis, D. Harhoff, N. Rao, D. Rosenfeld, et al., "Identifying and measuring developments in artificial intelligence," 2020.
  5. A. J. Shenhar, D. Dvir, O. Levy, and A. C. Maltz, "Project success: a multidimensional strategic concept," Long range planning, vol. 34, pp. 699-725, 2001.
  6. S. J. Bennett, "Investigating the Role of Moral Decision-Making in Emerging Artificial Intelligence Technologies," presented at the Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing, Austin, TX, USA, 2019.
  7. N. Manders-Huits, "Moral responsibility and IT for human enhancement," presented at the Proceedings of the 2006 ACM symposium on Applied computing, Dijon, France, 2006.
  8. K. Martin, "Ethical Implications and Accountability of Algorithms:," Journal of Business Ethics, vol. 160, pp. 835–850, Dec 2019.
  9. R. J. Turner and R. Zolin, "Forecasting Success on Large Projects: Developing Reliable Scales to Predict Multiple Perspectives by Multiple Stakeholders Over Multiple Time Frames," Project Management Journal, vol. 43, pp. 87––99, 2012.
  10. O. Zwikael and J. R. Meredith, "Who’s who in the project zoo? The ten core project roles," International Journal of Operations & Production Management, vol. 38, pp. 474–492, 2018.
  11. K. Davis, "An empirical investigation into different stakeholder groups perception of project success," International Journal of Project Management, vol. 35, pp. 604–617, May 2017.
  12. R. K. Mitchell, B. R. Agle, and D. J. Wood, "Toward a Theory of Stakeholder Identification and Salience: Defining the Principle of who and What Really Counts," Academy of Management Review, vol. 22, pp. 853-886, Oct 1997.
  13. B. Mittelstadt, "Principles alone cannot guarantee ethical AI," Nature Machine Intelligence, vol. 1, pp. 501-507, 2019.
  14. L. A. Ika, "Project success as a topic in project management journals," Project Management Journal, vol. 40, pp. 6--19, 2009.
  15. C. Weninger, "Project Initiation and Sustainability Principles: What Global Project Management Standards Can Learn from Development Projects when Analyzing Investment," presented at the Paper presented at PMI® Research and Education Conference, Limerick, Munster, Ireland, 2012.
  16. J. K. Pinto and D. P. Slevin, "Critical Success Factors Across the Project Life Cycle," Project Management Journal, vol. 19, p. 67, 1988.
  17. W. Belassi and O. I. Tukel, "A new framework for determining critical success/failure factors in projects," International Journal of Project Management, vol. 14, pp. 141-151, 1996.
  18. G. J. Miller, "A conceptual framework for interdisciplinary decision support project success," in 2019 IEEE Technology & Engineering Management Conference (TEMSCON), 2019, pp. 1-8
  19. J. Aggarwal and S. Kumar, "A Survey on Artificial Intelligence," International Journal of Research in Engineering, Science and Management vol. 1, Dec 2018.
  20. R. Iqbal, F. Doctor, B. More, S. Mahmud, and U. Yousuf, "Big Data analytics and Computational Intelligence for Cyber-Physical Systems: Recent trends and state of the art applications," Future Generation Computer Systems, pp. 766–778, Nov 2017.
  21. T. M. Jones, "Ethical decision making by individuals in organizations: An issue-contingent model," Academy of management review, vol. 16, pp. 366-395, 1991.
  22. G. E. M. Anscombe, "Modern moral philosophy," Philosophy, vol. 33, pp. 1–19, 1958.
  23. I. G. Cohen, R. Amarasingham, A. Shah, B. Xie, and B. Lo, "The Legal And Ethical Concerns That Arise From Using Complex Predictive Analytics In Health Care," Health Affairs, vol. 33, pp. 1139–1147, Jul 2014.
  24. N. P. Shaw, A. Stöckel, R. W. Orr, T. F. Lidbetter, and R. Cohen, "Towards Provably Moral AI Agents in Bottom-up Learning Frameworks," Aies '18, pp. 271–277, 2018.
  25. A. Jobin, M. Ienca, and E. Vayena, "The global landscape of AI ethics guidelines," Nature Machine Intelligence, vol. 1, pp. 389-399, 2019.
  26. T. Hagendorff, "The Ethics of AI Ethics: An Evaluation of Guidelines," Minds and Machines, vol. 30, Mar 2020.
  27. M. Ryan and B. C. Stahl, "Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications," Journal of Information, Communication and Ethics in Society, vol. 19, pp. 61-86, 2021.
  28. Y. Zhang, M. Wu, G. Y. Tian, G. Zhang, and J. Lu, "Ethics and privacy of artificial intelligence: Understandings from bibliometrics," Knowledge-Based Systems, vol. 222, p. 106994, 2021/06/21/ 2021.
  29. D. Moher, A. Liberati, J. Tetzlaff, and D. G. Altman, "Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement," International Journal of Surgery, vol. 8, pp. 336–341, Jan 2010.
  30. M. Wieringa, "What to account for when accounting for algorithms: a systematic literature review on algorithmic accountability," presented at the Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Barcelona, Spain, 2020.
  31. A. Rossi and G. Lenzini, "Transparency by design in data-informed research: A collection of information design patterns," Computer Law & Security Review, vol. 37, pp. 1–22, Jul 2020.
  32. M. Büchi, E. Fosch-Villaronga, C. Lutz, A. Tamò-Larrieux, S. Velidi, and S. Viljoen, "The chilling effects of algorithmic profiling: Mapping the issues," Computer Law & Security Review, vol. 36, pp. 1–15, Apr 2020.
  33. E. Bertino, A. Kundu, and Z. Sura, "Data Transparency with Blockchain and AI Ethics," Journal of Data and Information Quality, vol. 11, pp. 1–8, 2019.
  34. M. Loi, C. Heitz, and M. Christen, "A Comparative Assessment and Synthesis of Twenty Ethics Codes on AI and Big Data," in 2020 7th Swiss Conference on Data Science (SDS), 26-26 June
  35. 2020, 2020, pp. 41-46. I. Munoko, H. L. Brown-Liburd, and M. Vasarhelyi, "The Ethical Implications of Using Artificial Intelligence in Auditing: JBE,"
  36. Journal of Business Ethics, vol. 167, pp. 209-234, Nov 2020. T. Gebru, J. Morgenstern, B. Vecchione, J. W. Vaughan, H. Wallach, H. Daumé III, et al., "Datasheets for datasets: arXiv preprint https://arxiv.org/abs/1803.09010," arXiv preprint arXiv:1803.09010, 2018.
  37. R. Hamon, H. Junklewitz, G. Malgieri, P. De Hert, L. Beslay, and I. Sanchez, "Impossible Explanations? Beyond explainable AI in the GDPR from a COVID-19 use case scenario," presented at the Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event, Canada, 2021.
  38. B. Hutchinson, A. Smart, A. Hanna, E. Denton, C. Greer, O. Kjartansson, et al., "Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructure," presented at the Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event, Canada, 2021.
  39. B. Wagner, K. Rozgonyi, M.-T. Sekwenz, J. Cobbe, and J. Singh, "Regulating transparency? Facebook, Twitter and the German Network Enforcement Act," presented at the Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Barcelona, Spain, 2020.
  40. H. J. Watson and N. Conner, "Addressing the Growing Need for Algorithmic Transparency," Communications of the Association for Information Systems, vol. 45, p. 26, Mar 2019.
  41. J. Cobbe, M. S. A. Lee, and J. Singh, "Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems," presented at the Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event, Canada, 2021.
  42. O. H. Gandy, "Engaging rational discrimination: exploring reasons for placing regulatory constraints on decision support systems," Ethics and Information Technology, vol. 12, pp. 29–42, Mar 2010.
  43. J. H. Lim and H. Y. Kwon, "A Study on the Modeling of Major Factors for the Principles of AI Ethics," presented at the Digital Government Research (DG.O '21), June 09–11, 2021, Omaha, NE, USA, 2021.
  44. H. Adam, "The ghost in the legal machine: algorithmic governmentality, economy, and the practice of law," Journal of Information, Communication and Ethics in Society, vol. 16, pp. 16–31, 2018.
  45. J. Alasadi, A. A. Hilli, and V. K. Singh, "Toward Fairness in Face Matching Algorithms," presented at the Proceedings of the 1st International Workshop on Fairness, Accountability, and Transparency in MultiMedia, Nice, France, 2019.
  46. E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell, "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? ," presented at the Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event, Canada, 2021.
  47. M. Eslami, K. Vaccaro, M. K. Lee, A. E. B. On, E. Gilbert, and K. Karahalios, "User Attitudes towards Algorithmic Opacity and Transparency in Online Reviewing Platforms," presented at the Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, Scotland Uk, 2019.
  48. M. Mitchell, S. Wu, A. Zaldivar, P. Barnes, L. Vasserman, B. Hutchinson, et al., "Model Cards for Model Reporting," presented at the Proceedings of the Conference on Fairness, Accountability, and Transparency, Atlanta, GA, USA, 2019.
  49. M. Langer and R. N. Landers, "The future of artificial intelligence at work: A review on effects of decision automation and augmentation on workers targeted by algorithms and third-party observers," Computers in Human Behavior, vol. 123, p. 106878, 2021.
  50. A. R. Givens and M. R. Morris, "Centering disability perspectives in algorithmic fairness, accountability and transparency," presented at the Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Barcelona, Spain, 2020.
  51. U.-V. Albrecht, "Transparency of Health-Apps for Trust and Decision Making," Journal of Medical Internet Research, vol. 15, pp. 1–5, Dec 2013.
  52. E. P. Vallejos, A. Koene, V. Portillo, L. Dowthwaite, and M. Cano, "Young People's Policy Recommendations on Algorithm Fairness," presented at the Proceedings of the 2017 ACM on Web Science Conference, Troy, New York, USA, 2017.
  53. J. Matthews, "Patterns and Antipatterns, Principles, and Pitfalls: Accountability and Transparency in Artificial Intelligence," AI Magazine, vol. 41, pp. 82-89, Nov 2020.
  54. U. Bhatt, A. Xiang, S. Sharma, A. Weller, A. Taly, Y. Jia, et al., "Explainable Machine Learning in Deployment," presented at the Conference on Fairness, Accountability, and Transparency (Fat* '20), January 27–30, 2020, Barcelona, Spain, 2020.
  55. A. Mowbray, P. Chung, and G. Greenleaf, "Utilising AI in the legal assistance sector—Testing a role for legal information institutes," Computer Law & Security Review, vol. 38, pp. 1–9, Sep 2020.
  56. A. Joerin, M. Rauws, R. Fulmer, and V. Black, "Ethical Artificial Intelligence for Digital Health Organizations," Cureus, vol. 12, May 2020.
  57. B. Shneiderman, "Bridging the Gap Between Ethics and Practice: Guidelines for Reliable, Safe, and Trustworthy Human-Centered AI Systems," ACM Trans. Interact. Intell. Syst., vol. 10, 2020.
  58. J. Metcalf, E. Moss, E. A. Watkins, R. Singh, and M. C. Elish, "Algorithmic Impact Assessments and Accountability: The Co- construction of Impacts," presented at the Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 2021
  59. A. Jacovi and Marasovi, "Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI," presented at the ACM Conference on Fairness, Accountability, and Transparency (ACM FAccT '21), March 3– 10, 2021, Virtual Event, Canada, 2021.
  60. A. Aguirre, G. Dempsey, H. Surden, and P. B. Reiner, "AI Loyalty: A New Paradigm for Aligning Stakeholder Interests," IEEE Transactions on Technology and Society, vol. 1, pp. 128- 137, 2020.
  61. A. P. Brady and E. Neri, "Artificial Intelligence in Radiology— Ethical Considerations," Diagnostics, vol. 10, p. 231, Apr 2020.
  62. W. X. Wan and T. Lindenthal, "Towards Accountability in Machine Learning Applications: A System-testing Approach," Available at SSRN, 2021.
  63. G. Harrison, J. Hanson, C. Jacinto, J. Ramirez, and B. Ur, "An Empirical Study on the Perceived Fairness of Realistic, Imperfect Machine Learning Models," Conference on Fairness, Accountability, and Transparency (Fat* '20), January 27–30, 2020, pp. 392–402, 2020.
  64. S. K. McGrath and S. J. Whitty, "Accountability and responsibility defined," International Journal of Managing Projects in Business, vol. 11, pp. 687–707, Nov 2018.
  65. D. Rezania, R. Baker, and A. Nixon, "Exploring project managers’ accountability," International Journal of Managing Projects in Business, vol. 12, pp. 919–937, Nov 2019.
  66. D. Shin and Y. J. Park, "Role of fairness, accountability, and transparency in algorithmic affordance," Computers in Human Behavior, vol. 98, pp. 277-284, Sep 2019.
  67. Artificial Intelligence Act, R. (EU) Proposal for a regulation of the European Parliament and of the Council: Laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain union legislative acts, 2021.