Logo PTI Logo FedCSIS

Proceedings of the 16th Conference on Computer Science and Intelligence Systems

Annals of Computer Science and Information Systems, Volume 25

Fed-agent – a Transparent ACID-Enabled Transactional Layer for Multidatabase Microservice Architectures

,

DOI: http://dx.doi.org/10.15439/2021F46

Citation: Proceedings of the 16th Conference on Computer Science and Intelligence Systems, M. Ganzha, L. Maciaszek, M. Paprzycki, D. Ślęzak (eds). ACSIS, Vol. 25, pages 489–492 ()

Full text

Abstract. With the recent expansion of specialized databases and departure from the ``one size fits all'' paradigm, engineers might decide to use multiple databases. Each database holds a representation of a data object but offers transactions and consistency guarantees only locally. Existing solutions either require additional coding or do not provide global ACID transactions. In this paper, we present fed-agent, a transactional layer that provides global consistency and ACID transactions for single data objects within multidatabase systems. It requires no additional coding besides configuration files. We show that fed-agent scales linearly and introduces an overhead small enough for most microservice solutions.

References

  1. M. Stonebraker, S. Madden, D. J. Abadi, S. Harizopoulos, N. Hachem, and P. Helland, “The end of an architectural era: it's time for a complete rewrite,” Making Databases Work: the Pragmatic Wisdom of Michael Stonebraker, pp. 463–489, 2018.
  2. VoltDB, 10-May-2021. [Online]. Available: https://www.voltdb.com/. [Accessed: 23-May-2021].
  3. Neo4j Graph Database Platform, 13-May-2021. [Online]. Available: https://neo4j.com/. [Accessed: 23-May-2021].
  4. V. Gadepally, P. Chen, J. Duggan, A. Elmore, B. Haynes, J. Kepner, S. Madden, T. Mattson, and M. Stonebraker, “The BigDAWG polystore system and architecture,” 2016 IEEE High Performance Extreme Computing Conference (HPEC), 2016.
  5. P. Bakkum and K. Skadron, “Accelerating SQL database operations on a GPU with CUDA,” Proceedings of the 3rd Workshop on General-Purpose Computation on Graphics Processing Units - GPGPU '10, 2010.
  6. C. Mohan, B. Lindsay, and R. Obermarck, “Transaction management in the R* distributed database management system,” ACM Transactions on Database Systems, vol. 11, no. 4, pp. 378–396, 1986.
  7. A. Thomson, T. Diamond, S.-C. Weng, K. Ren, P. Shao, and D. J. Abadi, “Calvin,” Proceedings of the 2012 international conference on Management of Data - SIGMOD '12, 2012.
  8. W. Vogels, “Eventually consistent,” Communications of the ACM, vol. 52, no. 1, pp. 40–44, 2009.
  9. D. Ongaro, and J. Ousterhout, „In search of an understandable consensus algorithm”. In 2014 {USENIX} Annual Technical Conference ({USENIX}{ATC} 14) , pp. 305-319, 2014.
  10. P. A. Bernstein and N. Goodman, “Multiversion concurrency control —theory and algorithms,” ACM Transactions on Database Systems, vol. 8, no. 4, pp. 465–483, 1983.
  11. Tile38. [Online]. Available: https://tile38.com/. [Accessed: 23-May- 2021].
  12. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears, “Benchmarking cloud serving systems with YCSB,” Proceedings of the 1st ACM symposium on Cloud computing - SoCC '10, 2010..
  13. C. Rodríguez, M. Baez, F. Daniel, F. Casati, J. C. Trabucco, L. Canali, and G. Percannella, “REST APIs: A Large-Scale Analysis of Compliance with Principles and Best Practices,” Lecture Notes in Computer Science, pp. 21–39, 2016.
  14. Y. Breitbart, H. Garcia-Molina, and A. Silberschatz, “Overview of multidatabase transaction management,” CASCON First Decade High Impact Papers on - CASCON '10, 2010.
  15. F. Junqueira, B. Reed, and M. Yabandeh, “Lock-free transactional support for large-scale storage systems,” 2011 IEEE/IFIP 41st International Conference on Dependable Systems and Networks Workshops (DSN-W), 2011.
  16. G. Zhang, K. Ren, J.-S. Ahn, and S. Ben-Romdhane, “GRIT: Consistent Distributed Transactions Across Polyglot Microservices with Multiple Databases,” 2019 IEEE 35th International Conference on Data Engineering (ICDE), 2019. Conference on Data Engineering (ICDE) (pp. 2024-2027). IEEE.
  17. Levandoski, J. Justin, D. Lomet, M. Mokbel and K. Zhao. “Deuteronomy: Transaction Support for Cloud Data.” CIDR (2011).
  18. V. Arora, F. Nawab, D. Agrawal, and A. E. Abbadi, “Typhon: Consistency Semantics for Multi-Representation Data Processing,” 2017 IEEE 10th International Conference on Cloud Computing (CLOUD), 2017.
  19. A. Dey, A. Fekete, and U. Rohm, “Scalable distributed transactions across heterogeneous stores,” 2015 IEEE 31st International Conference on Data Engineering, 2015.