Wes McKinney - The Road to Composable Data Systems: Thoughts on the Last 15 Years and the Future; (Pedreira et al. 2023) PDF
The stack proposed by this article:
- apache-arrow -- language-independent compute and data interchange layer and supporting systems infrastructure across important programming languages
- ibis and dplyr -- backend-agnostic data frame interfaces
- RAPIDS -- GPU-accelerated libraries for data analytics and machine learning
- duckdb and velox -- embeddable systems providing fast columnar query processing
- Substrait -- - language-independent intermediate representation (IR) middleware for analytical computing to assist in decoupling user interfaces from compute engines
References
- Pedreira, Erling, Karanasos, Schneider, McKinney, Valluri, Zait, Nadeau (2023). The Composable Data Management System Manifesto.