IBM Center for Open Source Data and AI Technologies (CODAIT)
Romeo is a human and generally nice guy.
The open source serverless data lakehouse - the next evolution in big data
Serverless promises huge cost reduction in operations, increase of stability and scalability and overall increase of developer and user happiness. We bring the serverless delta architecture to kubernetes using open source standards and technologies including Apache Iceberg, Knative/Kubernetes, Cloud Object Store, Apache Kafka and KFServing into a single open source reference architecture capable of running on any Kubernetes service in the Cloud (IBM, Amazon, Google, Microsoft, …) as well as on on-premises datacenters (RedHat Openshift, …). The architecture combines batch and stream processing, data lakes, data catalogs and data warehouses, business intelligence and machine learning.