Casper: Carbon-Aware Scalable Processing in Elastic Clusters

The Casper project investigates how the execution of scalable batch processing applications can be aligned with the availability of low-carbon energy. More specifically, we aim to pioneer how individual processing steps of large-scale cluster applications can be managed dynamically based on continuously updated estimates of application performance, resource availability, and carbon intensity.

About Our Research

The three main goals towards our project aim are:

  1. Develop the methods needed to reliably reduce the emissions of large scalable batch data processing applications on elastic compute clusters significantly

  2. Design and implement a prototype for elastic Kubernetes clusters and scalable batch data processing (such as Nextflow workflows and Spark dataflows)

  3. Evaluate the prototype system in use cases covering (1) a commercial cluster service of a leading public cloud provider and (2) a similar service running on the private cloud resources of a research organisation

Latest News

IEEE CLOUD 2026 research paper on workflow energy prediction

June 11, 2026

Our full conference paper, “Augur: Pre-Execution Energy Prediction for Workflow Tasks in Heterogeneous Clusters” was accepted for publication in the proceedings of the “2026 IEEE International Conference on Cloud Computing (CLOUD), and will be presented in Sydney in July 2026.

In the paper, we proposed Augur, a novel method to predict the energy consumption of scientific workflow tasks prior to execution. By efficiently profiling both the available cluster infrastructure and the workflow at hand, Augur is capable of predicting the overall energy consumption with a median prediction error of 16.3% compared to Ichnos, an energy estimation method that uses fitted power models, and 18.2% compared to Intel RAPL measurements, as observed in our experimental evaluation on public and private cloud infrastructure. Augur outperforms two state-of-the-art methods in predicting both task runtime and total workflow energy, providing a robust foundation for energy-efficient and carbon-aware scientific data analysis.

The pre-print of the paper is available on arXiv, with the results repository also available on GitHub.

Read more

Future Generation Computer Systems article on carbon-aware scientific workflows

March 06, 2026

We are happy to share that our journal article “A Systematic Evaluation of the Potential of Carbon-Aware Execution for Scientific Workflows” has been published in the journal Future Generation Computer Systems.

Read more

FONDA workshop presentations on workflow carbon impact at HU Berlin

November 06, 2025

Kathleen and Lauritz will be speaking at the FONDA workshop on Reducing the Carbon Emissions of Large-Scale Computational Data Analysis, which will take place on 25 and 26 November at Humboldt University of Berlin.

Read more

View all news

Recent Publications and Open-Source Software

Augur: Pre-Execution Energy Prediction for Workflow Tasks in Heterogeneous Clusters

Kathleen West, Vasilis Bountris, Philipp Thamm, Ulf Leser, Yehia Elkhatib, and Lauritz Thamsen

To appear in the Proceedings of the 19th IEEE International Conference on Cloud Computing (CLOUD), 2026

Energy-Aware Workflow Execution: An Overview of Techniques for Saving Energy and Emissions in Scientific Compute Clusters

Lauritz Thamsen, Yehia Elkhatib, Paul Harvey, Syed Waqar Nabi, Jeremy Singer, and Wim Vanderbauwhede

Workflow Systems for Large-Scale Scientific Data Analysis, 2026

A Systematic Evaluation of the Potential of Carbon-Aware Execution for Scientific Workflows

Kathleen West, Youssef Moawad, Fabian Lehmann, Vasilis Bountris, Ulf Leser, Yehia Elkhatib, Lauritz Thamsen

Future Generation Computer Systems, 2026

Ichnos: A Carbon Footprint Estimator for Scientific Workflows

Kathleen West, Magnus Reid, Yehia Elkhatib, and Lauritz Thamsen

To appear in the Post-Proceedings of the 1st International Workshop on Low Carbon Computing (LOCO), 2025

Exploring the Potential of Carbon-Aware Execution for Scientific Workflows

Kathleen West, Fabian Lehmann, Vasilis Bountris, Ulf Leser, Yehia Elkhatib, and Lauritz Thamsen

In the Proceedings of the 25th IEEE International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2025

Ichnos software for Carbon Footprint Estimation for Scientific Workflows

Kathleen West, Youssef Moawad, Magnus Reid, Yehia Elkhatib, and Lauritz Thamsen

View all results