CRC 1404/1: Adaptive, Distributed and Scalable Analysis of Massive Satellite Data (SP B05)

Subproject B05 investigates means to improve adaptability and portability of DAWs for large-scale analysis of satellite data. DAWs for such problems are often long and involved and include tasks with very heterogeneous resource requirements (in terms of memory, runtime, and bandwidth). As the manner in which the concrete requirements of tools depend on the input data is a-priori unknown, these DAWs are very difficult to schedule. Today, this problem typically is solved by hardwiring data- and infrastructure dependent scheduling decisions into the DAW. B05 will research new methods for adaptive scheduling of DAWs that adapt to the concrete remote sensing scenario. It will work closely with A04, which also studies satellite data but with a focus on accuracy instead of scalability, and with B06 in the area of DAW scheduling. B05 is an interdisciplinary subproject, led by Prof. Hostert, expert in large-scale satellite data analysis, and Prof. Leser, an expert in workflow management systems for large-scale scientific data analysis.