In-situ processing of big raster data with command line tools
Explosive growth of raster data volumes in numerical simulations, remote sensing and other fields stimulate the development of new efficient data processing techniques. For example, in-situ approach queries data in diverse file formats avoiding time-consuming import phase. However, after data are read from file, their further processing always takes place with code developed almost from scratch. Standalone command line tools are one of the most popular ways for in-situ processing of raster files. Decades of development and feedback resulted in numerous feature-rich, elaborate, free and quality-assured tools mostly for a single machine. The paper reports current development state of ChronosServer – distributed system partially delegating in-situ raster processing to external tools. The new delegation approach is anticipated to readily provide rich collection of raster data operations at scale.