FastMosaic in Action: A New Mosaic Operator for Array DBMSs

PROCEEDINGS OF THE VLDB ENDOWMENT. 2023. Vol. 16. No. 12. P. 3938–3941.

Rodriges Zalipynis R. A.

Array DBMSs operate on 𝑁-d arrays. During the Data Ingestion phase, the widely used mosaic operator ingests a massive collection of overlapping arrays into a single large array, called mosaic. The operator can utilize sophisticated statistical and machine learning techniques, e.g. Canonical Correlation Analysis (CCA), to produce a high quality seamless mosaic where the contrasts between the values of cells taken from input overlapping arrays are minimized. However, the performance bottleneck becomes a major challenge when applying such advanced techniques over increasingly growing array volumes. We introduce a new, scalable way to perform CCA that is orders of magnitude faster than the popular Python’s scikit-learn library for the purpose of array mosaicking. Furthermore, we developed a hybrid web-desktop application to showcase our novel FastMosaic operator, based on this new CCA. A rich GUI enables to comprehensively investigate in/out arrays, interactively guides through an end-to-end mosaic construction on real-world geospatial arrays using FastMosaic, facilitating a convenient exploration of the FastMosaic pipeline and its internals.

Keywords: Distributed systems, геоинформационные системы, большие данные, big data, geographic information systems, Landsat, параллельные и распределенные системы, array databases, change detection, обнаружение изменений, Earth remote sensing, дистанционное зондирование Земли, пространственные данные, Базы данных, Spatial data, Distributed databases, Array DBMS, Data Fusion