In the AI-Cube project datacube fusion and AI-based analytics will be integrated,
demonstrated in several real-life Earth Observation application scenarios,
and deployed on a federation of CODE-DE, DIASs and further high-volume EO/geo data offerings.
Goal is to support scenarios like the following: User selects a topic
(in the project: specific crop types, specific forest types, burnt forest areas).
System determines, through a combined analysis of various large-scale data sources,
a list of regions showing the criterion selected. User gets this visualized directly
or continues analysing, possibly combining with further data sources.
The workplan is as follows:
- WP1: Project Management (ConstructorU)
- WP2: Infrastructure Setup (ConstructorU, TU-Berlin, rasdaman)
- WP3: ML Support in Array Databases (ConstructorU, rasdaman)
- Task 3.1: Language Concepts for ML Queries in Array Databases (ConstructorU)
- Task 3.2: Prototypical Implementation of CBIR Extensions in rasdaman (rasdaman)
- Task 3.3: Server-Side Optimization of ML Queries (rasdaman)
- WP4: Multi/Cross-Modal Datacube-enabled AI Methods (TU-Berlin)
- Task 4.1: Characterisation of large-scale multi-modal EO data (TU-Berlin)
- Task 4.2: Multi-modal EO data retrieval (TU-Berlin)
- Task 4.3: Cross-modal EO data retrieval (TU-Berlin)
- WP5: Evaluation (rasdaman, TU-Berlin)
- Task 5.1: Technical Validation on a DIAS (rasdaman)
- Task 5.2: Application Validation on DIAS (rasdaman, TU-Berlin)
- WP6: Outreach (rasdaman, ConstructorU, TU-Berlin)
- Task 6.1: Web pages, project flyer (ConstructorU)
- Task 6.2: Publications (ConstructorU, TU-Berlin)
- Task 6.3: Continuous Media Presence (rasdaman)
AI-Cube is in part funded by the German Federal Ministry of Economic Affairs and Climate Action (BMVK). Project runtime is from September 2021 through August 2023.
ConfigILM for visual Question Answering
ConfigILM is a pytorch based library, established by the TU Berlin Begum Demir team
that enables fast development of visual question answering systems.
Visual Question Answering (VQA) in remote sensing refers to the task of answering a question formulated in natural language related to the semantic content of the remote sensing images. To support the development of models to solve this task, the researchers at the Remote Sensing Image Analysis Group (RSiM) at TU Berlin created the ConfigILM that is a pytorch-based library for configurable combination of pre-trained image and language models.
Configurable ML in the Datacube Engine
The rasdaman datacube engine is being enhanced so that ML models can be invoked from within datacube queries in the OGC-standardized WCPS geo datacube query language.
User-Defined Functions (UDFs) are a concept in databases used for integrating external code on server side into queries.
From a user (i.e., query writer) perspective this external code appears like a function invocation embedded in the queries.
I can be used, but not downloaded so that Intellectual Property remains protected.
In AI-Cube, UDF bridges have been implemented which allow invocation of pytorch on server side.
The following example illustrates how pretrained ML models, stored in the database, can be invoked as part of a general analytics query:
for in (Sentinel_2a),
$m in (CropModel)
return encode( nn.predict( $c[...], $m ), "tiff" )
The most important advantages of this integration is that now ML is seamlessly integrated into EO datacube analytics.
For example, data can be extracted from a datacube, preprocessed as necessary, then the ML model can work on it, and the output can be processed further with all image processing and statistics functionality available.
Additionally, there is a full integration into all optimization, distributed processing, etc. the datacube engine provides already.
Currently, the team is working on integrating the Natural Language Processing capabilities of the Tu Berlin models, among other tasks.
Large-Scale Scientific Information Systems Group, Prof. Peter Baumann (Coordinator)
Under the lead of Prof. Dr. Peter Baumann
the Large-Scale Scientific Information Systems
focuses on Array Databases, a research field we have pioneered since 1992:
flexible, scalable services on large, multi-dimensional arrays,
such as spatio-temporal sensor, image, simulation output, and statistics data - nowadays commonly also called "datacubes".
We address this field in all its aspects, such as algebraic modelling,
query languages, architectures, optimization, parallelization, distribution,
new hardware, application, and standardization.
Among the highlights of our research and standardization activities are
the free, open-source rasdaman array analytics server
the "Big Datacube" standards in OGC, ISO, and INSPIRE
This has been honoured by a series of innovation awards
Remote Sensing Image Analysis Group, Prof. Demir Begüm
The Remote Sensing Image Analysis Group
led by Prof. Begüm Demir, is part of the Faculty of EECS at TU Berlin.
Our group performs research in the field of processing and analysis of remote sensing images
for Earth observation with interdisciplinary approaches associated to remote sensing,
machine learning, signal and image processing and big data management.
Deep-tech SME rasdaman GmbH
is a German independent academic spin-off with mission to commercializing the rasdaman ("raster data manager") datacube technology.
Its game-changing Actionable Datacubes® paradigm stands out through its flexibility, scalability, security, open standards support (such as OGC and INSPIRE),
and planetary-scale federation capabilities on Big Earth Data. The rasdaman engine is mature (TRL 9) and proven on 130+ Petabyte datacube assets,
with queries parallelized more than 1,000x in AWS; it scales seamlessly from cloud to edge, such as nanosats.
Documented through publications and patents, the rasdaman team has pioneered Datacubes and Array Databases
and remains world technology leader in high-performance analytics and fusion on spatio-temporal datacubes.
Terms of Reference
Constructor University Bremen gGmbH
c/o Peter Baumann
Campus Ring 12
Data Protection Regulation (GDPR)
The controller responsible for the described data collection and processing is
named in the Constructor University imprint.
When you visit our website, the Web server
temporarily stores usage information on our server
machine running in Germany) for statistical purposes
in the form of a log in order to improve the quality
of our website.
We do not transfer your personal data to third
parties without your express consent. We use
revolvermaps for determining the city of visitors
(nothing beyond this anonymized information is
available); see their privacy statement which, at
the time we evaluated it, obviously was in
accordance with GDPR.
When it comes to processing your personal data, the
GDPR grants you certain rights as a website user:
- Right of Access (Art. 15 of the
GDPR): You have the right to request
confirmation as to whether personal data
concerning you is being processed; where this is
the case, you have a right of access to this
personal data and to the information specified
in Article 15 of the GDPR.
- Right to Rectification and Right to
Erasure (Art. 16 and 17 of the GDPR): You have
the right to immediately request the
rectification of incorrect personal data
concerning you and, if necessary, the completion
of incomplete personal data. You also have the
right to request that personal data concerning
you be erased immediately if one of the reasons
listed in Art. 17 of the GDPR applies in detail,
e.g. if the data is no longer required for the
purposes for which it was collected.
- Right to Restriction of Processing
(Art. 18 of the GDPR): You have the right to
request a restriction of processing for the
duration of a review if any of the conditions
specified in Art. 18 of the GDPR have been met,
e.g. if you have lodged an objection to the
- Right to Data Portability (Art. 20
of the GDPR): In certain cases (which are
outlined in detail in Article 20 of the GDPR),
you have the right to obtain from us your
personal data in a structured, standard,
machine-readable format or to request the
transfer of such data to a third party.
- Right to Object (Art. 21 of the
GDPR): If data is collected on the basis of Art.
6(1)(f) of the GDPR (data processing on the
grounds of legitimate interests), you have the
right to object to the processing at any time
for reasons arising from your particular
situation. If you make such an objection, we
will no longer process your personal data unless
we can demonstrate compelling legitimate grounds
for the processing which override your
interests, rights, and freedoms or for the
establishment, exercise, or defense of legal
- Right to Lodge a Complaint with a
Supervisory Authority In accordance with Art. 77
of the GDPR, you have the right to lodge a
complaint with a supervisory authority if you
believe that the processing of your personal
data violates data protection regulations. This
right to lodge a complaint may particularly be
exercised before a supervisory authority in the
EU member state where you reside, work, or where
you suspect that your rights have been