Skip to content

Data and Knowledge Administration Console

Info

Current version:

Technology: Apache Superset

Project: Summary Dashboard

Access point:

Introduction

Overview & Scope

The Data and Knowledge Administration Console is compiled of several dashboard pages implemented using Apache Superset technology. Apache Superset is an open-source data exploration and visualization platform that enables to create interactive, web-based dashboards with minimal coding. In SoilWise it is used to present statistics from the Metadata Catalogue, results of the Metadata Validation and to provide more insights into the results published by Mission Soil projects. The console is available only for authorised users.

Intended Audience

  • SWC Administrator monitoring the contents of the SoilWise Catalogue
  • Mission Soil Projects Monitoring officer monitoring the results published by Mission Soil projects
  • JRC data analysts monitoring the metadata quality of published soil-related datasets.

Key Features

  1. Rich visualisation possibilities different kinds of charts, tables and so on.
  2. Intuitive SQL editor for querying data sources and preparation of data for visualisation.
  3. WYSIWYG editor for configuring the content and layout of dashboard pages.
  4. Role-based access control for managing access rights.
  5. Redis is used to cache data.

Architecture

Technological Stack

Technology Description
Apache Superset Used for configuration and display of the dashboard pages compiling the Console.
Keycloak Used for user management and access rigths.
PostgreSQL Connection to a DB with Catalogue contents and validation results.
Redis The connection to Redis is used to store Superset sessions and cache data for faster performance.

Main Components Diagram

flowchart LR

    %% =====================================================
    %% Swimlane: Browser
    %% =====================================================
    subgraph BR[Browser]
        A([Start: Visit Superset])
        U1[Enter credentials]
        U2([Apache Superset Dashboard])
    end

    %% =====================================================
    %% Swimlane: Superset
    %% =====================================================
    subgraph SP[Superset]
        D1{Authenticated?}
        R1[Redirect to Keycloak]
        TK[Receive JWT token]
        D2{Role mapping}
        RA[Admin]
        RG[Gamma]
    end

    %% =====================================================
    %% Swimlane: Keycloak
    %% =====================================================
    subgraph KC[Keycloak]
        KL[Login Page]
        KV[Validate & issue token]
        KDB[(keycloak_db)]
    end

    %% =====================================================
    %% Swimlane: Redis
    %% =====================================================
    subgraph RD[Redis]
        RS[Store session & cache]
    end

    %% =====================================================
    %% Swimlane: PostgreSQL
    %% =====================================================
    subgraph PG[PostgreSQL]
        PD[(superset_db)]
    end

    %% =====================================================
    %% Flow
    %% =====================================================
    A --> D1
    D1 -- Yes --> RS --> PD --> U2
    D1 -- No --> R1 --> KL --> U1 --> KV
    KV <--> KDB
    KV --> TK --> D2
    D2 -- admin --> RA --> RS
    D2 -- other --> RG --> RS