Warehouse · 02 of 04

The warehouse that never forgets.

Store, organise, back up, and serve every sensor reading across your estate. Cloud or on-prem. Hot, warm and cold tiers. REST and GraphQL APIs. The single source of truth between your sensors and every platform that queries them.

MUSA Data Management is the data warehouse that sits at the center of the MUSA pipeline. The Integrator pushes data here; View, Assistant, and analytics workloads pull from it. It is the single source of truth, every sensor reading, every calibration event, every submission receipt, stored, indexed, and available through APIs.

Deploy it as a managed cloud instance on GCP or Tencent Cloud, or run it on-premise for estates with air-gapped or low-latency requirements. The warehouse is regulation-aware out of the box: KLHK retention periods, audit logging, and data-lineage tracking are built in, not bolted on.

Every solution in the MUSA catalogue SISPEK stack emissions, SPARING wastewater, ISPU ambient air, carbon ledgers lands in Data Management first. From there, it is queried by View dashboards, Assistant agents, and third-party BI tools through the same REST and GraphQL endpoints.

Features

Built for environmental telemetry at scale.

Time-series optimised storage

Columnar storage engine optimised for environmental telemetry. Sub-second queries over billions of readings. Automatic partitioning by site, sensor, and time.

  • Columnar compression reduces storage footprint by up to 90%
  • Automatic partitioning by site, sensor type and time range
  • Sub-second queries over billions of records
Data analytics visualization

Hot / warm / cold tiering

Hot tier keeps 18 months of full-resolution data. Warm tier rolls up to 5-minute aggregates for 5 years. Cold tier archives hourly data for 10+ years. Fully automatic lifecycle management.

  • Hot: 18 months full resolution (1-second to 1-minute)
  • Warm: 5 years at 5-minute roll-ups
  • Cold: 10+ year compliance archive at hourly
Energy and infrastructure

REST & GraphQL APIs

Query any time range, any sensor, any site. REST for simple reads; GraphQL for complex, nested queries. Rate-limited, authenticated, auditable. MUSA View and Assistant are built on these APIs.

  • REST v2 for straightforward time-series reads
  • GraphQL for multi-sensor, cross-site nested queries
  • Rate limiting, API key management, full audit trail
Code and data

Backup, restore & disaster recovery

Continuous replication to a secondary region. Point-in-time recovery for any window. Automated integrity checks. KLHK requires 3-year retention, we archive 10+.

  • Cross-region asynchronous replication
  • Point-in-time recovery for any timestamp window
  • Automated daily integrity checks with alerting
Data protection and security
Technical specs

Under the hood.

DeploymentManaged cloud (GCP / Tencent) · Private cloud · On-prem (VM or bare-metal)
Storage engineColumnar time-series (custom) · Relational metadata (PostgreSQL)
IngestionMQTT · HTTPS/REST · OPC-UA · Batch CSV/IMPORT
Query APIsREST v2 · GraphQL · SQL (analytics workspace)
Retention (hot)18 months full resolution
Retention (warm)5 years at 5-min roll-ups
Retention (cold)10+ years compliance archive
ReplicationCross-region async · RPO < 5 min
SecurityTLS 1.3 · AES-256 at rest · RBAC · SSO (SAML/OIDC) · Audit log
ComplianceGDPR-ready · Indonesian PDP Law compliant
Uptime SLA99.95% (managed cloud)
Works with

Solutions whose data lands in MUSA Data Management.

How it works

From provisioning to production in four steps.

1. Provision & configure

Cloud project setup, tenant creation, security policies, network peering (if on-prem). Storage tiers sized to your sensor count and ingestion rate. Done in days, not months.

2. Connect edge sources

MUSA Integrator pairing, sensor registry population, data model mapping. Each stack, outfall, AQMS node and meter is registered with its metadata, location, and regulatory context.

3. Validate & reconcile

Data quality checks, gap detection, calibration metadata import. We reconcile the first 30 days of data against source records to confirm completeness and accuracy.

4. Operate & scale

Continuous monitoring, retention lifecycle management, quarterly compliance reconciliation. Add new sensors and sites without re-architecture. The warehouse grows with your estate.

Start with your sensor inventory

A 30-minute architecture review, tailored to your estate.

Send us your stack, outfall and AQMS inventory. We'll draft a Data Management deployment architecture, cloud, on-prem or hybrid, and walk through it with your team.