Skip to main content
Version: v5

MQTT

Added in: v4.2.0

Harper includes a built-in MQTT broker that provides real-time pub/sub messaging deeply integrated with the database. Unlike a generic MQTT broker, Harper's MQTT implementation connects topics directly to database records — publishing to a topic writes to the database, and subscribing to a topic delivers live updates for the corresponding record.

How Topics Map to Database Records

MQTT topics in Harper follow the same path convention as REST endpoints. If you define a table or resource with an endpoint path of my-resource, the corresponding MQTT topic namespace is my-resource.

A topic of my-resource/some-id corresponds to the record with id some-id in the my-resource table (or custom resource). This means:

  • Subscribing to my-resource/some-id delivers notification messages whenever that record is updated or deleted.
  • The current value of the record is treated as the retained message for that topic. On subscription, the subscriber immediately receives the current record as the initial retained message — no separate GET request needed.
  • Publishing with the retain flag set replaces the record in the database (equivalent to a PUT operation).
  • Publishing without the retain flag delivers the message to current subscribers without writing to the database.

Defining a table that creates a topic can be as simple as adding a table with no attributes to your schema.graphql in a Harper application:

type MyTopic @table @export

Protocol Support

Harper supports MQTT versions v3.1.1 and v5, with standard publish/subscribe capabilities.

Topics and Wildcards

Harper supports multi-level topics for both publishing and subscribing:

  • Multi-level wildcard (#) — Subscribe to my-resource/# to receive notifications for all records in that resource, including nested paths (my-resource/some-id, my-resource/nested/id).
  • Single-level wildcard (+) — Added in v4.3.0. Subscribe to my-resource/+/status to match any single path segment.

QoS Levels

  • QoS 0 — At most once delivery (fire and forget).
  • QoS 1 — At least once delivery (acknowledged delivery).
  • QoS 2 — Harper can perform the QoS 2 conversation but does not guarantee exactly-once delivery.

Sessions

  • Clean sessions — Subscriptions and queued messages are discarded on disconnect.
  • Durable sessions — Subscriptions and queued messages are persisted across reconnects. See Durable Sessions below.

Durable Sessions

A durable session retains a client's subscription list and any unacknowledged messages across disconnects. When the client reconnects with the same client ID, it picks up from where it left off — including any messages published while it was offline.

Durable sessions in Harper are persisted as records in the hdb_durable_session system table, indexed by client ID. The session record holds the list of subscriptions (topic + QoS) and the timestamp of the last delivered message per topic. Because durable sessions are records rather than in-memory state, an abandoned session sits idle with no runtime cost until the client reconnects or the record is deleted.

Establishing a durable session — Connect with a stable client ID and cleanSession: false (MQTT v3.1.1) or cleanStart: false (MQTT v5):

// MQTT v5 with the `mqtt` npm package
mqtt.connect('mqtts://harper.example.com:8883', {
clientId: 'sensor-42',
clean: false, // request a durable session
protocolVersion: 5,
properties: {
sessionExpiryInterval: 86400, // keep session for 24h after disconnect
},
});

Catch-up on reconnect — When the client reconnects, Harper replays missed messages on subscribed topics by reading the audit log. For this to work, audit logging must be enabled on the tables backing the subscribed topics. See Transaction Logging and logging.auditLog.

Session expiry — In MQTT v5, the sessionExpiryInterval property on CONNECT controls how long the session is retained after the client disconnects. With sessionExpiryInterval: 0 (or a clean session connect), Harper deletes the session record at disconnect. Connecting with the same client ID and clean: true also explicitly deletes any existing durable session.

Distributed durable sessions — Harper does not currently maintain a single logical durable session across multiple cluster nodes; a durable session record lives on the node where it was created. Clients that may reconnect to different nodes (e.g., behind a load balancer with round-robin DNS) should use sticky routing or terminate on a fixed node.

Last Will

Added in: v4.3.0

Harper supports the MQTT Last Will and Testament feature. If a client disconnects unexpectedly, the broker publishes the configured will message on its behalf. Will messages are persisted in the hdb_session_will system table at CONNECT time, so they survive a broker restart and fire reliably on unexpected disconnect.

Content Negotiation

Harper handles structured data natively. Messages can be published and received in any supported structured format — JSON, CBOR, or MessagePack — and Harper stores and delivers them as structured objects. Different clients can independently choose their preferred format: one client may publish in JSON while another subscribes and receives in CBOR.

Ordering and Distributed Delivery

Harper is designed for distributed, low-latency message delivery. Messages are delivered to subscribers immediately on arrival — Harper does not delay delivery to coordinate consensus across nodes.

In a distributed cluster, messages may arrive out of order due to network topology. The behavior depends on whether the message is retained or non-retained:

  • Retained messages (published with retain: true, or written via PUT/upsert) maintain eventual consistency across the cluster. Harper keeps the message with the latest timestamp as the winning record state. An out-of-order earlier message will not be re-delivered to clients; the cluster converges to the most recent state.
  • Non-retained messages are always delivered to local subscribers when received, even if they arrive out of order. Every message is delivered, prioritizing completeness over strict ordering.

Non-retained messages are suited for applications like chat where every message must be delivered. Retained messages are suited for sensor readings or state updates where only the latest value matters.

Authentication

MQTT connections support two authentication methods:

  • Credential-based — Standard MQTT username/password in the CONNECT packet.
  • mTLS — Added in v4.3.0. Mutual TLS authentication using client certificates. The CN (common name) from the client certificate subject is used as the Harper username by default.

Authentication is required by default (requireAuthentication: true). See MQTT Configuration for details on disabling authentication or configuring mTLS options.

Server Events API

JavaScript components can listen for MQTT connection events via server.mqtt.events:

server.mqtt.events.on('connected', (session, socket) => {
console.log('client connected with id', session.clientId);
});

Available events:

EventDescription
connectionClient establishes a TCP or WebSocket connection
connectedClient completes MQTT handshake and is authenticated
auth-failedClient fails to authenticate
disconnectedClient disconnects

Feature Support Matrix

FeatureSupport
MQTT v3.1.1 connections
MQTT v5 connections
Secure MQTTS (TLS)
MQTT over WebSockets
Authentication via username/password
Authentication via mTLS✅ (added v4.3.0)
Publish
Subscribe
Multi-level wildcard (#)
Single-level wildcard (+)✅ (added v4.3.0)
QoS 0
QoS 1
QoS 2Not fully supported — conversation supported, not guaranteed
Keep-Alive monitoring
Clean session
Durable session
Distributed durable sessionNot supported
Last Will
MQTT V5 Subscribe retain handling✅ (added v4.3.0)
MQTT V5 User propertiesNot supported
MQTT V5 Will propertiesNot supported
MQTT V5 Connection propertiesNot supported
MQTT V5 Connection acknowledgement propertiesNot supported
MQTT V5 Publish propertiesNot supported
MQTT V5 Subscribe properties (general)Not supported
MQTT V5 Ack propertiesNot supported
MQTT V5 AUTH commandNot supported
MQTT V5 Shared subscriptionsNot supported