Kafka
Apache Kafka and Kafka-compatible clouds — connect, inspect, live-stream, and administer topics and consumer groups.
Wire protocol: KAFKA. Create a profile in Connections or use a cloud preset (MSK, Event Hubs, Managed Kafka, Strimzi).
Connect
- Presets — AWS MSK, Azure Event Hubs (Kafka), GCP Managed Kafka, OCP AMQ Streams / Strimzi, Confluent Cloud
- Endpoints — bootstrap brokers; TLS and SASL applied from preset or custom
- Test — validate metadata reachability before saving
curl -X POST http://localhost:8080/api/v1/connections \
-H "Content-Type: application/json" \
-d '{"name":"msk-dev","protocol":"KAFKA","brokerUrl":"b-1.example.kafka.amazonaws.com:9096"}'
Browse & inspect
- Topic list with partition count and replication factor
- Consumer groups and per-partition lag
- Message search by offset, timestamp, or key filter
- Add topics to the live workspace
GET /api/v1/connections/{id}/inspect/topics
GET /api/v1/connections/{id}/inspect/consumer-groups
GET /api/v1/connections/{id}/inspect/topics/{topic}/messages?limit=50
Live streaming
Subscribe to multiple Kafka topics over WebSocket with header/body regex filters, timed capture windows, and JSON, CSV, or NDJSON export. See Streaming & live view.
Administration
Requires
deployment-mode: ADMIN, Kafka on the classpath, and KAFKA in adminProtocols.
- Create, alter, and delete topics (partitions, replication, retention)
- Produce messages with headers
- View and manage ACLs when the cluster supports them
- List consumer groups, inspect lag, reset offsets (where permitted)
POST /api/v1/connections/{id}/kafka/topics
POST /api/v1/connections/{id}/kafka/topics/{topic}/produce
GET /api/v1/connections/{id}/kafka/acls
OpenAPI: openapi/streams/kafka-api.yaml (Swagger when the Kafka provider is active).
Credentials
- SASL/SCRAM, PLAIN, or IAM (MSK) from preset defaults
- Mutual TLS and truststore configuration per connection
- Username/password or IAM role via environment / connection properties