leontoetenel/topology_mapper

topology_mapper

topology_mapper is a Python service that queries the Dynatrace API for hosts, process groups, services, and process group instances.
It builds a normalized topology snapshot (components + relations) and publishes it in batches via a Kafka REST Proxy.

Features

• Fetches Hosts, Process Groups, Services, and PG Instances from Dynatrace Entities API
• Normalizes topology with components (Hosts, PG/PGI, Services)
• Builds relations:
  • Host → Process Group
  • Service → Process Group
  • Service → Service
• Publishes batches to Kafka via REST endpoint
• Retry logic for both Kafka and Dynatrace connectivity
• OpenShift- and Docker-ready container (stdout logging, non-root, arbitrary UID-proof)
• Optional safe/unsafe TLS mode configurable via environment variable

Environment variables

Local run (Docker)

With explicit env vars:

bash
docker run --rm \
  -e DT_URL=https://<tenant>.live.dynatrace.com \
  -e DT_TOKEN=*** \
  -e KAFKA_REST_URL=https://<kafka-rest-endpoint> \
  -e KAFKA_USER=*** \
  -e KAFKA_PASS=*** \
  -e KAFKA_TOPIC=topology-intake \
  -e SAFE_MODE=false \
  leontoetenel/topology_mapper:latest

OpenShift / Kubernetes deployment

ConfigMap

configmap
apiVersion: v1
kind: ConfigMap
metadata:
  name: topology-mapper-config
  namespace: <your-namespace>
data:
  DT_URL: "https://<dynatrace-tenant-url>"
  KAFKA_TOPIC: "<your-kafka-topic>"
  KAFKA_REST_URL: "https://<kafka-rest-endpoint>"
  SAFE_MODE: "false"

Secret

secret
apiVersion: v1
kind: Secret
metadata:
  name: topology-mapper-secrets
  namespace: <your-namespace>
type: Opaque
stringData:
  DT_TOKEN: "<dynatrace-api-token>"
  KAFKA_USER: "<kafka-username>"
  KAFKA_PASS: "<kafka-password>"

Deployment with Cron job settings

Since topology_mapper runs once and then exits, a CronJob is the most convenient way to collect snapshots at regular intervals.

Example: run every 240 minutes (4 hours):

deployment
apiVersion: batch/v1
kind: CronJob
metadata:
  name: topology-mapper
  namespace: dynatracehelpers
spec:
  schedule: "0 23 * * *"   # elke dag om 23:00
  jobTemplate:
    spec:
      template:
        spec:
          containers:
          - name: topology-mapper
            image: docker.io/leontoetenel/topology_mapper:v1.2.0
            imagePullPolicy: IfNotPresent
            envFrom:
            - configMapRef:
                name: topology-mapper-config
            - secretRef:
                name: topology-mapper-secrets
            resources:
              requests:
                cpu: "100m"
                memory: "128Mi"
              limits:
                cpu: "500m"
                memory: "512Mi"
            securityContext:
              runAsNonRoot: true
              allowPrivilegeEscalation: false
              seccompProfile:
                type: RuntimeDefault
          restartPolicy: Never