MQTT and Dynatrace Integration

Input and output integration overview

The MQTT Telegraf plugin is designed to read from specified MQTT topics and create metrics, enabling users to leverage MQTT for real-time data collection and monitoring.

The Dynatrace plugin allows users to send metrics collected by Telegraf directly to Dynatrace for monitoring and analysis. This integration enhances the observability of systems and applications, providing valuable insights into performance and operational health.

Integration details

MQTT

The MQTT plugin allows for reading metrics from specified MQTT topics, creating metrics using supported input data formats. This plugin operates as a service input, which listens for incoming metrics or events rather than gathering them at set intervals like normal plugins. The flexibility of the plugin is enhanced with support for various broker URLs, topics, and connection features, including Quality of Service (QoS) levels and persistent sessions. Its configuration options incorporate global settings to modify metrics and handle startup errors effectively. It also supports secret-store configurations for securing username and password options, ensuring secure connections to MQTT servers.

Dynatrace

The Dynatrace plugin for Telegraf facilitates the transmission of metrics to the Dynatrace platform via the Dynatrace Metrics API V2. This plugin can function in two modes: it can run alongside the Dynatrace OneAgent, which automates authentication, or it can operate in a standalone configuration that requires manual specification of the URL and API token for environments without a OneAgent. The plugin primarily reports metrics as gauges unless explicitly configured to treat certain metrics as delta counters using the available config options. This feature empowers users to customize the behavior of metrics sent to Dynatrace, harnessing the robust capabilities of the platform for comprehensive performance monitoring and observability. It’s crucial for users to ensure compliance with version requirements for both Dynatrace and Telegraf, thereby optimizing compatibility and performance when integrating with the Dynatrace ecosystem.

Configuration

MQTT

[[inputs.mqtt_consumer]]
  servers = ["tcp://127.0.0.1:1883"]
  topics = [
    "telegraf/host01/cpu",
    "telegraf/+/mem",
    "sensors/#",
  ]
  # topic_tag = "topic"
  # qos = 0
  # connection_timeout = "30s"
  # keepalive = "60s"
  # ping_timeout = "10s"
  # max_undelivered_messages = 1000
  # persistent_session = false
  # client_id = ""
  # username = "telegraf"
  # password = "metricsmetricsmetricsmetrics"
  # tls_ca = "/etc/telegraf/ca.pem"
  # tls_cert = "/etc/telegraf/cert.pem"
  # tls_key = "/etc/telegraf/key.pem"
  # insecure_skip_verify = false
  # client_trace = false
  data_format = "influx"
  # [[inputs.mqtt_consumer.topic_parsing]]
  #   topic = ""
  #   measurement = ""
  #   tags = ""
  #   fields = ""
  #   [inputs.mqtt_consumer.topic_parsing.types]
  #      key = type

Dynatrace

[[outputs.dynatrace]]
  ## For usage with the Dynatrace OneAgent you can omit any configuration,
  ## the only requirement is that the OneAgent is running on the same host.
  ## Only setup environment url and token if you want to monitor a Host without the OneAgent present.
  ##
  ## Your Dynatrace environment URL.
  ## For Dynatrace OneAgent you can leave this empty or set it to "http://127.0.0.1:14499/metrics/ingest" (default)
  ## For Dynatrace SaaS environments the URL scheme is "https://{your-environment-id}.live.dynatrace.com/api/v2/metrics/ingest"
  ## For Dynatrace Managed environments the URL scheme is "https://{your-domain}/e/{your-environment-id}/api/v2/metrics/ingest"
  url = ""

  ## Your Dynatrace API token.
  ## Create an API token within your Dynatrace environment, by navigating to Settings > Integration > Dynatrace API
  ## The API token needs data ingest scope permission. When using OneAgent, no API token is required.
  api_token = ""

  ## Optional prefix for metric names (e.g.: "telegraf")
  prefix = "telegraf"

  ## Optional TLS Config
  # tls_ca = "/etc/telegraf/ca.pem"
  # tls_cert = "/etc/telegraf/cert.pem"
  # tls_key = "/etc/telegraf/key.pem"
  ## Optional flag for ignoring tls certificate check
  # insecure_skip_verify = false

  ## Connection timeout, defaults to "5s" if not set.
  timeout = "5s"

  ## If you want metrics to be treated and reported as delta counters, add the metric names here
  additional_counters = [ ]

  ## In addition or as an alternative to additional_counters, if you want metrics to be treated and
  ## reported as delta counters using regular expression pattern matching
  additional_counters_patterns = [ ]

  ## NOTE: Due to the way TOML is parsed, tables must be at the END of the
  ## plugin definition, otherwise additional config options are read as part of the
  ## table

  ## Optional dimensions to be added to every metric
  # [outputs.dynatrace.default_dimensions]
  # default_key = "default value"

Input and output integration examples

MQTT

1. Smart Home Monitoring: Use the MQTT Consumer plugin to monitor various sensors in a smart home setup. In this scenario, the plugin can be configured to subscribe to topics for different devices, such as temperature, humidity, and energy consumption. By aggregating this data, homeowners can visualize trends and receive alerts for unusual patterns, enhancing the overall quality and efficiency of home automation systems.

2. IoT Environmental Sensing: Deploy the MQTT Consumer to gather environmental data from sensors distributed across different locations. For instance, this can include readings from air quality sensors, temperature sensors, and noise level meters. The plugin can be configured to extract relevant tags and fields from the MQTT topics which allows for detailed analyses and reporting on environmental conditions at scale, supporting better decision making for urban planning or environmental initiatives.

3. Real-Time Vehicle Tracking and Telemetry: Integrate the MQTT Consumer plugin within a vehicle telemetry system that collects data from various sensors in real-time. With the plugin, metrics related to vehicle performance, location, and fuel consumption can be sent to a centralized monitoring dashboard. This real-time telemetry data enables fleet managers to optimize routes, reduce fuel costs, and improve vehicle maintenance schedules through proactive data analysis.

4. Agricultural Monitoring System: Leverage this plugin to collect data from agricultural sensors that monitor soil moisture, crop health, and weather conditions. The MQTT Consumer can subscribe to multiple topics associated with farming equipment and environmental sensors, allowing farmers to make data-driven decisions to improve crop yields while also conserving resources, enhancing sustainability in agriculture.

Dynatrace

1. Cloud Infrastructure Monitoring: Utilize the Dynatrace plugin to monitor a cloud infrastructure setup, feeding real-time metrics from Telegraf into Dynatrace. This integration provides a holistic view of resource utilization, application performance, and system health, enabling proactive responses to performance issues across various cloud environments.

2. Custom Application Performance Metrics: Implement custom application-specific metrics by configuring the Dynatrace output plugin to send tailored metrics from Telegraf. By leveraging additional counters and dimension options, development teams can gain insights that are precisely aligned with their application’s operational requirements, allowing for targeted optimization efforts.

3. Multi-Environment Metrics Management: For organizations running multiple Dynatrace environments (e.g., production, staging, and development), use this plugin to manage metrics for all environments from a single Telegraf instance. With proper configuration of endpoints and API tokens, teams can maintain consistent monitoring practices throughout the SDLC, ensuring that performance anomalies are detected early in the development process.

4. Automated Alerting Based on Metrics Changes: Integrate the Dynatrace output plugin with an alerting mechanism that triggers notifications when specific metrics exceed defined thresholds. This scenario involves configuring additional counters to monitor crucial application performance indicators, enabling swift remediation actions to maintain service availability and user satisfaction.

Feedback

Thank you for being part of our community! If you have any general feedback or found any bugs on these pages, we welcome and encourage your input. Please submit your feedback in the InfluxDB community Slack.