Google Cloud PubSub and ServiceNow Integration
Powerful performance with an easy integration, powered by Telegraf, the open source data connector built by InfluxData.
5B+
Telegraf downloads
#1
Time series database
Source: DB Engines
1B+
Downloads of InfluxDB
2,800+
Contributors
Table of Contents
Powerful Performance, Limitless Scale
Collect, organize, and act on massive volumes of high-velocity data. Any data is more valuable when you think of it as time series data. with InfluxDB, the #1 time series platform built to scale with Telegraf.
See Ways to Get Started
Input and output integration overview
This plugin ingests metrics from Google Cloud PubSub, allowing for real-time data processing and integration into monitoring setups.
This output plugin streams metrics from Telegraf directly to a ServiceNow MID Server via HTTP, leveraging the nowmetric
serializer for efficient integration with ServiceNow’s Operational Intelligence and Event Management.
Integration details
Google Cloud PubSub
The Google Cloud PubSub input plugin is designed to ingest metrics from Google Cloud PubSub, a messaging service that facilitates real-time communication between different systems. It allows users to create and process metrics by pulling messages from a specified subscription in a Google Cloud Project. One of the critical features of this plugin is its ability to operate as a service input, actively listening for incoming messages rather than merely polling for metrics at set intervals. Through various configuration options, users can customize the behavior of message ingestion, such as handling credentials, managing message sizes, and tuning the acknowledgment settings to ensure that messages are only acknowledged after successful processing. By leveraging the strengths of Google PubSub, this plugin integrates seamlessly with cloud-native architectures, enabling users to build robust and scalable applications that can react to events in real-time.
ServiceNow
Telegraf can be used to send metric data directly to a ServiceNow MID Server REST endpoint. Metrics are formatted either using ServiceNow’s Operational Intelligence (OI) format or JSONv2 format, enabling seamless integration with ServiceNow’s Event Management and Operational Intelligence platforms. The serializer batches metrics efficiently, reducing network overhead by minimizing the number of HTTP POST requests. This integration allows users to quickly leverage metrics in ServiceNow for enhanced observability, proactive incident management, and performance monitoring, with ServiceNow’s operational intelligence capabilities.
Configuration
Google Cloud PubSub
[[inputs.cloud_pubsub]]
project = "my-project"
subscription = "my-subscription"
data_format = "influx"
# credentials_file = "path/to/my/creds.json"
# retry_delay_seconds = 5
# max_message_len = 1000000
# max_undelivered_messages = 1000
# max_extension = 0
# max_outstanding_messages = 0
# max_outstanding_bytes = 0
# max_receiver_go_routines = 0
# base64_data = false
# content_encoding = "identity"
# max_decompression_size = "500MB"
ServiceNow
[[outputs.http]]
## ServiceNow MID Server metrics endpoint
url = "http://mid-server.example.com:9082/api/mid/sa/metrics"
## HTTP request method
method = "POST"
## Basic Authentication credentials
username = "evt.integration"
password = "P@$$w0rd!"
## Data serialization format for ServiceNow
data_format = "nowmetric"
## Metric format type: "oi" (default) or "jsonv2"
nowmetric_format = "oi"
## HTTP Headers
[outputs.http.headers]
Content-Type = "application/json"
Accept = "application/json"
## Optional timeout
# timeout = "5s"
## TLS configuration options
# tls_ca = "/etc/telegraf/ca.pem"
# tls_cert = "/etc/telegraf/cert.pem"
# tls_key = "/etc/telegraf/key.pem"
# insecure_skip_verify = false
Input and output integration examples
Google Cloud PubSub
-
Real-Time Analytics for IoT Devices: Utilize the Google Cloud PubSub plugin to aggregate metrics from IoT devices scattered across various locations. By streaming data from devices to Google PubSub and using this plugin to ingest metrics, organizations can create a centralized dashboard for real-time monitoring and alerting. This setup allows for immediate insights into device performance, facilitating proactive maintenance and operational efficiency.
-
Dynamic Log Processing and Monitoring: Ingest logs from numerous sources via Google Cloud PubSub into a Telegraf pipeline, utilizing the plugin to parse and analyze log messages. This can help teams quickly identify anomalies or patterns in logs and streamline the process of troubleshooting issues across distributed systems. By consolidating log data, organizations can enhance their observability and response capabilities.
-
Event-Driven Workflow Integrations: Use the Google Cloud PubSub plugin to connect various cloud functions or services. Each time a new message is pushed to a subscription, actions can be triggered in other parts of the cloud architecture, such as starting data processing jobs, notifications, or even updates to reports. This event-driven approach allows for a more reactive system architecture that can adapt to changing business needs.
ServiceNow
-
Proactive Incident Management: Utilize the Telegraf and ServiceNow integration to stream infrastructure and application metrics in real-time to ServiceNow Event Management. Automatically trigger incidents or remediation workflows based on thresholds, significantly reducing incident detection and response times.
-
End-to-End Application Monitoring: Deploy Telegraf agents across multiple layers of an application stack, sending performance metrics directly into ServiceNow. Leveraging ServiceNow’s Operational Intelligence, teams can correlate metrics across components, quickly identifying performance bottlenecks.
-
Dynamic CI Performance Tracking: Integrate Telegraf metrics with ServiceNow’s CMDB by using this plugin to push performance data, allowing automatic updates of Configuration Item (CI) health states based on live metrics. This ensures an accurate and current state of infrastructure health in ServiceNow.
-
Cloud Resource Optimization: Collect metrics from hybrid and multi-cloud infrastructures using Telegraf, streaming directly to ServiceNow. Leverage these metrics for real-time analytics, predictive capacity planning, and resource optimization, enabling proactive management and reduced operational costs.
Feedback
Thank you for being part of our community! If you have any general feedback or found any bugs on these pages, we welcome and encourage your input. Please submit your feedback in the InfluxDB community Slack.
Powerful Performance, Limitless Scale
Collect, organize, and act on massive volumes of high-velocity data. Any data is more valuable when you think of it as time series data. with InfluxDB, the #1 time series platform built to scale with Telegraf.
See Ways to Get Started
Related Integrations
Related Integrations
HTTP and InfluxDB Integration
The HTTP plugin collects metrics from one or more HTTP(S) endpoints. It supports various authentication methods and configuration options for data formats.
View IntegrationKafka and InfluxDB Integration
This plugin reads messages from Kafka and allows the creation of metrics based on those messages. It supports various configurations including different Kafka settings and message processing options.
View IntegrationKinesis and InfluxDB Integration
The Kinesis plugin allows for reading metrics from AWS Kinesis streams. It supports multiple input data formats and offers checkpointing features with DynamoDB for reliable message processing.
View Integration