Cloud Monitoring API Usage
How Cloud Monitoring Works?
Cloud Monitoring involves collecting, analyzing, and visualizing performance metrics and telemetry data from cloud infrastructure and applications via APIs.
Cloud Monitoring data collection flow:
- API Authentication: Authenticate with cloud providers using secure credentials such as API keys, IAM roles, service principals, or OAuth tokens.
- Data Collection: Make scheduled API calls to retrieve resource states, performance metrics, and configuration information at defined intervals.
- Data Processing & Presentation: After data collection, data is normalized, processed, and stored for analysis, then visualized.
Types of APIs
- LIST APIs: Used to get the list of resources.
- GET / DESCRIBE API: Used to get the metadata or configuration data of the specific resource.
- Monitor APIs: Used to get the performance data for the resource. (ex: From AWS CloudWatch, Azure Monitor, etc.).
Cloud Monitoring Comparison
| Native Monitoring (AWS CloudWatch, Azure Monitor) | Applications Manager |
Cloud Support | Single Cloud | Multi Cloud |
Threshold / Alarm Pricing | NA | |
API Pricing | NA | Cost incurred only for AWS CloudWatch GetMetricData API |
Detailed RCA & Customized Dashboard | Basic level | Advanced level |
Cloud API Pricing
AWS
For AWS monitoring, please find the API cost below
- CloudWatch
- GetMetricData: $0.01 per 1,000 metrics requested
- GET / DESCRIBE API: Free
Note: Please find the list of APIs used for monitoring here.Microsoft Azure
For Azure monitoring, please find the API cost below
- Platform Metrics - First 1M API calls/month free, then $0.01 per 1,000 calls.
- In Applications Manager, we use Metrics - List API to fetch Azure monitors metrics.
Note: Please find the list of APIs used for monitoring here.
Cost Calculation
AWS Pricing (Example)
Please find the calculation for the API cost incurred in AWS monitors for the default poll interval - 5 mins.
Monitor Type | Metrics count / poll | Metrics count / hour (12 polls) | Metrics count / month (12 polls * 24 * 30) | Monthly cost per monitor | Metrics count for 10 monitors | Monthly cost for 10 monitors |
SQS | 6 | 72 | 51,840 | $0.51 | 518,400 | $5.18 |
API Gateway (REST) | 7 | 84 | 60,480 | $0.60 | 604,800 | $6.04 |
File Transfer Family | 11 | 132 | 95,040 | $0.95 | 950,400 | $9.50 |
Microsoft Azure (Example)
Please find the calculation for the API cost incurred in Azure monitors for the default poll interval - 5 mins.
| Monitor Type | Metrics / Poll | Metrics / Hour (12 polls) | Metrics / Month (12 × 24 × 30) | 10 Monitors Total Metrics | Monthly Cost per Monitor (Free Tier) | Monthly Cost per Monitor (No Free Tier) | Monthly Cost for 10 Monitors (With Free Tier) | Monthly Cost for 10 Monitors (No Free Tier) |
| Express Route | 15 | 180 | 129,600 | 1,296,000 | $0 | $1.296 | $2.96 | $12.96 |
| ARM Service Bus | 17 | 204 | 146,880 | 1,468,800 | $0 | $1.4688 | $4.688 | $14.688 |
Cost Optimization Recommendations
- Reduce API Call Frequency:
- Increase the poll interval of the non-critical monitors (UAT) to reduce the API call frequency (For ex: increase the poll interval from 5 mins to 15 mins).
- Prioritize Critical Resources:
- Leverage advanced discovery filters in Applications Manager to target essential resources.
- Utilize regex-based filtering, choose required services & regions, etc.
- Use stop discovery to halt further discovery once sufficient resource required for monitoring have been discovered.
Cloud Monitoring Architecture
New to ADSelfService Plus?
Related Articles
Memory Usage Calculation (Linux- Telnet/SSH)
Physical Memory Utilization Calculation: Note: For version 16800 and above , the Skip option will be under Settings -> Performance Polling -> Servers -> Linux monitor type. Formula: (i) If Skip buffer and cache from monitoring (Applicable only for ...Optimizing AWS API Usage to Avoid Rate Limit Errors in Applications Manager
If you encounter the error Request Limit Exceeded This is not an issue caused by Applications Manager but rather a result of AWS API rate limits. These limits are set by AWS to ensure fair usage across all customers. The error occurs when the ...Monitoring HAProxy - Configuring the HAProxy Stats page
To effectively monitor an HAProxy instance, you can enable and access the HAProxy stats page, which provides real-time metrics about HAProxy's performance. Steps to Enable HAProxy Stats: Open the HAProxy Configuration File: The HAProxy configuration ...Azure Kubernetes Service(AKS) - How Pod CPU and Memory Usage (%) metrics are derived
Overview Note: Pod CPU & Memory Usage (%) metrics are supported from Applications Manager v17.81.00 This KB explains how the Pod CPU Usage (%) and Pod Memory Usage (%) metrics shown in the Pods tab → Pod CPU and Memory Usage table are derived. The ...GCP - Access is denied. Cloud Resource Manager API has not been enabled.
This error occurs when the Cloud Resource Manager API has not been enabled or if it is disabled. Troubleshooting: In the GCP console, go to APIs & Services and click on Library. Check if the Cloud Resource Manager API is enabled. If you have ...
