Azure Kubernetes Service(AKS) Troubleshooting FAQs
Azure Kubernetes Service (AKS) monitor can be configured only if you have already added a Microsoft Azure monitor in Applications Manager.
Ensure that you have met all the prerequisites for the Microsoft Azure monitor before monitoring Azure Kubernetes Service in Applications Manager.
How to verify if all the prerequisites have been met?
- Ensure that the pre-requisites required to monitor AKS cluster in Applications Manager is met.
- Verify if you are able to connect to the AKS cluster with the credential used in Applications Manager to monitor the subscription.
- For troubleshooting errors while connecting to the AKS cluster, refer the troubleshooting errors section.
- Refer here to troubleshoot network problems in AKS clusters.
If the issue still persists, please reach out via mail to appmanager-support@manageengine.com with the below information:
- Latest Support Information File (SIF), ensure that 'print all logs' is enabled.
- Screenshot of the below mentioned information from prerequisites:
- Command: az --version (To login to Azure account) --> Sample Output (For windows 10): azure-cli/2.31.0 Python/3.8.9 Windows/10 exe/AMD64 prompt/off)
- Command: kubectl version --client (To connect to EKS cluster) --> Sample Output starts with: Client Version: v1.23.2
- Check if the Applications Manager installed user has permission to access installed kubectl/azure-cli by verifying prerequisites mentioned above.
- Screenshot of network configuration in Azure portal > Kubernetes services > Networking.
- If Microsoft Entra ID authentication is used out of the three supported modes, send the screenshot of the configuration of the user for the Kubernetes cluster.
- Sample screenshots can be found in the document at the bottom of the page.
Possible Errors in AKS Monitor and their troubleshooting
Data collection is not performed as kubectl/azure-cli util is not installed.
- Ensure that the Azure CLI and kubectl is installed in the Applications Manager installed server.
- Refer the prerequisites for the installation steps.
Data collection has stopped. Unable to connect to AKS cluster endpoint via kubectl.
Ensure the network connectivity of the Applications Manager installed server.
Check the firewall configured for the AKS cluster and the firewall of Applications Manager server.
- If you are using a private AKS endpoint and you encounter this error, refer here to run kubectl commands using private endpoint access.
Timeout exceeded when executing kubectl command.
Increase the timeout value. (The default and minimum value for timeout is 30 seconds). To increase the value, go to Azure Kubernetes Service monitor page, monitor actions -> Edit monitor -> give the appropriate value and update.
Ensure your system has a stable network connectivity.
Connect to the AKS cluster and run the following kubectl commands to get to know the approximate amount of time it takes to receive a response.
kubectl get nodes
kubectl get pods --all-namespaces
Unable to perform data collection as the Cluster is in Stopped state.
We initiate data collection only when the AKS cluster is in RUNNING state.
Possible states: RUNNING, STOPPED.
If the cluster is in any other state (unless it is deleted), we will only update the "Cluster Information" group in "Overview" tab.
- To start data collection, go to Azure Portal -> Kubernetes Services -> Select the Cluster for which you want to start data collection -> click Start.
Unable to collect kubectl performance metrics. Reason: Command '{command}' not found
- Connect to the AKS cluster and run the command which is causing the issue in the machine where kubectl and Application Manager installed. Refer this troubleshooting document to connect the cluster to run the problematic command and send us the output.
Unable to collect some of the performance metrics. Reason {REASON}
- Ensure that you have met the pre-requisites particularly steps to enable container insights.
- Verify if Container Insights metrics are populated in Azure console only then Applications Manager can collect container insights metrics.
- Steps to verify if the Container Insights metrics are populated in Azure console:
Go to Azure portal -> Kubernetes Service -> Select the Cluster for which you have enabled container insights -> Monitoring tab in the left pane -> Metrics -> check if Namespaces available under Custom category -> click on the required Namespace(insights.container/nodes) -> choose the metric(cpuUsagePercentage) to see the data.
Applications Manager will be able to fetch the data for container insights only if it is populated in Azure console.
Frequently Asked Questions
How to bypass proxy for AKS Cluster FQDN?
- In Applications manager, navigate to Settings > Product settings > Connectivity > Proxy server.
- First verify if Proxy server has been configured in Applications Manager.
- If yes, to exclude kubectl from using proxy, navigate to Azure Kubernetes Service monitor page > Overview tab > Cluster information and get Cluster FQDN information. Give the endpoint information in the Do not use proxy for addresses beginning with field without protocol(http/https)
Proxy is only supported from kubectl version 1.19 and above.
How to disable automatic alerts for a specific node condition?
Disable the specific condition by navigating to Settings > Performance Polling > Optimize Data Collection > Azure Kubernetes Service.
If a node is not in the ready state, its health will be automatically affected.
New to ADSelfService Plus?
Related Articles
Unable to Add Kubernetes Monitor
If you are having trouble adding a Kubernetes monitor in Applications Manager, ensure that the the prerequisites have been met: Verify whether you can establish an SSH connection to the Kubernetes server from the APM installed machine. Use the ...How to connect Azure Kubernetes Service(AKS) Cluster and run Kubectl commands
This KB has information about connecting the Azure Kubernetes Cluster using Azure CLI and kubectl commands. Verify both Azure CLI and kubectl are configured in Applications Manager installed server as mentioned in our prerequisites. This document ...Absence of data in the Pods tab or some tabs in the Kubernetes monitor
This is a known issue in the older version of Applications Manager, which is fixed in APM v16800. So, we recommend upgrading the Applications Manager to the stable version to properly fix this issue. To collect data for the Kubernetes Monitor, ...AWS EKS Troubleshooting FAQs
AWS EKS monitor can be configured only if you have already added an Amazon monitor in Applications Manager. Ensure that you have met the pre-requisites for the Amazon monitor before monitoring Elastic Kubernetes Service in Applications Manager. How ...Real User Monitor (RUM) - Troubleshooting
If the monitor has not polled data for a long time, follow the steps below for troubleshooting: Step 1: Check the RUM Agent configuration Real User Monitor requires the RUM Agent to be installed and mapped to the Applications Manager. Refer the help ...