Transaction Count Mismatch Between APM Insight and applications

Transaction Count Mismatch Between APM Insight and applications

Transaction counts are crucial for understanding application performance. However, discrepancies between APM Insight-reported and application-reported counts can cause confusion. This article explores common causes and solutions for these mismatches, aiming for a 99% to 100% match after adjustments.

Causes of Transaction Count Mismatch

  1. Sampling Rate: Applications Manager uses sampling to reduce overhead, capturing only a subset of transactions. Adjusting the sampling rate can help align the counts, potentially achieving a 99% to 100% match.
  2. Configuration Issues: Misconfigurations in the agent configuration profile or application settings can lead to incorrect data collection. This includes filters, exclusions, and incorrect threshold settings.
  3. Network Latency: Delays or losses in data transmission between the application and the APM Insight agent can affect transaction reporting.
  4. Data/Time Aggregation: Differences in how data is aggregated and reported by our agent compared to the application can cause discrepancies. APM tools often use different time windows or aggregation methods, resulting in these differences. There could be maximum of 1 or 2 minutes difference between data collection and reporting times.
  5. Calculation Differences: Custom time ranges set in Applications Manager may include an extra minute or use  different rounding rules, affecting the transaction counts.

Troubleshooting Steps

  1. Verify APM Configuration: Ensure that the agent profiles are configured correctly to monitor all relevant transactions. For example, adjust the sampling rate to capture a higher percentage of transactions. Set it to 100% for a period to compare counts 
  2. Compare Data Collection Methods: Understand the aggregation and filtering methods in both systems. For example, ensure that no transactions are being filtered out or preprocessed in a way that affects the counts.

  3. Analyze Network Traffic: Monitor for packet loss and network latency.
  4. Review Logs and Metrics: Look for discrepancies and missing entries.
  5. Test with Controlled Transactions: Perform controlled tests to compare reported counts. For example, execute a known number of transactions and compare the counts reported by the agent and the application. This can help isolate the source of the mismatch.
  6. Adjust for Time Aggregation and Calculation Differences: Ensure matching time aggregation settings and custom ranges. For example, be aware that custom time ranges in Applications Manager might include an extra minute or use different rounding rules. Adjust the custom ranges to match the application's reporting periods.

Additional Considerations

Based on the application load (requests per minute), the mismatch in counts can vary. The percentage discrepancy can range from as low as 0.1% to potentially significant differences, especially under high load conditions. This variability underscores the importance of thorough troubleshooting to identify and correct the root causes.

Conclusion

Transaction count mismatches can be resolved by adjusting configurations, ensuring complete instrumentation, and aligning data collection methods. By systematically troubleshooting and understanding time aggregation and calculation differences, a 99% to 100% match is achievable, ensuring accurate performance monitoring. 


                  New to ADSelfService Plus?

                    • Related Articles

                    • Uninstrumented Block of Code - APM Insight

                      In the traces tab --> Slowest Method Calls and Count we show if you find Un-instrumented block of code the reason is as follows: Basically, What is un-instrumented block of code in APM Insight? By default, APM Insight agent monitors known frameworks ...
                    • Self monitor Applications Manager using APM Insight Java Agent

                      Applications Manager is built with Java, hence we can monitor it using APM Insight Java Agent to measure it's performance continuously, which can be very much useful. Setting up APM Insight Java Agent Follow the below steps to download and set up the ...
                    • APM Insight Troubleshooting - FAQs

                      Monitor Addition - FAQs 1. How to add an APM Insight Monitor? After you deploy the APM Insight agent in your Application Server with suitable Applications Manager credentials in the apminsight.conf file, APM Insight monitors will automatically be ...
                    • APM Insight monitor not getting added to Applications Manager

                      Possible Reasons for the Issue, 1. Incorrect Host and Port Settings The host and port settings for the Application Manager in the APM Insight agent's configuration may be incorrect. To verify and correct these settings, follow the steps below: Linux: ...
                    • How to rename an existing APM - Java agent application's monitor?

                      In Applications Manager's APM(Application Performance Monitoring) doesn't support renaming applications/monitors from the web client. However, the application name of an existing application instance can be renamed in the `apminsight.conf` file and ...