The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product. Learn more about how Cisco is using Inclusive Language.
THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.
Unacknowledged Reports can cause High CPU Utilization due to Smart Agent
For affected versions of the Cisco IOS® XE software, devices might report high CPU or memory usage. In some scenarios, devices might report both high CPU and memory usage.
This issue is seen only when the 'Smart Licensing Using Policy' feature is implemented on the device.
This issue is seen when the "Smart Licensing Using Policy" feature is implemented, and Resource Utilization Measurement (RUM) reports are accumulated in large quantities on the device.
The underlying reason for the accumulation could be a communication issue between the device and Cisco Smart Software Manager (CSSM). When RUM reports do not get the required acknowledgement, they accumulate on the device and can cause high CPU/memory usage.
The underlying reason for the RUM report accumulation could be a communication issue between the device and Cisco Smart Software Manager (CSSM).
This error log might be observed in the affected device:
%SMART_LIC-3-COMM_FAILED: Communications failure with the Cisco Smart Software Manager (CSSM) : Communications failure
This issue can occur when there is an increasing trend of accumulated RUM reports in the device. The increasing trend of accumulated RUM reports can be viewed with multiple iterations of these commands:
Sample output is shown here:
system#license smart save usage all file flash:report.txt
system#more flash:report.txt | count RUMReport
Number of lines which match regexp = 214 <<<< This counter may increase over multiple iterations
Cisco has observed that at 1000 RUM reports, high CPU/memory usage might be seen. This value, however, is not fixed and will vary depending on network conditions and topology. It is highly recommended that the mitigation steps (see the Workaround/Solution section) are taken as soon as RUM reports start to accumulate.
For high CPU, the processes “SAGetRUMIds” and “SAUtilRepSave” will be seen.
Sample output is shown here:
system#show processes cpu sorted
CPU utilization for five seconds: 99%/99%; one minute: 99%; five minutes: 99%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
725 4042749037 313719798 12886 75.29% 77.09% 76.24% 0 SAGetRUMIds
154 164791260 261212986 630 21.62% 21.81% 22.97% 0 SAUtilRepSave
For high memory usage, there will be an increasing trend in memory held by the “MallocLite” process.
The underlying reason for the RUM report accumulation could be a communication issue between the device and CSSM. Ensure that the underlying connectivity operates as expected for your network as per the smart licensing implementation.
Either of these workarounds can be implemented in order to temporarily resolve the issue:
Clean Up RUM Report Accumulation
Enter the license smart factory reset command followed by a device reload with the reload command.
Receive Email Notification About New Field Notices
To receive email updates about Field Notices (reliability and safety issues), Security Advisories (network security issues), and end-of-life announcements for specific Cisco products, set up a profile in My Notifications