Field Notice: FN - 72187 - UCS 2408 IOM Upgrade/Downgrade Failure on Some Units Shipped in April 2021 - Hardware Upgrade Available

Available Languages

Updated:November 16, 2022
Document ID:FN72187

Bias-Free Language

The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product. Learn more about how Cisco is using Inclusive Language.

Notice

THIS FIELD NOTICE IS PROVIDED ON AN "AS IS" BASIS AND DOES NOT IMPLY ANY KIND OF GUARANTEE OR WARRANTY, INCLUDING THE WARRANTY OF MERCHANTABILITY. YOUR USE OF THE INFORMATION ON THE FIELD NOTICE OR MATERIALS LINKED FROM THE FIELD NOTICE IS AT YOUR OWN RISK. CISCO RESERVES THE RIGHT TO CHANGE OR UPDATE THIS FIELD NOTICE AT ANY TIME.

Revision History

Revision Publish Date Comments
1.2
16-Nov-22
Updated the Upgrade Program to Use Support Case Manager (SCM)
1.1
23-Aug-21
Updated the Upgrade Program Replacement Tracking Number
1.0
08-Jun-21
Initial Release

Products Affected

Affected Product ID Comments
UCS-IOM-2408
UCS-IOM-2408=
Part Alternate

Defect Information

Defect ID Headline
CSCvy20701 2408 IOM upgrade/downgrade failure on subset shipped April 2021

Problem Description

Firmware upgrade or downgrade attempts on a subset of Cisco UCS-IOM-2408 Fabric Extender Expansion Modules shipped in April 2021 will fail and continuously repeat the firmware update process.

Background

A subset of UCS-IOM-2408 Fabric Extender Expansion Modules shipped in April 2021 will not allow a firmware upgrade or downgrade to complete successfully. This is a hardware issue.

Problem Symptom

Any upgrade or downgrade attempt of the 2408 I/O Module (IOM) firmware will fail and loop continuously. This will primarily manifest as a failure immediately after the initial installation to a Unified Computing System (UCS) domain.

If the IOM did not require upgrade or downgrade upon installation, the IOM will be functional until a firmware change is attempted. In this case, the Technical Assistance Center (TAC) will not be able to access the IOM’s debug kernel shell.

During Upgrade Failures

Cisco UCS Manager faults will show many occurences of a message similar to "IOM 1/1 (A) is auto upgrading firmware".

The NX-OS CLI command show fex detail will repeat "Requesting satellite to download image".

The IOM /cmc/log/updated log will show:

NOCSN_updated-3-CMC  0:validate_image_signature:Image signature validation failed#012
NOCSN_updated-3-CMC  1067:check_magic:error reading key
NOCSN_updated-3-CMC  1067:check_magic:error reading key

Workaround/Solution

The impacted UCS-IOM-2408 Fabric Extender Expansion Modules should be replaced. Follow the instructions in the How To Identify Affected Products section in order to determine if your IOM is impacted. If it is impacted, complete the form at the end of this field notice to request a replacement.

How To Identify Affected Products

If installation has not been attempted, the UCS-IOM-2408 serial numbers can be collected from the Cisco Sales Order details when they were procured.

If installed, the UCS-IOM-2408 expansion module serial numbers can be collected from UCS Manager or from the NX-OS CLI.

UCS Manager - Click the Equipment tab and choose Chassis > Chassis X > IO Module Y for any UCS-IOM-2408 expansion module in question. The serial number will be listed under Properties.

NX-OS CLI - SSH to the Cluster Virtual IP address and enter this sequence of commands in order to show all IOM serial numbers in the system:

  • connect nxos a
  • show fex
  • exit
  • connect nxos b
  • show fex
  • exit

With this list of serial numbers, verify if the UCS-IOM-2408 IOM is impacted or not using the Serial Number Validation Tool in the next section.

Serial Number Validation

Cisco provides a tool to verify whether a device is impacted by this issue. In order to check the device, enter the device's serial number in the Serial Number Validation Tool.

Note: For security reasons, you must click on the Serial Number Validation Tool link provided in this section to check the serial number for the device. Use of the Serial Number Validation Tool URL external to this field notice will fail.

Upgrade Program Information

Support Case Manager must be used for ordering replacement parts for this Field Notice.

Click on the following link to open Support Case Manager in a new tab:
https://mycase.cloudapps.cisco.com/fieldnotice?fn=FN72187

  1. Serial Numbers (SNs) must be provided and be affected.
    • SN Entitlement Check will be performed.
    • Order entry supports up to 50 SNs per request. If you have more than 50, you will need to submit more than 1 request.
  2. One ship to address per request.
  3. Service Request number (SR#) is not required, but if you have an Existing SR# please enter it for better tracking purposes.

For More Information

If you require further assistance, or if you have any further questions regarding this field notice, please contact the Cisco Systems Technical Assistance Center (TAC) by one of the following methods:

Receive Email Notification For New Field Notices

My Notifications—Set up a profile to receive email updates about reliability, safety, network security, and end-of-sale issues for the Cisco products you specify.

Was this Document Helpful?

FeedbackFeedback

Contact Cisco

This Document Applies to These Products