MAP7012 Private network isolation procedure 12

The Network Topology tool has been used to determine that one management console has lost connectivity to all nodes through the SW2 Ethernet switch (Gray network) eth3 port..

MAP7012 Section-1

Procedure

  1. Select the appropriate rack model:
  2. Locate the Ethernet switch SW2 (Gray network) at the rear of the storage facility that contains the failing management console. See Figure 1 for 16-port switches, and Figure 2, Figure 3, and Figure 4 for 8-port switches.
    Is the Ethernet switch powered on?
    Note: If this is an external management console, then go to the storage facility to which the management console is cabled.
    Figure 1. 16-port Ethernet switch port designations (SW1, SW2 - Tx) - Models 921/931, 922/932, 9A2/9B2
    Ethernet switch port designations (SW1, SW2 - Tx)
    Figure 2. 8-port Ethernet switch port designations (SW1, SW2-Tx) Models 921/931, 922/932, 9A2/9B2
    8-port Ethernet switch port designations (SW1, SW2-Tx)
    Figure 3. 8-port Ethernet switch port designations (SW1, SW2-Tx) Model 941, Model 951, and Model 961
    8-port Ethernet switch port designations (SW1, SW2-Tx)
    Figure 4. 8-port Ethernet switch port designations (SW1, SW2-Tx) Models 98x
    8-port Ethernet switch port locations, Model 98x
  3. Select the type of Ethernet switches in the affected storage facility:
    • 16-port Ethernet switches, go to step 4.
    • 8-port Ethernet switches, go to step 6.
  4. Observe the 16-port Ethernet switch port LEDs for the failing management console link (SW2-T1 for HMC1 or SW2-T2 for HMC2). See Figure 1. See Table 1 for a description and interpretation of the 16-port Ethernet switch port LEDs.
    Table 1. 16-port Ethernet switch port LED descriptions
    LED State Meaning
    Upper On 1000 Mb/s connection
    Off 100 Mb/s connection (Normal for FSP connection only)
    Lower Off No link
    On Link, No Activity
    Flashing Link, Activity

    There are two LEDs for each port. Is the lower Link LED lit solidly or flashing?

    • Yes, continue with step 9.
    • No, continue with the next step.
  5. Temporarily move the Ethernet cable to an unused port on the same switch. Observe the Ethernet switch port LEDs corresponding to the new location.

    Is the lower Link LED lit solidly or flashing?

    • Yes, it appears that the Ethernet switch is failing. Move the Ethernet cable back to its original port, and then go to MAP7012 Section-5.
    • No, move the Ethernet cable back to its original port and go to step 9.
  6. Observe the 8-port Ethernet switch port LEDs for the failing management console link (SW2-T1 for HMC1 or SW2-T2 for HMC2). See Figure 2.
    • When viewed from the rear of the rack, the Ethernet ports are numbered 1 to 8 from right to left. The LED indicator for each port is on the top front edge of the switch and are also numbered T1 to T8 from right to left.
    • See Table 2 for a description and interpretation of the 8-port Ethernet switch port LEDs.
    Table 2. 8-port Ethernet switch port LED description
    LED State Meaning
    Blue port LED Off No link
    On Link, No Activity
    Flashing Link, Activity
    Is the blue port LED lit solidly or flashing?
    • Yes, continue with step 9.
    • No, continue with the next step.
  7. Is there an unused port on the same switch?
    • Yes, go to the next step.
    • No, temporarily unplug the cable from port T8, and then continue with the next step.
      Note: For Models 9A2 and 9B2, this may cause a new serviceable event to be opened for Ethernet communications from the second LPAR on this CEC enclosure. After this cable is reconnected in the following step, you can close that serviceable event.
  8. Temporarily move the Ethernet cable to an unused port on the same switch. Observe the Ethernet switch port LEDs corresponding to the new location.
    Is the port LED lit solidly or flashing?
    • Yes, it appears that the Ethernet switch is failing. Move the Ethernet cable back to its original port. If you unplugged the cable from T8 to create an unused port, then reconnect that cable now. Then go to MAP7012 Section-5.
    • No, move the Ethernet cable back to its original port and continue with the next step.
  9. Select the step that applies to your management console:
    • If you have an xSeries x335, x336 or x3550 server, go to the next step.
    • If you have a ThinkPad W500 laptop, go to step 12.
    • If you have a ThinkPad laptop, go to step 13.
    • If you have a model 98x management console, go to step 14.
  10. Observe the eth3 link status LED on the rear of the failing management console. See Figure 5 (X335 server) or Figure 6 (X336 server) or Figure 7 (X3550 server).

    Is the eth3 Link Status LED lit?

    Figure 5. LEDs on the rear of the X335 management console server
    LEDs on the rear of the X335 MC server
    Figure 6. LEDs on the rear of the X336 management console server
    LEDs on the rear of the X336 MC server
    Figure 7. LEDs on the rear of the X3550 management console server
    LEDs on the rear of the X3550 management console server
  11. Move the Ethernet cable from eth3 to eth1. See Figure 8 (X335 server) or Figure 11 (X336 server) or Figure 12 (X3550 server).

    Is the eth1 Link Status LED lit?

    • Yes, it appears that the management console Ethernet port is failing. Restore the Ethernet cables to their original positions and continue with MAP7012 Section-3.
    • No, it appears that the Ethernet cable between the management console and the Ethernet switch is failing. Go to MAP 7012 Section-6 to replace the cable.
    Figure 8. Ethernet connectors on the rear of the X335 management console server
    Management console rear view with Ethernet locations
    Figure 9. Ethernet connectors on the rear of the X336 management console server
    X336 management console Ethernet ports
    Figure 10. Ethernet connectors on the rear of the X336 management console server
    X336 management console Ethernet ports
    Figure 11. Ethernet connectors on the rear of the X336 management console server
    X336 management console Ethernet ports
    Figure 12. Ethernet connectors X3550 management console server (rear view)
    X3550 management console server (front view)
  12. Observe the eth3 USB Ethernet 100/ACT LED indicator. See Figure 15.
    • The eth3 USB Ethernet adapter USB cable connects to the ThinkPad W500 as shown in Figure 14.
    • The USB and Ethernet cables that connect to the eth3 adapter are gray. See Figure 13.
    Figure 13. eth0 (black network) and eth3 (gray network) USB Ethernet adapters for Thinkpad W500 (similar for Thinkpad T510, T520, T530, T540)
    eth0 (black network) and eth3 (gray network) USB Ethernet adapters for Thinkpad W500 (similar for Thinkpad T510)
    Figure 14. Ethernet connectors eth3 for laptop management console server (rear view)
    Ethernet connectors eth3 for laptop management console server (rear view)
    Figure 15. USB Ethernet adapter LED indicators
    USB Ethernet adapter LED indicators

    Is the indicator lit or blinking?

    • Yes, the Ethernet connection appears to be working. Exit this MAP and determine if the failure is still occurring.
    • No, go to 15.
  13. Observe the eth3 USB Ethernet 100/ACT LED indicator. See Figure 15.
    • For T510, T520, and T530, the eth3 Ethernet adapter USB cable connects to the left side, lower USB connector Callout label 2 as shown in Figure 16.
    • For T540, the eth3 Ethernet adapter USB cable connects to the left side, rear USB connector Callout label 6 as shown in Figure 17.
    • The USB and ethernet cables that connect to the eth3 adapter are gray. See Figure 13.
    Figure 16. ThinkPad T510, T520, and T530 USB and RJ45 network connection ports
    ThinkPad T510 laptop unit cable connections
    Figure 17. ThinkPad T540 laptop unit cable connections (left and rear)
    ThinkPad T540 laptop unit cable connections (left and rear)

    Is the indicator lit or blinking?

    • Yes, the Ethernet connection appears to be working. Exit this MAP and determine if the failure is still occurring.
    • No, go to step 15.
  14. For Model 98x: observe the eth3 link status LED on the rear of the failing management console. See Figure 18.

    Is the eth3 Link Status LED lit?

    • Yes, the Ethernet connection appears to be working. Exit this MAP and determine whether the failure is still occurring.
    • No, complete the following steps:
      1. Ensure that the private network cable is properly connected to the model 98x management console and the network switch
      2. If the cable is properly connected, then try another network cable before replacing the model 98x management console.
      3. Continue with MAP7012 Section-3.
    Figure 18. Ethx and Ethx LEDs on the rear of the model 98x management console server
    Note: Ethernet ports: eth3  2 ; eth2  3 ; eth0  4 . The Ethernet port LED activity is the same format (left-right LED status) as in this figure.
    Model 98x management console cable connections (rear)
  15. Perform the following steps:
    1. Ensure that the eth3 USB Ethernet adapter is properly connected to the laptop leftmost USB port.
    2. Ensure that the private network cable is properly connected to the USB Ethernet adapter.
    3. If the cables are properly connected, the possible failing FRUs are the:
      • USB Ethernet adapter, private network cable, or USB cable, all three of which can be replaced concurrently
      • USB port on the laptop, which requires replacing the laptop

MAP7012 Section-2

In this section, you will attempt to resolve the problem by performing a network reset on the failing management console network port.

Procedure

Use the Network topology test tool as described in MAP7001 Using the network topology tool to check if the problem is resolved.

Is the network problem resolved?

  • Yes, return to the serviceable event and close it by reviewing the steps in MAP1500 Ending a service action.
  • No, replace the FRUs in the order listed in Table 3 until the problem is resolved.
Table 3. FRU replace actions
FRU Go to:
Management console Ethernet adapter MAP7012 Section-4
Ethernet switch MAP7012 Section-5
Cable, management console to Ethernet switch MAP7012 Section-6

MAP7012 Section-3

In this section, you will attempt to resolve the problem by performing a network reset on the failing management console network port.

Procedure

Use the Network topology tool as described in MAP7001 Using the network topology tool to check if the problem is resolved.

Is the network problem resolved?

  • Yes, return to the serviceable event and close it by reviewing the steps in MAP1500 Ending a service action.
  • No, if you have an x335, x336, or x3550 HMC go to MAP7012 Section-4 to replace the Ethernet adapter in the management console server.
  • No, if you have a ThinkPad laptop, go to MAP7012 Section-7 to replace one of the following FRUs:
    • eth3 Ethernet adapter
    • USB cable
    • ThinkPad laptop (the laptop system board is not a FRU, it takes too long to replace)
  • No, if you have a model 98x management console, go to MAP7012 Section-8 to replace the management console.

MAP7012 Section-4

In this section, you will replace the xSeries HMC Ethernet adapter eth3 to correct problems on the Gray network.

Procedure

  1. Ensure that the customer is not currently accessing the management console, such as to perform logical configuration functions or copy services functions.
  2. Open the appropriate manual contained on the IBM DS8000® series Service Documents CDROM:
    • xSeries 335 Type 8676, Type 8830 Hardware Maintenance Manual and Troubleshooting Guide
    • xSeries 336 Type 1879 and Type 8837 Hardware Maintenance Manual and Troubleshooting Guide
    • IBM System x3550 Type 7978 and 1913 Problem Determination and Service Guide
  3. Using the appropriate manual, replace the management console Ethernet adapter associated with eth3.
    Table 4. Management console (replacing the Ethernet adapters)
    Management console type Replace See figure:
    xSeries x335 System board P1 Figure 8
    xSeries 336 System board P1 Figure 11
    IBM® System x3550 Ethernet card P1-C1 Figure 12
    1. Power off the server (Refer to the "General information" section.)
    2. Replace the Ethernet card (Refer to the "Customer replaceable units" section.)
    3. Power on the server (Refer to the "General information" section.)
  4. Verify the fix using the Network Topology test tool as described in MAP7001 Using the network topology tool.

    Is the network problem resolved?

    • Yes, return to the serviceable event and close it by reviewing the steps in MAP1500 Ending a service action.
    • No, if you have other FRUs to replace, do so now. Otherwise, contact your next level of support.

MAP7012 Section-5

In this section, you will replace the SW2 Ethernet switch to correct problems with the Gray network.

Procedure

  1. Go to Exchanging parts to replace Ethernet switch SW2. Return her after the Ehternet switch as been replaced.
  2. Verify the fix using the Network Topology test tool as described in MAP7001 Using the network topology tool.

    Is the network problem resolved?

    • Yes, return to the serviceable event and close it by reviewing the steps in MAP1500 Ending a service action.
    • No, if you have other FRUs to replace, then continue with the replacement. Otherwise, contact your next level of support.

MAP7012 Section-6

In this section, you will replace the Ethernet cable between the management console and the Ethernet switch.

Procedure

  1. Go to Exchanging parts to replace the cable between the management console and the Ethernet switch. Return here when the cable has been replaced.
  2. Verify the fix using the Network Topology test tool as described in MAP7001 Using the network topology tool.

    Is the network problem resolved?

    • Yes, return to the serviceable event and close it by reviewing the steps in MAP1500 Ending a service action.
    • No, if you have other FRUs to replace, do so now. Otherwise, contact your next level of support.

MAP7012 Section-7

In this section, you will replace network FRUs on the laptop HMC.

Procedure

  1. Read all the following steps before beginning the repair.
    1. The following possible failing FRUs can be replaced with the laptop powered on:
      • eth3 USB Ethernet adapter
      • USB cable
      • Private network Ethernet cable
    2. This possible failing FRU requires the laptop to be shutdown and fully powered off.
      Note: Ensure that the customer is not currently accessing the management console to perform a logical configuration of Copy Services functions.
      • ThinkPad laptop. The laptop system board is not a FRU for the 242x products, it takes too long to replace.
  2. After replacing each FRU, observe the 100/ACT LED indicator on the Ethernet adapter.
    1. If it is lit, exit this MAP.
    2. If it is not lit and you have replaced both FRUs, try rebooting the HMC to reset the USB port.
    3. If the LED is still not lit, contact your next level of support.

MAP7012 Section-8

About this task

In this section, you replace the model 98x management console.

Procedure

  1. Read the following before beginning the repair.
    This possible failing FRU requires the management console to be shutdown and fully powered off.
    Note: Ensure that the customer is not currently accessing the management console to perform a logical configuration of Copy Services functions.
  2. After replacing the management console, observe the Activity indicator on the Ethernet port.
    1. If it is lit, exit this MAP.
    2. If it is not lit, and you have replaced all FRUs, try rebooting the HMC.
    3. If the LED is still not lit, contact your next level of support.

MAP7012 Section-9

Procedure

  1. At the front of the rack, slide the management enclosure out to the service position and remove the top cover. See Figure 19.
    Note: The management enclosure is below the two CEC enclosures.
    1. Fully loosen the left and right captive thumb screws.
    2. Slide the management out fully so the sliding rails lock into place.
    3. At the rear of the top cover, fully loosen the left and right captive thumb screws.
    4. Slide the cover back until it lifts off.
    Figure 19. Management enclosure, front (Model 983
    Front of Management enclosure (Model 983)
  2. Locate the Ethernet switch SW2 (lower, gray network). Observe the power LED indicator. See Figure 20 and Figure 21.
    Is the Ethernet switch powered on?
    Figure 20. Management enclosure locations (Model 983)
    Management enclosure locations
    Figure 21. Ethernet switch, rear (Model 983)
    Ethernet switch, rear (Model 983)
  3. Observe the SW2 (lower, Gray network) Ethernet switch port LED for the failing management console link.
    See Table 5 and Figure 22 for a description of the Ethernet switch port LEDs.

    Is the port LED lit solidly or flashing?

    • Yes, the Ethernet connection appears to be working. Go to step 13 to verify the connection.
    • No, continue with the next step.
    Table 5. Ethernet switch port LED description
    LED State Meaning
    Port LED Off No link
    On Link, No Activity
    Flashing Link, Activity
    Figure 22. Management enclosure Ethernet cables (Models 983)
    Management enclosure Ethernet cables (Models 983)
  4. Use Table 6 to locate both ends of the Ethernet cable plugged into the Ethernet switch port with the LED indicator that is not lit.
    Table 6. Ethernet switch to management console cables
    Switch - port Management console - port (See Figure 23.)
    SW2-T7 MC1 - eth3 Callout label 2
    SW2-T8 MC2 - eth3 Callout label 2
    Figure 23. Model 98x management console cable connections (rear)
    Model 98x management console cable connections (rear)
  5. Is either end of the Ethernet cable unplugged?
    • Yes, reconnect the cable and then go to step 13 to verify the repair.
    • No, go to the next step.
  6. Unplug both ends of the suspect Ethernet cable.
  7. Temporarily connect the mid-length Ethernet cable FRU between the now empty connector ports.
  8. Is the Ethernet port LED lit solidly or flashing?
    • Yes, the original Ethernet cable is failing, go to step 9.
    • No, go to step 10.
  9. Replace the failing Ethernet cable.
    1. If the original Ethernet cable can be removed from the cable bundle, do that. If not, cut off both ends of the cable so it cannot accidentally be used.
    2. Route and connect the Ethernet cable FRU. Use hook-and-loop fasteners to secure the cable to the cable bundle.
    3. Go to step 13 to verify the fix.
  10. Determine whether the Ethernet switch port is failing.
    1. Disconnect the Ethernet cable FRU from the Ethernet switch port.
    2. Temporarily disconnect the Ethernet cable from the Ethernet switch port 1. (It is not used.)
    3. Connect the Ethernet cable FRU to the Ethernet switch port T1.
    4. Is the Ethernet switch T1 port LED lit solidly or flashing?
      • Yes, the Ethernet switch port is failing. Replace the Ethernet switch. Go to step 11.
      • No, reconnect the Ethernet cable to the original port. The management console eth3 port is failing, go to step 12.
  11. Complete the following steps to replace the Ethernet switch.
    1. Remove the Ethernet cable FRU and return it to the FRU kit.
    2. Reconnect the original Ethernet cable to the Ethernet switch port 1.
    3. Reconnect the original Ethernet cable to the management console and Ethernet switch ports.
    4. Replace the Ethernet switch. Go to MAP7060 Replacing the Ethernet switch. Then, return here.
    5. Is the Ethernet switch port LED lit solidly or flashing?
      • Yes, to verify the fix, go to step 13.
      • No, the management console eth3 port is failing. Go to step 12 to replace the management console.
  12. Replace the management console.
    1. Replace the management console. Go to Exchange the small form factor management console. Then, return here.
    2. Is the Ethernet switch port LED lit solidly or flashing?
      • Yes, go to step 13 to verify the fix.
      • No, contact your next level of support.
  13. Verify the fix by using the Network Topology test tool as described in MAP7001 Using the network topology tool
    Is the network problem resolved?