MAP7060 Replacing the Ethernet switch

MAP7060 Section-1

About this task

Notes:

The replacement of the Ethernet switch is a manual process. There is no HMC GUI code driven process to manage the resource and help guide you through the repair.
There are two private networks: one is known as "Gray" and the other as "Black." One of the two networks must always be functional to all connected nodes.
The private networks are automatically checked every few minutes by a microcode driven "heartbeat" communication process that checks HMC-to-LPAR as well as HMC-to-HMC communications. A serviceable event is opened if a problem is found.
There is an HMC GUI network topology tool that displays the nodes and their "health" status. Running it does not cause a serviceable event to be created.

Procedure

Were you directed to this MAP to replace a failing Ethernet switch?
- Yes, go to 7.
- No, go to 2.
Were you directed to this MAP from a serviceable event FRU list that had MAP7060 as the first FRU?
- Yes, use the serviceable event FRU location information to determine which Ethernet switch to replace. See figures, then go to step 7.
  - Models 94x, 95x, 96x, see Figure 1.
  - Models 98x (not 983), see Figure 2.
  - Models 983. See Figure 14.
- No, go to step 3.
Figure 1. "SW1 (left) black" and "SW2 (right) gray"

Figure 2. 8-port Ethernet switch port locations, Model 98x

Note: Upper switch SW1 is "black" network; lower switch SW2 is "gray" network.
Display open serviceable events. Look for those events that could be related to private network problems.
Observe the SRC definition and also look for the following FRUs:
- For Models 941, 951:
  - CEC enclosure I/O planar assembly
  - CEC enclosure VPD pass-through card
  - CEC enclosure service processor card
- For Model 961:
  - CEC enclosure system backplane
  - CEC enclosure Ethernet four-port 1 Gb copper card
- For Model 98x:
  - CEC enclosure system backplane
  - CEC enclosure Ethernet multi-port 1 Gb card
Are there any open serviceable events related to the private networks?
- Yes, exit this MAP and repair the related serviceable event.
- No, go to the next step.
Run the private network topology utility to view the state of the network. Refer to MAP7001 Using the network topology tool.
Did you find any network problems?
- Yes, use MAP7001 Section-4 (Analyzing the results and repairing the network) to repair the problem.
- No, there are no indicated problems with the private network but you want to replace an Ethernet switch. Go to the next step.
Select the following option that applies:
- 16-port switch (Model 941), go to MAP7060 Section-2 (16-port switch Model 941).
- 8-port switch (Model 941), go to MAP7060 Section-3 (8-port switch Model 941).
- 8-port switch (Model 951), go to MAP7060 Section-4 (8-port Model 951).
- 8-port switch (Model 961), go to MAP7060 Section-6 (8-port Model 961).
- 8-port switch (Model 98x, not 983), go to MAP7060 Section-7 (8-port Model 98x, not 983).
- 8-port switch (Model 983), go to MAP7060 Section-8 (8-port Model 983).

MAP7060 Section-2 (16-port switch Model 941)

Procedure

At the rear of the rack:
1. Disconnect the rack power cord from the Ethernet switch assembly. See Figure 3.
2. Disconnect the Ethernet cables .
  Figure 3. Ethernet switch with cables
Unscrew the two captive thumbscrews , as shown in Figure 4, and remove the Ethernet switch from the rack.
Figure 4. Ethernet switch (removed)
Unplug the power cable from the Ethernet switch.
Remove the four screws that attach the left and right sheet metal brackets.
Install the left and right sheet metal brackets with two screws each.
Connect the power cable to the Ethernet switch.
At the rear of the rack, install the Ethernet switch assembly in the rack and secure it with the two captive thumbscrews , as shown in Figure 4.
Connect the rack power cord.
Connect the Ethernet cables.
Go to MAP7060 Section-5 (Checking the switch).

MAP7060 Section-3 (8-port switch Model 941)

Procedure

At the rear of the rack:
1. Disconnect the rack power cord from the Ethernet switch assembly. See Figure 5.
2. Disconnect the Ethernet cables .
3. Remove screw .
  Figure 5. 8-port Ethernet switches
Remove the Ethernet switch assembly.
- The Ethernet switch FRU is the assembly that includes the switch, the sheet metal enclosure it is mounted on, and the power adapter inside the enclosure.
- The switch enclosure slides to the rear of the rack to so that you can see the port LED indicators on the top surface of the switch.
- There is one tab at each rear corner of the enclosure that engages the slots in the sheet metal tray that supports both switch enclosures. See Figure 6.
- If you do not lift the rear of the switch enclosure, the tabs stay engaged, and the enclosure slides forward to the service position and then stops.
- Instead, if you slide it to the rear a little and then lift the rear of the enclosure, the tabs disengage from the slot, and you can fully remove the enclosure.
Figure 6. Rear enclosure tab and sheet metal tray slot
Set the new Ethernet switch assembly on the sheet metal tray. Slide it in far enough so that the enclosure rear tabs drop down through the sheet metal tray slot cutout. Then, slide the tray fully in.
Install the retaining screw in the front of the enclosure.
Connect the rack power cable.
Connect the Ethernet cables.
Reinstall the air baffle.
Go to MAP7060 Section-5 (Checking the switch).

MAP7060 Section-4 (8-port Model 951)

Procedure

At the rear of the rack, remove the air baffle above the Ethernet switch tray, as shown in Figure 7.
1. Remove the two mounting screws .
2. Pivot the two mounting tabs inward so they do not interfere with the cables upon removal.
3. Carefully remove the air baffle plate to not damage any cables.
Figure 7. Ethernet switch tray air baffle (Model 951)
At the rear of the rack (see Figure 7):
1. Disconnect the rack power cord from the Ethernet switch assembly.
2. Disconnect the Ethernet cables .
3. Remove screw .
Remove the Ethernet switch assembly.
Install the new Ethernet switch assembly.
Install the front retaining screw.
Connect the power cable.
Connect the Ethernet cables.
Reinstall the air baffle.
Go to MAP7060 Section-5 (Checking the switch).

MAP7060 Section-5 (Checking the switch)

Procedure

Ensure that at least one Ethernet switch LED indicator is lit, indicating it is powered on.
Display open serviceable events.

The replacement of the switch might cause at least one serviceable event to be opened for the loss of the private network connectivity.
Display the serviceable event details and ensure that it is related to the private network you affected with the switch replacement and then close it.
Run the network topology tool to check the status of the private network nodes. See MAP7001 Section-4 (Analyzing the results and repairing the network).
Exit this procedure.

MAP7060 Section-6 (8-port Model 961)

Procedure

At the rear of the rack, remove the Ethernet switch (see Figure 8):
1. Disconnect the rack power cable and Ethernet cables from the Ethernet switch.
2. Do not remove the Ethernet tray sheet metal air baffle .
3. The Ethernet switch is held to the sheet metal tray by four hook-and-loop fasteners. See Figure 9.
4. Beginning at one corner, lift the Ethernet switch off the tray.
Figure 8. Ethernet switches SW1 and SW2 (Model 961), rack version 1 shown, rack version 2 similar

Figure 9. Four hook-and-loop fasteners for each Ethernet switch
There are three possible Ethernet switch FRUs, depending on which FRU P/N is ordered.
- Version 1 Ethernet switch that is fastened to a sheet metal bracket. Go to step 3.
- Version 2 Ethernet switch with power cable(s). Go to step 4.
- Version 2 Ethernet switch with no power cable(s). Go to step 4.
For Version 1, do the following steps:
1. Remove the two black plastic latches that fasten the new Ethernet switch to the sheet metal bracket. See Figure 10.
2. Discard the latches and sheet metal bracket.
3. Locate the four hook-and-loop fasteners in the FRU kit and place one squarely on each Ethernet tray hook-and-loop fastener.
4. Peel the backing off each hook-and-loop fastener to expose the adhesive surface.
5. Align the Ethernet switch with the partner Ethernet switch and push down firmly. Gently lift to ensure that it is properly fastened.
6. Properly connect the power and Ethernet cables; refer to the cable location labels.
7. Go to MAP7060 Section-5 (Checking the switch).
Figure 10. Release Ethernet switch from the sheet metal bracket
For Version 2, do the following steps:
1. Set the new Ethernet switch on top of the tray so it aligns evenly with the partner Ethernet switch. See Figure 8. Push down firmly and then gently lift to ensure that it is fastened to the Ethernet switch tray.
2. Connect the Ethernet cables.
3. Connect the power cable.
  
  If the existing power cable does not properly plug into the new Version 2 Ethernet switch, use the power-cable installation instructions in the FRU kit to install the proper cable.
4. Go to MAP7060 Section-5 (Checking the switch).

MAP7060 Section-7 (8-port Model 98x, not 983)

Procedure

At the right rear of the rack, remove the Ethernet switch:
1. Disconnect the input power cable and Ethernet cables (ports T1-T8) from the Ethernet switch. See Figure 11.
2. Loosen the fasteners securing the Ethernet switch bracket to the frame. See Figure 12.
3. Remove or pivot the bracket as needed, then remove the Ethernet switch.
Install the new Ethernet switch:
1. Hold the switch in position, and position the bracket over the switch.
2. Tighten the fasteners to secure the bracket.
3. Connect Ethernet cables.
4. Connect the input power cable.
5. Go to MAP7060 Section-5 (Checking the switch).
Figure 11. 8-port Ethernet switch port locations, Model 98x

Note: Upper switch SW1 is "black" network; lower switch SW2 is "gray" network.

Figure 12. 8-port Ethernet switch brackets, Model 98x

MAP7060 Section-8 (8-port Model 983)

Procedure

At the front of the rack, slide the management enclosure out to the service position and remove the top cover. See Figure 13.

Note: The management enclosure is below the two CEC enclosures.
1. Fully loosen the left and right captive thumb screws.
2. Slide the management out fully so the sliding rails lock into place.
3. At the rear of the top cover, fully loosen the left and right captive thumb screws.
4. Slide the cover back until it lifts off.
Figure 13. Management enclosure, front (Model 983)
Prepare to remove the Ethernet switch:
1. Determine which Ethernet switch is to be replaced. See Figure 14.
  - SW1, Black network, upper
  - SW2, Gray network, lower
2. Remove the hold-down bracket for the upper Ethernet switch.
3. If you are removing SW1 upper, go to step 3.
4. If you are removing SW2 lower, carefully lift the upper Ethernet switch up and out of way. Ensure that the power input cable is not accidentally pulled out.
5. Go to step 3.
Figure 14. Management enclosure locations.
Remove the Ethernet switch.
1. Disconnect the input power cable.
2. At the Ethernet switch, disconnect the Ethernet cables at ports T7-T8. See Figure 15.
3. At the Ethernet switch, disconnect the Ethernet cables at ports T2-T6. See Figure 15.
  
  Note: Port T1 is not used. Notice that the Ethernet switch port T2 cable goes to the T2 coupler at the rear of the management enclosure. Similar for T3 to T3, T4 to T4, and so on. See Figure 16.
Figure 15. Ethernet switch, rear (Model 983)

Figure 16. Management enclosure Ethernet cable connections
Install the new Ethernet switch:
1. Hold the switch in position, and position the bracket over the switch.
2. Tighten the fasteners to secure the bracket.
3. Connect Ethernet cables.
  
  Note: Port T1 is not used. Notice that the Ethernet switch port T2 cable goes to the T2 coupler at the rear of the management enclosure. Similar for T3 to T3, T4 to T4, and so on. See Figure 16.
4. Connect the input power cable.
5. If SW2 lower was replaced, put SW1 upper in position and install the hold-down bracket.
Return the management enclosure to the operating position.
1. Install the cover and fasten the two rear captive thumbscrews.
2. Slide the management enclosure fully in and tighten the left and right captive thumb screws.
Go to MAP7060 Section-5 (Checking the switch).