MAP4100 Repairing a service processor (FSP) problem

This is not a standalone procedure. It must only be used if you were sent here from elsewhere in maintenance package. This MAP will assist you to diagnose and repair a service processor problem.

MAP4100 Section-1

Procedure

  1. Use Service Management > Manage Serviceable Events to check if you have a serviceable event to repair for the failing storage facility. Did you find a service processor or CEC enclosure system backplane to repair?
    • Yes, repair the problem using the serviceable event. Return to this MAP if you still have a service processor problem following the repair.
    • No, continue with the next step.
  2. Observe the CEC enclosure control panel. Is there a system reference code (SRC) displayed on the panel.
  3. Verify that the CEC enclosure which contains the failing service processor has power available. Check the LEDs on the rear of the CEC enclosure power supplies.
    Note: The DC good LED Callout label 2 might be on or flashing. This does not affect service processor power. See Figure 1, Figure 2, Figure 3, or Figure 4.

    Is the input power good LED Callout label 1 lit solid on at least one of the power supplies for the CEC enclosure?

    • Yes, continue with the next step. This will take you through a power cycle of the CEC to reset the service processor.
    • No, this problem should not normally occur on a single CEC enclosure. Do the following:
      • Check that all power distribution cables are plugged.
      • Check that the rack operator panel UEPO switch assembly is enabled.
        Note: This step does not apply to Model 98x.
      • Check that customer AC input is available - look for 'AC Input Good' LED on the rear of the primary power supplies.
      • If no problem is found, then contact your next level of support.
    Figure 1. CEC enclosure power supply LEDs (Model 951 shown, LEDs similar for Model 961)
    CEC Enclosure Power Supply LEDs
    Figure 2. CEC enclosure power supply LEDs (Models 980, 983, 984)
    Location of the power supplies and LEDs (Model 980)
    Figure 3. CEC enclosure power supply LEDs (Models 981, 985, 986)
    Location of the power supplies and LEDs (Models 981, 985, 986)
    Figure 4. Location of the power supplies and LEDs (Model 982, 988)
    Location of the power supplies and LEDs (Model 982)
  4. Quiesce the LPARs on the CEC enclosure that requires the service processor reset. Perform the following steps to select the CEC enclosure:
    Note: Repeat the following steps for each Storage Facility Image (SFI) (one or more) that runs on the CEC enclosure.
    1. From the navigation area, click Storage Facility Management > storage facility > SF image.
    2. From the right work area, select the LPAR.
    3. From the bottom Task area, click Service Utilities > Change/Show LPAR State > Quiesce LPAR
    4. Click Yes to confirm the action.
  5. Shut down the LPARs on the CEC enclosure that requires the FSP reset. Perform the following steps to select the CEC enclosure:
    Note: For model 941, repeat the following steps for each SFI (one or more) that runs on the CEC enclosure.
    1. From the navigation area, click Storage Facility Management > storage facility > SF image.
    2. From the right work area, select the LPAR.
    3. From the bottom Task area, click Service Utilities > Change/Show LPAR State > Shutdown LPAR.
    4. Click Yes to confirm the action.
  6. Attempt to power off the CEC enclosure using the Service Utilities. Perform the following steps to select the CEC enclosure:
    Note: If there is a communication problem between the HMC and the service processor, this step might not work.
    1. From the navigation area, click Storage Facility Management > storage facility > Server View > server.
    2. From the bottom Task area, click Service Utilities > Storage System Power Control.
    3. Click Power Off System and confirm the action.
  7. Verify that the power-off completed. At the rear of the storage facility, check the DC GOOD (output power) LEDs on both CEC enclosure power supplies (LED Callout label 2 in Figure 1). Are both DC GOOD LEDs flashing?
    • Yes, power off completed (output power is standby). Continue with step 12.
    • No, continue with the next step.
  8. Is the affected CEC enclosure in a 242x model 961 (8205-E6C or 8205-E6D) or a Model 98x (8284-22A, 8286-42A, 8408-44E, or 8408-E8E)?
    • Yes, continue with step 9.
    • No, continue with step 10.
  9. Pull the CEC enclosure control panel out to the service position.
    1. For Model 961, press the blue release tab to the left and pull the control panel out to the service position. See Figure 5.
      Figure 5. Accessing the control panel (Model 961)
      Removing the control panel
    2. For model 98x, at the front of the affected CEC enclosure, press the blue eject button  E  and pull the control panel out to the service position. See Figure 6. After you complete this procedure, carefully slide the control panel into the control panel bay until it latches in place.
      Figure 6. Control panel LEDs
      Control panel LEDs
  10. Power off the CEC enclosure using the CEC enclosure control panel. Perform the following steps while referring to Figure 7, Figure 8, or Figure 9.
    1. Press the Increment button until 02 is displayed on the display.
    2. Press Enter. Display will show:
      Panel displays A<
    3. Press Enter. The panel displays [N<] as shown:
      Panel displays N<
    4. Press the Increment button. The panel displays [M<] as shown:
      Panel displays M<
    5. Press Enter. The panel displays [V<] as shown:
      Panel displays V<
    6. Press Enter. The panel displays [P<] as shown:
      Panel displays P<
    7. Press Enter. Display will show 02 only.
    8. Press the Power button and hold it until you see the power down sequence start.
    9. Wait until the CEC enclosure has powered down (Power On light will be flashing).
  11. Reset the CEC enclosure to Normal mode.
    1. Press the Increment button until 02 is shown on the display.
    2. Press Enter. Display will show:
      Panel displays A<
    3. Press Enter. The '<' moves from [A<] to [N<] as shown:
      Panel displays N<
    4. Press the Increment button. The [N<] changes to [M<] as shown:
      Panel displays M<
    5. Press Enter three more times. The display will show 02.
    6. Continue with the next step.
      Figure 7. CEC enclosure control panel (Models 941, 951)
      CEC enclosure control panel
      In Figure 8, the following buttons provide the actions noted:
      • H: Decrement
      • I: Enter
      • J: Increment
      Figure 8. CEC enclosure control panel assembly (Model 961)
      CEC enclosure control panel assembly
      Figure 9. CEC enclosure control panel assembly (Models 98x)
      Control panel LEDs (Models 98x)
      • H: Decrement button
      • I: Enter button
      • J: Increment button
  12. Remove all power from the CEC enclosure. At the rear of the CEC enclosure, disconnect the power input cables from all CEC enclosure power supplies. See Table 1.
    Table 1. Power inputs and power indicators
    Model(s) Power input Power input reference Power indicator Power indicator reference
    941, 951 E1-J1, E2-J1 Callout label A, Figure 10 Green icon, below power button Figure 7
    961 E1-J1, E2-J1 E1-J1, E2-J1, Figure 11 Green icon, to right of power button Callout label B, Figure 8
    980, 983, 984 E1-J1, E2-J1 Callout label B, Figure 12 Green LED, part of power button Callout label A, Figure 9
    981, 985, 986 E1-J1, E2-J1, E3-J1, E4-J1 Callout label B, Figure 13 Green LED, part of power button Callout label A, Figure 9
    982, 988 E1-J1, E2-J1, E3-J1, E4-J1 Callout label B, Figure 14 Green LED, part of power button Callout label A, Figure 9
    At the CEC enclosure control panel, observe the power indicator.
    • If it is slow flashing, the CEC enclosure is still in the power off state. DO NOT CONTINUE. Ensure that you have unplugged the power cables.
    • If it is off, go to the next step.
    Figure 10. CEC enclosure power supply cables (Models 941, 951)
    CEC enclosure (rear)
    Figure 11. CEC enclosure location codes, rear view (Model 961)
    Location codes for the CEC enclosure (rear view) (Models 961)
    Figure 12. Removing the power cords (Models 980, 983, 984)
    Removing the power cords (Model 980)
    Figure 13. Removing the power cords (Models 981, 985, 986)
    Removing the power cords (Model 981)
    Figure 14. Removing the power cords (Models 982, 988)
    Removing the power cords (Model 982)
  13. Wait 2 minutes, then connect the power input cables to all CEC enclosure power supplies.
  14. Ensure that the CEC enclosure is in power off state before continuing. At the CEC enclosure control panel, wait for the green power indicator to slow flash.
  15. Attempt to power on the CEC enclosure using the Service Utilities. Perform the following steps to select the CEC enclosure:
    Note: If there is a communication problem between the HMC and the service processor, this step might not work.
    1. From the navigation area, click Storage Facility Management > storage facility > Server View > server.
    2. From the bottom Task area, click Service Utilities > Storage System Power Control.
    3. Click Power On System to Ready and confirm the action.
    Did the managed system (CEC) power-on?
    • Yes, continue with the next step.
    • No, go to step 19.
  16. Activate the LPARs on the CEC enclosure.
    Note: For model 941, repeat the following steps for each SFI (one or more) that runs on the CEC enclosure.
    1. From the navigation area, click Storage Facility Management > storage facility > SF image.
    2. From the right work area, select the LPAR.
    3. From the bottom Task area, click Service Utilities > Change/Show LPAR State > Activate LPAR.
    4. Click Yes to confirm the action.
  17. Resume the LPAR(s) on the CEC enclosure:
    Note: Repeat the following steps for each Storage Facility Image (SFI) (one or more) that runs on the CEC enclosure.
    1. From the navigation area, click Storage Facility Management > storage facility > SF image.
    2. From the right work area, select the LPAR.
    3. From the bottom Task area, click Service Utilities > Change/Show LPAR State > Resume LPAR.
    4. Click Yes to confirm the action.
  18. Return to the MAP or procedure that sent you here to verify whether the problem is resolved. Return here if the service processor is still failing.
  19. Select the storage model and affected CEC enclosure, and take the action indicated. See Table 2.
    Table 2. Storage and CEC enclosure models, actions to take
    Storage model CEC enclosure model Action to take
    242x-941, 242x-951 9117-MMA Continue with step 20.
    242x-961 8205-E6C, 8205-E6D Continue with step 21.
    283x-980, 283x-984
    533x-983, 533x-984     		8284-22A Continue with step 21.
    283x-981, 283x-985, 283x-986 533x-985, 533x-986 8286-42A Continue with step 21.
    283x-982, 533x-988 8408-44E, 8408-E8E Continue with step 20.
  20. Use Storage Facility Management > storage facility > Exchange Parts to replace the following parts in sequence until the problem is resolved:
    • Service processor
      • Un-P1-C11 (9117-MMA)
      • Un-P1-C5 (8408-44E, 8408-E8E)
    • CEC enclosure I/O backplane (Models 941, 951, 98x)
      • Un-P1 (9117-MMA)
      • Un-P1 (8408-44E, 8408-E8E)

    If the problem remains, contact your next level of support.

  21. Use Storage Facility Management > storage facility > Exchange Parts to replace the following part:
    • CEC enclosure system backplane
      • Un-P1 (8205-E6C, 8205-E6D)
      • Un-P1 (8284-22A, 8286-42A)

    If the problem remains, contact your next level of support.