Pre-check while you are applying one-off patch

Oracle Database的补丁除去我们最常见的Patch set大补丁集(就是那种动辄1、2个G的补丁包)外，还包括Critical Patch Update(CPU)和Patch Set Update(PSU),one-off Patch(一次性补丁);在数据库使用过程中出现某些问题后(最常见的是出现ORA-00600、ORA-07445错误)，通过DBA与MOS的协作将问题定位到某个大版本上的具体Bug，如果该Bug在该版本上现有one-off patch的话，我们可以通过one-off patch的实施来解决问题，one-off patch具有如下特点:

one-off patch的patch包一般都很小，因为它是为了修正一个或多个bug所特制，它一般只包含必要的inventory xml信息，以及和bug相关的共享库文件(一般是.o或者.a文件)
one-off patch绝大多数是随需随制，一般是Oracle内部人员发现Bug或者客户在生产过程中遇到Bug后，向Oracle development开发部门提出patch building的Request ，开发人员接到building或backport的要求后会为客户系统指定的数据库版本和操作系统平台特制一个补丁(如果还没有的话)；举例来说可能一个bug在Linux平台的10.2.0.4版本中已有one-off patch，但客户在Solaris Sparc 平台上10.2.0.3上碰到同样的bug，那么这个时候就可以提交SR要求Oracle开发部门backport这个patch
绝大多数one-off patch只需要用Opatch工具apply即可，不需要升级/修正数据字典，这一点和Patch set/CPU/PSU是不同的
one-off patch是针对某个特殊版本的，如10.2.0.4上的one-off patch只能针对10.2.0.4实施，而在10.2.0.4.8(10.2.0.4的PSU 8)上该one-off patch可能是一个conflicting Bug即有冲突的一次性bug补丁；针对这种情况Oracle一般会给出当前版本上的替代one-off patch，例如6996030″MERGE LABEL REQUEST ON TOP OF 10.2.0.4 FOR AUDIT TRAIL CLEAN-UP”是10.2.0.4上的一个one-off patch，但在10.2.0.4.4上6996030是一个conflicting bug存在冲突，这样我们就需要一个替代品、一个10.2.0.4.4上的Equivalent patch等价补丁，在我们的例子中这个patch是9650152 “MERGE REQUEST ON TOP OF 10.2.0.4.4 FOR BUGS 9589005 6805009 6991606”
实施one-off patch意味着你的数据库软件将与其他主流版本的数据库在行为方式上有所区别，另一方面你需要考虑到如果发现了新的Bug并考虑打上另一个one-off patch时可能存在Conflicting冲突。大多数情况下one-off patch可以迅速帮我们解决Bug，但反过来说实施任意一个one-off patch时我们可能冒着今后花费更多时间去维护数据库补丁的风险；就这一点来看，应用one-off patch有着它明显的缺点
在11g中提出了hot patch的概念，这里的patch就是指的one-off patch；就目前看来online-patching只是一个噱头，因为真正具备在线实施能力的patch少之又少，你很难从MOS上的patch专栏中找到一个可用的online-patch
一个我个人的观点：Oracle GCS会通过stack call、trace、dump等信息将问题定位到bug，最为常见的是ORA-00600、ORA-07445等内部错误，这些错误因为有着明确的error argument、stack call等信息可以让GCS精确地定位故障，而对于另一些问题例如process spin、异常等待事件等不产生明确argument、stack、dump的问题时，定位就要困难一些。我们经常可以看到一些bug note，在客户apply one-off patch并设置特定event后one-off patch并不起作用，导致这种情况的原因多种多样，一种可能是patch在开发过程中存在问题(补丁代码没有被正确触发),另一种则是bug没有被准确定位。

我们目前的问题在于虽然one-off patch存在这样那样的问题，但很多时候又不得不实施one-off patch(大多数原因是停机时间限制);以及在一个已经实施了诸多Patch set、PSU、CPU和one-off patch的环境中新增one-off patch，为了更好地完成这项工作，我们有必要在具体实施补丁前完成以下的预备工作：

1.在定位到具体Bug后我们可以获得一个Bug No#，使用该No#到My Oracle Support上的Patches & Updates专栏中搜索该Bug相关的patch信息，这里存在三种情况：

最好的情况是指定的数据库版本和操作系统平台上存在相关的patch
指定数据库版本上有patch，注意这里的指定数据库版本需要精确到具体的PSU，但没有指定操作系统平台上的，这个时候可以提交SR要求在指定平台上build一个
指定数据库版本上没有patch，注意这里的指定数据库版本需要精确到具体的PSU，例如10.2.0.4上的patch是不能直接用在10.2.0.4.x上的;针对这种情况我们可以首先查询Metalink Note“Patch Set Updates – One-off Patch Conflict Resolution”,可以从这个Note中查到指定one-off patch是否被包含在某个psu中，或者在某个psu上有特定的等价补丁(Equivalent on top)，一部分one-off patch在不同的psu之间还存在通用性，如10.2.0.4.4上的部分patch可以在10.2.0.4.5上实施，具体是否通用可以参考下文中冲突检查的方法来检验。如果都没有等价补丁也没有通用补丁那么需要提交SR让Oracle开发部门去merge一个

2.更复杂的情况是在现有版本上已经应用了某些特定的patch(psu、cpu、或者其他one-off patch)，我们要保证需要新增的one-off patch之间不存在conflict关系，也不会和系统中已有的patch发生conflict，这时候我们可以使用opatch prereq命令来做冲突检查并得到相关建议，如:

[oracle@rh2 tmp]$ /s01/db_1/OPatch/opatch lsinventory
Invoking OPatch 11.2.0.1.3
Oracle Interim Patch Installer version 11.2.0.1.3
Copyright (c) 2010, Oracle Corporation.  All rights reserved.

Oracle Home       : /s01/db_1
Central Inventory : /s01/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.3
OUI version       : 10.2.0.4.0
OUI location      : /s01/db_1/oui
Log file location : /s01/db_1/cfgtoollogs/opatch/opatch2011-05-06_21-41-39PM.log

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt

Lsinventory Output file location : /s01/db_1/cfgtoollogs/opatch/lsinv/lsinventory2011-05-06_21-41-39PM.txt

--------------------------------------------------------------------------------
Installed Top-level Products (2): 

Oracle Database 10g                                                  10.2.0.1.0
Oracle Database 10g Release 2 Patch Set 3                            10.2.0.4.0
There are 2 products installed in this Oracle Home.

Interim patches (2) :

Patch  9654991      : applied on Fri May 06 21:33:38 CST 2011
Unique Patch ID:  12816418
   Created on 30 Jun 2010, 18:30:40 hrs PST8PDT
   Bugs fixed:
     9714832, 9713537, 9678695, 9655017, 9173248, 8309642, 9678697, 9678690
     9573054, 9654991
   This patch overlays patches:
     9352164
   This patch needs patches:
     9352164
   as prerequisites

Patch  9352164      : applied on Fri May 06 21:29:20 CST 2011
Unique Patch ID:  12307477
   Created on 1 Apr 2010, 11:33:14 hrs PST8PDT
   Bugs fixed:

/* 以上示例环境中实施了10.2.0.4上的psu4(9352164)和psu5(9654991) */

/* 在示例环境中我们试图实施补丁7527908和9696904，这2个merge patch是针对psu4(10.2.0.4.4)版本的，
    但在psu5(10.2.0.4.5)上没有相应的替代补丁，我们需要检测这2个patch是否和psu5发生冲突  */

[oracle@rh2 ~]$ mkdir $ORACLE_HOME/patches

/* 在Oracle HOME下创建存放patch的目录 */

[oracle@rh2 ~]$ cd $ORACLE_HOME/patches

[oracle@rh2 patches]$ unzip /home/oracle/patch/p7527908_102044_Linux-x86-64.zip 

Archive:  /home/oracle/patch/p7527908_102044_Linux-x86-64.zip
   creating: 7527908/
   creating: 7527908/files/
   creating: 7527908/files/lib/
   creating: 7527908/files/lib/libserver10.a/
  inflating: 7527908/files/lib/libserver10.a/ktm.o
  inflating: 7527908/files/lib/libserver10.a/ktu.o
  inflating: 7527908/files/lib/libserver10.a/ktusm.o
   creating: 7527908/etc/
   creating: 7527908/etc/config/
  inflating: 7527908/etc/config/inventory
  inflating: 7527908/etc/config/actions
   creating: 7527908/etc/xml/
  inflating: 7527908/etc/xml/GenericActions.xml
  inflating: 7527908/etc/xml/ShiphomeDirectoryStructure.xml
  inflating: 7527908/README.txt      

[oracle@rh2 patches]$ unzip ~/patch/p9696904_102044_Linux-x86-64.zip
Archive:  /home/oracle/patch/p9696904_102044_Linux-x86-64.zip
   creating: 9696904/
   creating: 9696904/files/
   creating: 9696904/files/lib/
   creating: 9696904/files/lib/libserver10.a/
  inflating: 9696904/files/lib/libserver10.a/kks1.o
  inflating: 9696904/files/lib/libserver10.a/kksc.o
  inflating: 9696904/files/lib/libserver10.a/kksh.o
  inflating: 9696904/files/lib/libserver10.a/ksmp.o
  inflating: 9696904/files/lib/libserver10.a/kspt.o
   creating: 9696904/etc/
   creating: 9696904/etc/config/
  inflating: 9696904/etc/config/inventory
  inflating: 9696904/etc/config/actions
   creating: 9696904/etc/xml/
  inflating: 9696904/etc/xml/GenericActions.xml
  inflating: 9696904/etc/xml/ShiphomeDirectoryStructure.xml
  inflating: 9696904/README.txt

接下来我们首先检查以上2个patch之间是否存在conflict冲突，这里我们会用到opatch prereq CheckConflictAmongPatchesWithDetail命令:

[oracle@rh2 db_1]$ /s01/db_1/OPatch/opatch prereq CheckConflictAmongPatchesWithDetail -phBaseDir $ORACLE_HOME/patches

Invoking OPatch 11.2.0.1.3
Oracle Interim Patch Installer version 11.2.0.1.3
Copyright (c) 2010, Oracle Corporation.  All rights reserved.

PREREQ session
Oracle Home       : /s01/db_1
Central Inventory : /s01/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.3
OUI version       : 10.2.0.4.0
OUI location      : /s01/db_1/oui
Log file location : /s01/db_1/cfgtoollogs/opatch/opatch2011-05-06_22-07-18PM.log

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt
Invoking prereq "checkconflictamongpatcheswithdetail"

Prereq "checkConflictAmongPatchesWithDetail" passed.

OPatch succeeded.

/* 可以看到以上补丁间冲突检查发现需要实施的补丁间不存在冲突 */

接着我们需要为将要实施的补丁与系统中现有的补丁检查是否存在冲突，这里我们要用到opatch prereq CheckConflictAgainstOHWithDetail命令，如:

[oracle@rh2 db_1]$ /s01/db_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /s01/db_1/patches/9696904
Invoking OPatch 11.2.0.1.3

Oracle Interim Patch Installer version 11.2.0.1.3
Copyright (c) 2010, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /s01/db_1
Central Inventory : /s01/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.3
OUI version       : 10.2.0.4.0
OUI location      : /s01/db_1/oui
Log file location : /s01/db_1/cfgtoollogs/opatch/opatch2011-05-06_22-08-44PM.log

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.

[oracle@rh2 db_1]$ /s01/db_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /s01/db_1/patches/7527908
Invoking OPatch 11.2.0.1.3

Oracle Interim Patch Installer version 11.2.0.1.3
Copyright (c) 2010, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /s01/db_1
Central Inventory : /s01/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.3
OUI version       : 10.2.0.4.0
OUI location      : /s01/db_1/oui
Log file location : /s01/db_1/cfgtoollogs/opatch/opatch2011-05-06_22-08-57PM.log

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.

/* 在这里另外举一个检查后发现冲突的例子 */

[oracle@rh2 tmp]$ /s01/db_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir 8557428
Invoking OPatch 11.2.0.1.3

Oracle Interim Patch Installer version 11.2.0.1.3
Copyright (c) 2010, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /s01/db_1
Central Inventory : /s01/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 11.2.0.1.3
OUI version       : 10.2.0.4.0
OUI location      : /s01/db_1/oui
Log file location : /s01/db_1/cfgtoollogs/opatch/opatch2011-05-06_22-38-25PM.log

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt

Invoking prereq "checkconflictagainstohwithdetail"

ZOP-47: The patch(es) has supersets with other patches installed in the Oracle Home (or) among themselves.

ZOP-40: The patch(es) has conflicts with other patches installed in the Oracle Home (or) among themselves.

Prereq "checkConflictAgainstOHWithDetail" failed.

Summary of Conflict Analysis:

There are no patches that can be applied now.

Following patches have conflicts. Please contact Oracle Support and get the merged patch of the patches :
9352164

Following patches are not required, as they are subset of the patches in Oracle Home or
subset of the patches in the given list : 

Following patches will be rolled back from Oracle Home on application of the patches in the given list :
9352164
Conflicts/Supersets for each patch are:

Patch : 8557428
        Bug Conflict with 9352164
        Conflicting bugs are:
        8479537,  7462072,  8210889,  6404447

OPatch succeeded.

/* 可以看到以上发现了8557428 one-off patch与9352164(PSU4)之间存在冲突，
    引发冲突的Bug是8479537,  7462072,  8210889,  6404447
    opatch建议用户提交合并8557428和9352164补丁的服务要求  */

通过以上检查可以发现虽然是针对psu4(10.2.0.4.4)发布的one-off patch，但在对psu5(10.2.0.4.5)的ORACLE HOME做checkConflict时未发现冲突，接着我们opatch apply -report命令来预演补丁实施，使用-report选项让opatch仅报告其所会做的操作，而不真正去实施这些操作:

[oracle@rh2 db_1]$ cd patches/7527908/
[oracle@rh2 7527908]$ ls
etc files README.txt
[oracle@rh2 7527908]$ /s01/db_1/OPatch/opatch apply -report
Invoking OPatch 11.2.0.1.3

Oracle Home : /s01/db_1
Central Inventory : /s01/oraInventory
from : /etc/oraInst.loc
OPatch version : 11.2.0.1.3
OUI version : 10.2.0.4.0
OUI location : /s01/db_1/oui
Log file location : /s01/db_1/cfgtoollogs/opatch/opatch2011-05-06_22-19-25PM.log

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt

ApplySession applying interim patch '7527908' to OH '/s01/db_1'

Running prerequisite checks...
[Report: skip "rm -rf /s01/db_1/ccr"]
[Report: skip unzipping "/s01/db_1/OPatch/ocm/ocm.zip"]
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:

You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Yes
[Report: Skip calling "/bin/sh /s01/db_1/ccr/bin/setupCCR -R
/s01/db_1/.patch_storage/ocmRespFile -S OPatch -V 11.2.0.1.3" under "/s01/db_1/ccr/bin"]

OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/s01/db_1')

Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files and inventory (not for auto-rollback) for the Oracle Home
Users request no RAC file generation. Do not create MP files.

Skip patching component oracle.rdbms, 10.2.0.4.0 and its actions.
The actions are reported here, but are not performed.

Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/ktm.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/ktu.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/ktusm.o"
Running make for target ioracle
ApplySession skipping inventory update.

Verifying the update...
Inventory and System verification is performed here.

The local system has been patched and can be restarted.

OPatch succeeded.

[oracle@rh2 patches]$ cd 9696904/
[oracle@rh2 9696904]$ /s01/db_1/OPatch/opatch apply -report
Invoking OPatch 11.2.0.1.3

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt

ApplySession applying interim patch '9696904' to OH '/s01/db_1'

You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Yes
[Report: Skip calling "/bin/sh /s01/db_1/ccr/bin/setupCCR -R /s01/db_1/.patch_storage/ocmRespFile -S
OPatch -V 11.2.0.1.3" under "/s01/db_1/ccr/bin"]

OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/s01/db_1')

Skip patching component oracle.rdbms, 10.2.0.4.0 and its actions.
The actions are reported here, but are not performed.

Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/kks1.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/kksc.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/kksh.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/ksmp.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/kspt.o"
Running make for target ioracle
ApplySession skipping inventory update.

Verifying the update...
Inventory and System verification is performed here.

The local system has been patched and can be restarted.

OPatch succeeded.

以上使用opatch apply -report进一步确认了实施以上补丁不会引起冲突或其他失败，我们可以放心地正式应用补丁了！

[oracle@rh2 patches]$ cd 7527908/
[oracle@rh2 7527908]$ /s01/db_1/OPatch/opatch apply
Invoking OPatch 11.2.0.1.3

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt

ApplySession applying interim patch '7527908' to OH '/s01/db_1'

Running prerequisite checks...
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:

You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Yes

OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/s01/db_1')

Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files and inventory (not for auto-rollback) for the Oracle Home
Backing up files affected by the patch '7527908' for restore. This might take a while...
Backing up files affected by the patch '7527908' for rollback. This might take a while...

Patching component oracle.rdbms, 10.2.0.4.0...
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/ktm.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/ktu.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/ktusm.o"
Running make for target ioracle
ApplySession adding interim patch '7527908' to inventory

Verifying the update...
Inventory check OK: Patch ID 7527908 is registered in Oracle Home inventory with proper meta-data.
Files check OK: Files from Patch ID 7527908 are present in Oracle Home.

The local system has been patched and can be restarted.

OPatch succeeded.

[oracle@rh2 7527908]$ cd ..
[oracle@rh2 patches]$ cd 9696904/
[oracle@rh2 9696904]$ /s01/db_1/OPatch/opatch apply
Invoking OPatch 11.2.0.1.3

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt

ApplySession applying interim patch '9696904' to OH '/s01/db_1'

You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]: Yes

OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/s01/db_1')

Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files and inventory (not for auto-rollback) for the Oracle Home
Backing up files affected by the patch '9696904' for restore. This might take a while...
Backing up files affected by the patch '9696904' for rollback. This might take a while...

Patching component oracle.rdbms, 10.2.0.4.0...
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/kks1.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/kksc.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/kksh.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/ksmp.o"
Updating archive file "/s01/db_1/lib/libserver10.a" with "lib/libserver10.a/kspt.o"
Running make for target ioracle
ApplySession adding interim patch '9696904' to inventory

Verifying the update...
Inventory check OK: Patch ID 9696904 is registered in Oracle Home inventory with proper meta-data.
Files check OK: Files from Patch ID 9696904 are present in Oracle Home.

The local system has been patched and can be restarted.

OPatch succeeded.

[oracle@rh2 9696904]$ /s01/db_1/OPatch/opatch lsinventory
Invoking OPatch 11.2.0.1.3

Patch history file: /s01/db_1/cfgtoollogs/opatch/opatch_history.txt

Lsinventory Output file location : /s01/db_1/cfgtoollogs/opatch/lsinv/lsinventory2011-05-06_22-28-56PM.txt

--------------------------------------------------------------------------------
Installed Top-level Products (2):

Oracle Database 10g 10.2.0.1.0
Oracle Database 10g Release 2 Patch Set 3 10.2.0.4.0
There are 2 products installed in this Oracle Home.

Interim patches (4) :

Patch 9696904 : applied on Fri May 06 22:26:37 CST 2011
Unique Patch ID: 12575150
Created on 10 May 2010, 23:22:02 hrs PST8PDT
Bugs fixed:
7025450, 8575528, 6904068
This patch overlays patches:
9352164
This patch needs patches:
9352164
as prerequisites

Patch 7527908 : applied on Fri May 06 22:25:33 CST 2011
Unique Patch ID: 12546933
Created on 30 Apr 2010, 12:48:09 hrs PST8PDT
Bugs fixed:
7527908
This patch overlays patches:
9352164
This patch needs patches:
9352164
as prerequisites

Patch 9654991 : applied on Fri May 06 21:33:38 CST 2011
Unique Patch ID: 12816418
Created on 30 Jun 2010, 18:30:40 hrs PST8PDT
Bugs fixed:
9714832, 9713537, 9678695, 9655017, 9173248, 8309642, 9678697, 9678690
9573054, 9654991
This patch overlays patches:
9352164
This patch needs patches:
9352164
as prerequisites

Patch 9352164 : applied on Fri May 06 21:29:20 CST 2011
Unique Patch ID: 12307477
Created on 1 Apr 2010, 11:33:14 hrs PST8PDT
Bugs fixed:
.............................................................

/* Applied one-off patch successfully, That's great! */

Pre-check while you are applying one-off patch

Comments

Leave a Reply Cancel reply