On HP UX platform I recently did an upgrade project of a 1TB warehouse system from 10.2.0.2 to 10.2.0.4. After upgrade I saw a strange behaviour that Oracle Database alert.log started reporting ORA-07445:[$PXNMOVE] and ORA-07445:[$COLD_KKERFP()+1984]. These errors are diagnosed as faulty CPU , so had to replace all Cell Boards on the Faulty HP Superdome Hardware.
Later the performance went down and we could not load the data on time. Things went bad.
All I saw is the first three CPUs were used by the system and not the rest of the CPUs.
With a lot of investigation between HP & Oracle , it was finally discovered to be the NUMA setup within Oracle Code to use the first cell board and ignore the rest.
alert.log looked like the below for NUMA configuration
and NUMA PG = 3, CPUs = 3
Statement from Oracle was "NUMA is turned on by default 10.2.0.4 and as per the observation only 3 CPU is used."
Later the Init.ora parameter were setup to disable the NUMA.
Database was restarted and we were able to see the Oracle processes working on all the 10 CPUS.
Now the alert.log will showed like
and NUMA PG = 1, CPUs = 10
I hope this information will help HP Customers running Oracle Database.
Saturday, September 27, 2008
FS_CLONE Phase It is a stand-alone command used for file system cloning. Standard cloning (using adcfgclone.pl) cannot be used to synch...
Options ABANDON and RESTART adop phase=apply patches=10721639 abandon=yes Used to specify whether to restart the previous run of a...
Abort Phase If for some reason either the prepare or apply phase failed or gave problems, you can abort the patching cycle. After runnin...
Scenario You have noticed that the on the patch edition there are lot of patches applied. You did the cutover and now customer wants t...
Scenario You have been asked to apply a patch and you completed the prepare phase and apply phase. Now customer has given a downtime f...
Scenario You have been asked to apply a patch and you start with the first phase “PREPARE”. Background Customer has recently...
Cleanup Phase Drops now-redundant columns and other objects which are not required after the cutover phase. It is important that we do n...
R12.2 Highlights This release is largely focused on providing new technology stack components, new configuration options, and new syst...
FMW 11g Upgrade Master Index After upgrading Discoverer and Portal to 11g logging on the portal or discoverer results in ORA-7445 in the ...
Ready the instance for cutover Perform the final operations like Compile Invalids , Generate Derived Objects and Pre-compute DDL to be run...