Upgrade to R12

Reference

R12.1 Upgrade Guide (_08 is current)

Oracle Applications Release Notes, Release 12.1.1 [ID 798258.1]

Oracle E-Business Suite Pre-install Patches Report [Video] [ID 1448102.1]

Upgrade Advisor: E-Business Suite (EBS) Upgrade from 11.5.10.2 to 12.1.3 [ID 269.1]

Oracle Applications Release 12 Upgrade Sizing and Best Practices [ID 399362.1]

Preupgrade

R11 backup:
Backup of database and application are at:

Database Backup
Nov 30 23:34 /backup/ERPPJD/2012_11_30
Application Backup
Nov 30 23:45 /backup/ERPPJD/2012_11_30_20_14



Disk space:[applpjd@gsulerpd13 ~/R12]$ cat df.out
Tue Dec  4 11:52:36 EST 2012 [applpjd@gsulerpd13 /backup/R12.1.1/startCD]$ df -Ph
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00   31G  5.2G   24G  18% /
/dev/sda1             494M   24M  446M   5% /boot
tmpfs                 2.0G     0  2.0G   0% /dev/shm
172.29.176.12:/home/capgemshare   16G  8.2G  6.6G  56% /capgemshare
172.29.158.27:/vol/gsu_home_vlan133/gsu_home_vlan133   40G  320K   40G   1% /export/home
172.29.158.27:/vol/gsulerpd13_applbase_u14/gsulerpd13_applbase_u14  100G   36G   65G  36% /u14
172.29.158.27:/vol/ultnapv004_004/gsulerpd01_support  220G  164G   57G  75% /support
172.29.158.27:/vol/ultnapv004_098/gsulerpd01_backup  1.4T  1.2T  229G  84% /backup

Create R12 Apps Tier filesystem

[applpjd@gsulerpd13 /backup/R12.1.1/startCD/Disk1/rapidwiz]$ ll

-r-xr-xr-x 1 1213 1101 71841 Mar 26 2009 adautostg.pl
drwxrwxr-x 2 1213 1101 4096  Apr 29 2009 bin
-r-xr-xr-x 1 1213 1101 556   Mar 26 2009 ClientWiz.cmd
drwxrwxr-x 6 1213 1101 4096  Apr 29 2009 driver
drwxrwxr-x 2 1213 1101 4096  Apr 29 2009 etc
drwxrwxr-x 2 1213 1101 4096  Apr 29 2009 File
drwxrwxr-x 4 1213 1101 4096  Apr 29 2009 images
drwxrwxr-x 4 1213 1101 4096  Apr 29 2009 jlib
drwxrwxr-x 9 1213 1101 4096  Apr 29 2009 jre
drwxrwxr-x 3 1213 1101 4096  Apr 29 2009 oui
-r-xr-xr-x 1 1213 1101 9407  Mar 26 2009 rapidwiz
-r-xr-xr-x 1 1213 1101 671   Mar 26 2009 RapidWiz.cmd
-r-xr-xr-x 1 1213 1101 24329 Apr 2 2009 RapidWiz.ini
-r-xr-xr-x 1 1213 1101 1092  Mar 26 2009 RapidWizVersion
-r-xr-xr-x 1 1213 1101 357   Mar 26 2009 RapidWizVersion.cmd
drwxrwxr-x 2 1213 1101 4096  Apr 29 2009 template
drwxrwxr-x 10 1213 1101 4096 Apr 29 2009 unzip

[applpjd@gsulerpd13 /backup/R12.1.1/startCD/Disk1/rapidwiz]$ echo $APPL_TOP

/u14/app/erp11i/apps

[applpjd@gsulerpd13 /backup/R12.1.1/startCD/Disk1/rapidwiz]$ export DISPLAY=gsulerpd11:99  

[applpjd@gsulerpd13 /backup/R12.1.1/startCD/Disk1/rapidwiz]$ nohup ./rapidwiz &

  Leave the OCM Configuration Manager details blank.  

  Select port pool 14 (for Projects Dev)    

Values presented are for applpjd (apps tier) environment.  Edit to match db tier env.  E.g.

Base Directory   /u14/app/orapjd/product/11.2.0

Next, enter passwords for APPS, APPLSYSPUB and GUEST.

Then, edit paths as follows ...

Base Directory    /u14/app/erp12/ERPPJD

Instance Dir      /u14/app/erp12/ERPPJD/inst

... which gives, 

APPL_TOP          /u14/app/erp12/ERPPJD/apps/apps_st/appl

COMMON_TOP        /u14/app/erp12/ERPPJD/apps/apps_st/comn
Tools ORACLE_HOME /u14/app/erp12/ERPPJD/apps/tech_st/10.1.2
Web ORACLE_HOME   /u14/app/erp12/ERPPJD/apps/tech_st/10.1.3
Temp Directory    /u14/app/erp12/ERPPJD/inst/apps/ERPPJD_gsulerpd13/temp

NB: APPL_TOP,aux1/2/3=APPL_TOP



All services enabled except "Other" ...

"Add to server ..." only adds applications node.
DB node is 32 bit - cannot change.

Click OK and,

• Rapid Wiz performs system checks.
• Config file written to, 

    $INST_TOP/apps/$CONTEXT_NAME/conf_ERPPJD.txt

Result,

Click Next and it starts installing R12.   4:00pm Tuesday 04 Dec 2012.

Appltop logfile - $INST_TOP/apps/$CONTEXT_NAME/logs/12041609.log

It will start asking questions for Tools, etc.  Search as follows ...

[applpjd@gsulerpd13 /backup/R12.1.1]$ grep -i tools oraA*/Disk*/disk.label

oraAS/Disk1/disk.label:Label=Oracle Applications Rapid Install - Tools
oraAS/Disk2/disk.label:Label=Oracle Applications Rapid Install - Tools
oraAS/Disk3/disk.label:Label=Oracle Applications Rapid Install - Tools


[applpjd@gsulerpd13 /u14/app/erp12/ERPPJD/inst/apps/ERPPJD_gsulerpd13/logs]$
tail -3 12041609.log


Disk platform missmatch.
required platform: Linux

Disks for platform: LINUX_X86-64

Download R12.1.1 for 32 bit linux Apps tier into /backup/R12.1.1.32bit

Restarted at Wed Dec 5 15:38:16 EST 2012
( ./rapidwiz -restart just gave the same screens. 
This time it started with the APPLTOP-Disk 1 dvd, not the Tools dvd)

Timing: After approx. 30 mins,

[applpjd@gsulerpd13 ~]$ df -Ph /u14
Filesystem            Size  Used Avail Use% Mounted on
172.29.158.27:/vol/gsulerpd13_applbase_u14/gsulerpd13_applbase_u14  100G   60G   41G  60% /u14
=> 60gb - 36gb = 24gb used.

Fix

mv -i erp12 erp12.00; mkdir -p erp12/ERPPJD/inst
Downloaded the 32 bit startcd.unzipped all the zip files ... unzip -q -o ...

./rapidwiz  (no change in database)

Logs before specifying base directory:
[applpjd@gsulerpd13 /tmp/12061204]$ ls -ltr
total 140
-rw-r--r-- 1 applpjd oaa 13813 Dec  6 12:05 gsulerpd03_VIS_db.xml
-rw-r--r-- 1 applpjd oaa 12103 Dec  6 12:07 conf_ERPPJD.txt
-rw-r--r-- 1 applpjd oaa 92233 Dec  6 12:08 gsulerpd13_ERPPJD_apps.xml
-rw-r--r-- 1 applpjd oaa 12840 Dec  6 12:08 12061204.log

Timing: After 1 hour:

Ignorable error in the logfile (see : 1112613.1)
.ERROR: InDbCtxFile.uploadCtx() : Exception : Error executng BEGIN fnd_gsm_util.upload_context_file(:1,:2,:3,:4,:5); END;: 1; The element reports_port is missing from the context file /u14/app/erp12/ERPPJD/inst/apps/ERPPJD_gsulerpd13/appl/admin/ERPPJD_gsulerpd13.xml.

df -Ph
172.29.158.27:/vol/gsulerpd13_applbase_u14/gsulerpd13_applbase_u14 100G 88G 13G 88% /u14

Click Next

(IANA Character Set: UTF-8)

No R12 applpjd processes were running so do not try to connect


R11i patches that should have been applied before rapidwiz
4712852 - Minipack 11i.AD.I.4 - already applied
5753359 - already applied

5467526 - already applied


5120936 - applied succesfully
          cd $AD_TOP/patch/115/sql
          sqlplus APPS/ @adtums.sql DATA_PUMP_DIR
          => gsulerpd03:/tmp/tumsr12.html is generated.
          tumsr12.html lists steps that can be omitted.

5726010 - applied succesfully (not adpatch)
          INTERIM tablespace is created with 
          datafile gsulerpd03:$ORACLE_HOME/dbf/interim.dbf 200MB

R12 AD patch

Set the environment to R12

[applpjd@gsulerpd13 ~]$ ln -s /u14/app/erp12/ERPPJD/apps/apps_st/appl/APPSERPPJD_gsulerpd13.env .


Set the applpjd .bash_profile to the above link and remove the hard-coded APPL_TOP, COMMON_TOP etc.  

Apply R12.AD.A 4502962

This patch is superceeded by AD.C, but apply only AD.A.   
 
 
Backup
Backup the new R12 appstier and R11i database into,
orapjd@gsulerpd03:/backup/ERPPJD/2012_12_07_pre4440000_ap
orapjd@gsulerpd03:/backup/ERPPJD/2012_12_07_pre4440000_db


Apply patch 7461070
    Run adgrants.sql from this patch in RDBMS


Apply patch 6678700
         
    adpatch options=nocopyportion,nogenerateportion
        (these options will ask for confirmation even with defaults file)

Start:Sun Dec 09 2012 21:32:20

Dec  9 23:51
FAILED: file pechktsk.sql on worker  4.
ORA-00979: not a GROUP BY expression

(Sigh)    

Fix: Note ID 1083981.1. 
Patch 8855023 for R12. 

Pre-install patches that should have been merged with the main driver

See Note 1448102.1 

Download the  EBS_R12.1_Preinstall_2012_Nov_20.zip file

Downloaded for


EBS
   -> Upgrade script Failure
      -> FIN: AP AR CE
      -> PJ: PJC PJB
      -> HRMS: none
      -> CRM: CS

p10041471_R12.AR.B_R12_GENERIC.zip
p10096115_R12.AP.B_R12_GENERIC.zip
p10096191_R12.AP.B_R12_GENERIC.zip
p10163753_R12.BIV.B_R12_GENERIC.zip
p10170555_R12.AP.B_R12_GENERIC.zip
p10275581_R12.CS.B_R12_GENERIC.zip
p10359715_R12.AP.B_R12_GENERIC.zip
p10362575_R12.PJB.B_R12_GENERIC.zip
p11071399_R12.AP.B_R12_GENERIC.zip
p11653739_R12.AP.B_R12_GENERIC.zip
p11847569_R12.AP.B_R12_GENERIC.zip
p12347791_R12.PJC.B_R12_GENERIC.zip
p12877002_R12.AP.B_R12_GENERIC.zip
p12930626_R12.PJC.B_R12_GENERIC.zip
p13016846_R12.AP.B_R12_GENERIC.zip
p13509912_R12.PJC.B_R12_GENERIC.zip
p13557244_R12.AP.B_R12_GENERIC.zip
p13626520_R12.AR.B_R12_GENERIC.zip
p13695167_R12.CE.B_R12_GENERIC.zip
p13774403_R12.AP.B_R12_GENERIC.zip
p13793279_R12.AR.B_R12_GENERIC.zip
p13837821_R12.AP.B_R12_GENERIC.zip
p13872862_R12.CE.B_R12_GENERIC.zip
p13980548_R12.AR.B_R12_GENERIC.zip
p14332425_R12.AR.B_R12_GENERIC.zip
p8615142_R12.AP.B_R12_GENERIC.zip
p8681082_R12.AP.B_R12_GENERIC.zip
p8712047_R12.AP.B_R12_GENERIC.zip
p9067770_R12.AP.B_R12_GENERIC.zip
p9104076_R12.AP.B_R12_GENERIC.zip
p9257954_R12.AP.B_R12_GENERIC.zip
p9366024_R12.AP.B_R12_GENERIC.zip
p9799876_R12.AP.B_R12_GENERIC.zip

mkdir /u14/app/erp12/ERPPJD/apps/apps_st/ap pl/admin/ERPPJD/preinstall
unzip all the patches into the preinstall directory.

cd /u14/app/erp12/ERPPJD/apps/apps_st/appl/au/12.0.0/patch/115/driver


   admrgpch -d . -preinstall -master u6678700.drv

   Executing the merge of the patch drivers

   No driver files exists 
        in /u14/app/erp12/ERPPJD/apps/apps_st/appl/admin/ERPPJD/preinstall.

   -- Processing file: u6678700.drv
   -- Done processing file: u6678700.drv
   1 unified drivers merged.
   Patch merge completed successfully
   Please check the log file at ./admrgpch.log.

Timing: took 4.5 hours!

However, patch 8855023 is not in the pre-install list.  Probably should apply the R11i version of that patch (9716146) before applying the merged upgrade driver.

Continuing with the pre-install patches note,  ....
"Apply the newly merged Release 12.1 upgrade driver (for example, $AU_TOP/patch/115/driver/u_merged.drv) with adpatch options=nocopyportion,nogenerateportion"

adpatch defaultsfile=/u14/app/erp12/ERPPJD/apps/apps_st/appl/admin/ERPPJD/adalldefaults.txt.ERPPJD logfile=umerged_6678700-01.log patchtop=$AU_TOP/patch/115/driver driver=u_merged.drv workers=4 interactive=Y options=nocopyportion,nogenerateportion



AutoPatch started at: Wed Dec 12 2012 10:35:55   At 15:38 Wednesday, workers 1,3,4 wait for worker 2 on IGSPS84S.pls which suffered a deadlock. Fix: adctrl "Tell manager that a worker failed its job".  adpatch re-assigns the job and continues on.  14:30 Thursday.        

Stopped again after 12 minutes!

-rw-r--r-- 1 applpjd oaa 7739559 Dec 13 14:42 umerged_6678700-01.log



Worker Code     Context           Filename                   Status
------ -------- ----------------- -------------------------- --------------
1 Run AutoPatch R120 Wait
2 Run AutoPatch R120 apwdflxs.pls Assigned
3 Run AutoPatch R120 Wait
4 Run AutoPatch R120 Wait

Cause: "Tell manager that a worker failed its job" seems to have disabled the worker.  (adworker 2 is defunct in Unix)

Fix:
applpjd 18003 17807 0 Dec12 pts/1 00:00:22 [adworker]

kill 18003

=> all of them died and adpatch stopped!

Restart adpatch. 9:32am Friday Dec 14th.

Fri Dec 14 2012 09:54:47

FAILED: file PMIRPTV.odf on worker 1.
ORA-00979: not a GROUP BY expression
occurred while executing the SQL statement:
CREATE OR REPLACE FORCE VIEW APPS.PMI_REP_PROD_STATUS_V (
 
Fix:
See [ID 1250054.1]
=> Apply, patch 9062910 (INTEROPERABILITY PATCH FOR R12.1.1 ON 11.2 RDBMS) PMIRPTV.odf -> 120.0.12010000.2

Restart adpatch 11:45am



Sun Dec 16 2012 12:37:15, this error occured:

3  Run AutoPatch R120 EDRXDOMigration.class FAILED

java.sql.SQLRecoverableException: Io exception: Connection reset   All attempts to fix this problem with SQLNET.INBOUND_CONNECT_TIMEOUT = 120 failed.    Subsequent attempts to restart adpatch caused all workers to fail.    
Thu Dec 20 15:05:58 EST 2012
Restoring R11i backup of /backup/ERPPJD/2012_11_30