EBS -- EBS 12.1.3 / Oracle Database 19C Upgrade

It is time to write about EBS. Here we are, talking about upgrading EBS databases to 19C.

In these days, we are mostly dealing with 11.2.0.4/12C databases in EBS world, so it is the time to upgrade those databases.

A big majority of EBS customers are still using EBS 12.1.3, my blog post will be about upgrading an EBS 12.1.3 databases to 19C.

In this blog post, I will try to give you the facts about these kinds of projects and then will give you a consolidated action plan for just a quick overview.

Facts :

• EBS 12.1.3 is certified with Oracle Database 19C (as of Sep 2019)
• EBS 12.1.3 is certified with Multitenancy, 1 CDB and 1 PDB. So if you are considering 19C upgrade in EBS environments, you should know that your 19C EBS database will be a multitenant.. Oracle certifies EBS and 19C only with this condition and Oracle won't certify EBS with a non-CDB 19C database even in the future.
• With the 19C upgrade, UTL_FILE_DIR becomes obsoleted, so UTL_FILE_DIR based file access mechanisms, should be replaced with the Database Directories-based file operations.
• Uprade environment should be tested very carefuly after the Test iterations.. (custom code should be reviewed..) Performance problems may appear and if they appear they should be resolved .. Especially for the ISG(Integrated SOA Gateway).
• For Linux customers (most of our customers are on Linux), 19C requires Oracle Linux 7 or Redhat Linux 7.  So you need to consider OS upgrade if you are on a lower version.. Note that, OEL 7 upgrade can be done in-place if you are on a certain OS software level, but I find it risky. Anyways, this item must be carefully considered.
• EBS 12.1.3 apps tier is also certified with OEL&RHEL 7. Linux upgrade for apps nodes is not a must, but it is a nice-to-have thing.. Besides, this makes single node environments (Both Apps and DB in the same server) to be upgraded without a need for splitting the services to multiple nodes.
• I can't give a certain downtime requirement for such an upgrade. That's why I recommend it to be measured during the Test iterations.
• As EBS 19C upgrades require CDB-based db tier, we need to have a high level of understanding of CDB-PDB / multitenant Oracle databases. Actually, we need to learn it by hearth, or as the germans say "wir ( APPS DBAs) alle müssen es auswendig lernen" :)
• It seems Oracle made our job easy again.. I mean, things like converting non-PDB to PDB is done using perl scripts :)

Okay, let's take a look at the action plan from the surface:

Preperation :

• Applying Prerequisites Patches for the Upgrade. (19C interop,AD/TX Delta patches and etc.).
• Applying Warehouse Builder patches (optional)
• Applying Autoconfig patches.
• Applying   Patch 6400501: APPSST11G:1203:NOT ABLE TO COMPILE FORMS LIBRARRY WITH 11G DB (For Linux)
• Applying Patch 12964564:R12.FND.B - Enabling the Oracle Database 11g Case-Sensitive Password Feature for Oracle E-Business Suite Release 12.1.1+ (optional, for enabling case sensitive passwords)
• Creating the initialization parameter setup files (running txkOnPremPrePDBCreationTasks.pl)
• Install 19C RDBMS Software (Software only)
• Create Nls9i data (running $ORACLE_HOME/nls/data/old/cr9idata.pl)
• Applying 19C RDBMS Home Patches (almost 15 DB patches)
• Creating a new appsutil.zip and copying it to the required folders/servers.
• Copying orai18n.jar file to the required folders.
• Create a CDB (without any PDBs)
• Patching CDB, synching it with the 19C home (running datapatch)
• Creating CDB MGDSYS schema(running catmgd.sql)
• Creating CDB TNS Files(running txkGenCDBTnsAdmin.pl)
• Configure Transparent Data Encryption for CDB (conditional/optional)
• Shutdown CDB
• UTL_FILE_DIR(for the required UTL_FILE migration)
• Shutting down Application services and application tier listener in source
• Drop SYS.ENABLED$INDEXES (conditional)
• Disabling Database Vault (conditional)
• Exporting OLAP analytical workspaces (conditional)
• Removing the MGDSYS schema (conditional -- running catnomgdidcode.sql)

Upgrade + Conversion :

• Upgrading the DATABASE (11.2.0.4 to 19C)
• Backing up database
• Upgrading database using DBUA
•  Performing post-upgrade tasks
• Running patch post-install instructions (for the patches applied in earlier steps)
• Compiling PL/SQL code natively (optional)
• Importing OLAP analytical workspaces (conditional)
• Running adgrants.sql
• Granting create procedure privilege on CTXSYS(adctxprv.sql)
• Compiling invalids
• Granting data store access
• Validating the WF rulesets (wfaqupfix.sql)
• Gathering SYS stats
• Creating the new MGDSYS schema (conditional) -- running catmgd.sql
• Creating Demantra privileges (conditional)
• Exporting Master Encryption Key (conditional)
• Converting the upgraded database to Multitenant
• Creating the PDB descriptor
• Disabling the ENCRYPTION_WALLET_LOCATION sqlnet.ora entry (conditional)
• Updating the CDB initialization parameters
• Checking for PDB violations (review and resolve the errors if there are any)           
• Creating the PDB (run txkCreatePDB.pl)
• Running the post PDB script (txkPostPDBCreationTasks.pl)

Post-Upgrade tasks :

• Modify initialization parameters (according to the EBS-Database initialization parameters MOS document)
• Run Apps Tier autoconfig (with some additional context file modifications)
• Apply post-upgrade WMS patch (Patch 18039691)
• Recreate custom database links
• Apply latest RDBMS Release Update (Database Release Update 19.5.0.0.0, OJVM Release Update Patch 19.5.0.0.0 and other 19.5.0.0.0 patches)
• Restart application services

Post-Upgrade Support :

• Babysitting
• Error correction & Throubleshooting

Okay, we are at the end of this blog post.. Lastly, I m sharing the MOS document which should be followed line by line to do such an upgrade.. You should follow it closely.. It may redirect you to some other documents when necessary, but you will come back to it after taking the actions on those documents. So your main document is ;

"Interoperability Notes: Oracle E-Business Suite Release 12.1 with Oracle Database 19c (Doc ID 2580629.1)"