Cloning an Application Database 12.2

Prepare the Source System DB Tier for cloning.

$ cd <RDBMS ORACLE_HOME>/appsutil/scripts/<CONTEXT_NAME>

$ perl adpreclone.pl dbTier

Prepare the Source Application Tier for Cloning

$ cd <INST_TOP>/admin/scripts
$ perl adpreclone.pl appsTier

As of Release 12.2, the adpreclone.pl process on the application tier creates a complete compressed archive of the Oracle Fusion Middleware and its components as follows:

A compressed archive of the Oracle WebLogic Server home, Oracle Web Tier Utilities home, Oracle Common Utilities home and the Oracle E-Business Suite home:
<COMMON_TOP>/clone/FMW/FMW_Home.jar

A compressed archive of the Oracle E-Business Suite WebLogic domain:
<COMMON_TOP>/clone/FMW/WLS/EBSdomain.jar

The Oracle E-Business Suite WebLogic domain's configuration template:
<COMMON_TOP>/clone/FMW/WLS/plan/moveplan.xml

A compressed archive of the Oracle Web Tier/Oracle HTTP Server configuration instance:
<COMMON_TOP>/clone/FMW/OHS/ohsarchive.jar

The Oracle HTTP Server configuration instance's configuration template:
<COMMON_TOP>/clone/FMW/OHS/moveplan.xml

The adpreclone log files are created in the <INST_TOP>/admin/log/clone directory.

Copy both database tier and application tier nodes from the Source System to the Target System

Copy the database node file system

     1. Log on to the Source Application tier node as the applmgr user, and then:

1. Shutdown the application tier processes.
1. Log on to the Source System database node as the oracle user, and then: 
1. Perform a normal shut down of the Source System database. 
2. Copy the database (.dbf) files from the Source System to the Target System. 
3. Copy the Source System database ORACLE_HOME to the Target System. 
4. Start the Source applications system database and application tier processes. 
2. Log on to the Target System database node as the oracle user, and then:
1. Delete the oraInst.loc file in the Database ORACLE_HOME, if it exists.

Copy the application tier file system from the Source "Run Edition File System" to the Target "Run Edition File System"

Copy / rsync the “EBSapps” From Source Run FS to Target Run FS

(Use an identical File structure for source & target, i.e if source Run FS is FS1 use Target run FS as FS1)

$rsync –avz $RUN_BASE/fs1/EBSapps $RUN_BASE/fs1/EBSapps

$rsync –avz $RUN_BASE/fs2/EBSapps $RUN_BASE/fs2/EBSapps

FMW_Home & inst will be created by adcfgclone execution

NB: Preserve Old Env Files / Context Files / DBC File / .Profile / Inventory

De-register the Oracle Homes on both Run Edition and Patch Edition file system:

Verify if Oracle Inventory contains the following Oracle Home entries for the Run Edition or Patch Edition file system:

<FMW_HOME>/oracle_common
<FMW_HOME>/webtier
<FMW_HOME>/Oracle_EBS-app1

Ex: To de-register or detach that Oracle Home:

$ ./runInstaller -detachhome ORACLE_HOME=<Oracle Home Location> [-invPtrLoc <s_invPtrLoc>]

Issues:

Script Executed in 25420 milliseconds, returning status 255

Script failed, exit code 255

In: ../../fs1/EBSapps/comn/clone/FMW/logs the following error is seen:

ERROR - CLONE-20275   Insufficient space to create /tmp/CLONINGCLIENT048348542103845

Fix: Increase / Change the temp directory location by setting the T2P_JAVA_OPTIONS environment variable to point to a temporary location of your choice

Bug 12959323: T2P cloning tools require 10GB of free space in /tmp

          $ T2P_JAVA_OPTIONS="-Djava.io.tmpdir=/home/applmgr/tmp"

          $ export T2P_JAVA_OPTIONS

$cd $COMMON_TOP/clone/bin

$ perl adcfgclone.pl appsTier dualfs (When you are above Delta6)

Since we are on Delta 6 I used

$ perl adcfgclone.pl appsTier

Prompts for Below inputs:

Enter the APPS password :

Enter the Weblogic AdminServer password :

Do you want to add a node (yes/no) [no] :

Target System File Edition type [run] :

Provide the values required for creation of the new APPL_TOP Context file.

Target System Hostname (virtual or normal) [hostname] :

Target System Database SID : <SID>

Target System Database Server Node [hostname] :

Target System Database Domain Name [domain.com] :

Target System Base Directory : /../../applmgr/<SID>

Target System Base Directory set to /../../applmgr/<SID>

Target System Current File System Base set to /../../applmgr/<SID>/fs2

Target System Other File System Base set to /../../applmgr/<SID>/fs1

Target System Fusion Middleware Home set to /../../applmgr/<SID>/fs2/FMW_Home

Target System Web Oracle Home set to /../../applmgr/<SID>/fs2/FMW_Home/webtier

Target System Appl TOP set to /../../applmgr/<SID>/fs2/EBSapps/appl

Target System COMMON TOP set to /../../applmgr/<SID>/fs2/EBSapps/comn

Target System Instance Home Directory [/../../applmgr/<SID>] :

Target System Instance Top set to /../../applmgr/<SID>/fs2/inst/apps/<ContextName>

Do you want to preserve the Display [hostname:0.0] (y/n)  : n

Target System Display [hostname:0.0] :

Target System Root Service [enabled] :

Target System Web Administration [enabled] :

Target System Web Entry Point Services [enabled] :

Target System Web Application Services [enabled] :

Target System Batch Processing Services [enabled] :

Target System Other Services [disabled] :

Do you want the target system to have the same port values as the source system (y/n) [y] ? : n

Target System Port Pool [0-99] : 10

Checking the port pool 10

done: Port Pool 10 is free

Report file located at /../../applmgr/<SID>/fs2/inst/apps/<ContextName>/admin/out/portpool.lst

Complete port information available at /../../applmgr/<SID>/fs2/inst/apps/<ContextName>/admin/out/portpool.lst

UTL_FILE_DIR on database tier consists of the following directories.

1. /../../applmgr/<SID>/fs1/inst/apps/<ContextName>/appltmp

2. /../../oracle/product/<SID>/db/tech_st/12.1.0/appsutil/outbound/<ContextName>

Choose a value which will be set as APPLPTMP value on the target node [1] :

Creating the new APPL_TOP Context file from :

  /../../applmgr/<SID>/fs2/EBSapps/comn/clone/context/apps/adxmlctx.tmp

The new APPL_TOP context file has been created :

  /../../applmgr/<SID>/fs2/inst/apps/<ContextName>/appl/admin/<ContextName>.xml

Log file located at /../../applmgr/<SID>/fs2/EBSapps/comn/clone/bin/CloneContext_0127155028.log

Remove Excessive Managed Servers:

perl $AD_TOP/patch/115/bin/adProvisionEBS.pl ebs-delete-managedserver -contextfile=$CONTEXT_FILE -managedsrvname=oacore_server2 -servicetype=oacore -logfile=$APPLRGF/TXK/delMS_OACORESrver2.log

perl $FND_TOP/patch/115/bin/txkSetAppsConf.pl -contextfile=$CONTEXT_FILE -configoption=removeMS  -formsc4ws=hostname.domain.com:7812

Run EBS Technology Codelevel Checker (ETCC) on the database tier.

On the database tier, run the EBS Technology Codelevel Checker (ETCC) described in My Oracle Support Knowledge Document 1594274.1, Oracle E-Business Suite Release 12.2: Consolidated List of Patches and Technology Bug Fixes to confirm that all required database patches have been applied.

EBS Technology Codelevel Checker (ETCC) is available via Patch 17537119 and analyzes an Oracle Database Oracle Home, and warns of any missing database bug fixes required for Oracle E-Business Suite Release 12.2. It is run with the command checkDBpatch.sh (on UNIX) or checkDBpatch.cmd (on Windows). Further instructions are available in the patch readme. Ensure to install the latest version of ETCC into <RDBMS_ORACLE_HOME>/appsutil/etcc directory.

Repeat the steps for Patch FS

Remove Source Instances References:

As APPS user run

EXEC FND_CONC_CLONE.SETUP_CLEAN;

Please run below steps from DB Side to establish same patch level connectivity.

cd $ORACLE_HOME

Backup the appsutil directory

$ cp -pr appsutil appsutil.old

$ unzip -o $INST_TOP/admin/out/appsutil.zip

cd $ORACLE_HOME/appsutil/bin

Run Autoconfig on DB Node

./adconfig.sh 

Change APPS & SYSADMIN password using FNDCPASS.

$AFPASSWD –s applsys

$AFPASSWD –s sysadmin

Change the APPS password in WLS Data Source by running the the following script as shown:

$ perl $FND_TOP/patch/115/bin/txkManageDBConnectionPool.pl

When prompted, select 'updateDSPassword' to change the APPS password in the WLS Datasource.

Start all the application tier services using the $INST_TOP/admin/scripts/adstrtal.sh script.

Verify the WLS data source changes as follows:

Log in to the WLS Administration Console.

In the Domain Structure tree, expand Services, then select Data Sources.

On the Summary of JDBC Data Sources page, select EBSDataSource.

On the Settings for EBSDataSource page, select Monitoring > Testing.

Select "oacore_server1".

Click Test DataSource.

Look for the message "Test of EBSDataSource on server oacore_server1 was successful".

When Source is registered with SSO, De-register the References:

How to Remove OAM References for Clone Instances

===========================================

$FND_TOP/bin/txkrun.pl -script=SetSSOReg -removereferences=Yes -appspass=*******

$txkrun.pl -script=SetOAMReg -deregisteroam=yes -ebsProfileLevel=site \

-oamHost=http://host.domain.com:6017 -oamUserName=weblogic -skipConfirm=yes

After de-registering your Oracle E-Business Suite instance from Oracle Access Manager, you no longer need the Oracle E-Business Suite AccessGate deployment. Delete your Oracle E-Business Suite AccessGate using your WebLogic Administration Console, for example:

http://ebshost.example.com:7001/console

In the WebLogic Administration Console, navigate to EBS_domain_sid > Deployments, stop then delete the Oracle E-Business Suite AccessGate application named "accessgate". Ensure that you click 'Activate Changes' in the 'Change Center' pane, for the changes to take effect.

If you do not use the data source "OAEADatasource" for any other application, you may also delete the datasource. Navigate to EBS_domain_sid > Services > Data Sources, and delete data source "OAEADatasource". Ensure that you click 'Activate Changes' in the 'Change Center' pane, for the changes to take effect.

Delete the Managed Server on which accessgate was deployed:

1.    If the Managed Server oaea_server1 is currently running, shut it down as follows:

$ sh $ADMIN_SCRIPTS_HOME/admanagedsrvctl.sh stop oaea_server1

The script will prompt for the following passwords:

Enter the WebLogic Admin password.

Enter the required information when prompted.

2.    Run the command below on the application tier node where the oaea_server1 managed server resides. This will delete the managed server, and also update the respective context variables that contain references to the deleted managed server:

$ perl $AD_TOP/patch/115/bin/adProvisionEBS.pl ebs-delete-managedserver -contextfile=$CONTEXT_FILE -managedsrvname=oaea_server1

The script will prompt for the following passwords:

Enter the APPS Schema password.

Enter the WebLogic AdminServer password.

Enter the required information when prompted.

The following confirmation message will be displayed: ManagedServer oaea_server1 deleted successfully.

3.    Remove the managed server and port from the mod_wl_ohs.conf configuration:

$ perl $FND_TOP/patch/115/bin/txkSetAppsConf.pl -contextfile=$CONTEXT_FILE -configoption=removeMS -accessgate=<host>.<domain>:<port>

To determine the value of the Port that was used for the oaea_server1 managed server, search for 's_wls_oaeaport' in $CONTEXT_FILE.

Stop and restart the Oracle E-Business Suite Application Tier services.

As the APPS user, run the script to unlink all Oracle E-Business Suite users:

SQL>@$FND_TOP/patch/115/sql/fndssouu.sql %

Run Autoconfig on AppsTier

Source the Run FS

$ . /u*/app/applmgr/<SID>/EBSapps.env run

$adautocfg.sh

Source the Patch FS (Upload the context file to Database)

$ . /u*/app/applmgr/<SID>/EBSapps.env patch (No need to run autoconfig, Just upload the context file)

$$ADJVAPRG oracle.apps.ad.autoconfig.oam.CtxSynchronizer action=upload contextfile=$CONTEXT_FILE logfile=/tmp/patchctxupload.log

ADOP: Run a Mock Cycle

adop phase=fs_clone

or

adop phase=prepare

adop phase=cutover

Menu’s not available Issue

Fix: Ask DBA’s to restore the below tables

FND_USER

WF_USER_ROLE_ASSIGNMENTS

WF_ALL_USER_ROLES

AK_WEB_USER_SEC_ATTR_VALUES

WF_LOCAL_USER_ROLES

WF_LOCAL_USERS

Post clone addendum (should  be included in the post clone steps)

For production clone:

 1.Change the profile option:

     Site name : instance name

     Java color scheme: Teal

2. Set the override address to One of the appsdba email address (before starting concurrent manager)

cd $FND_TOP/sql

$sqlplus apps/*****

SQL> @afsvcpup.sql

Issues: Prepare Phase is Failing with Below Issue

    [ERROR]     Error Message :

    [ERROR]     ORA-20010: ORA-01422: exact fetch returns more than requested number of rows

    [ERROR]     ORA-06512: at "APPS.AD_ZD_ADOP", line 2790

    [ERROR]     ORA-06512: at line 2 (DBD ERROR: OCIStmtExecute)

    [UNEXPECTED]Error occurred while adding new node information

    [UNEXPECTED]Unrecoverable error occured. Exiting the current session.

Fix: 

EXEC FND_CONC_CLONE.SETUP_CLEAN;

Cloning Oracle E-Business Suite Release 12.2 Environments integrated with Oracle Access Manager 11gR2 (11.1.2) and Oracle E-Business Suite AccessGate (Doc ID 1614793.1)