How To Check If a Patch is Applied in 12.2.x, How to Reapply a Patch

[STATEMENT]     Prepare phase status: X
[STATEMENT]     Apply phase status: P
[STATEMENT]     Cutover  phase status: R
[STATEMENT]     Abort phase status: X
[STATEMENT]     Session status: F
[STATEMENT] [Note: Y denotes that the phase is done
[STATEMENT]        N denotes that the phase has not been completed
[STATEMENT]        X denotes that the phase is not applicable
[STATEMENT]        R denotes that the phase is running (in progress) or ran
[STATEMENT]        F denotes that the phase has failed
[STATEMENT]        P (is applicable only to APPLY phase) denotes atleast
[STATEMENT]           one patch is already applied for the session id

How to Re-Apply a patch in 12.2
To Restart the patch from Scratch
adop phase=apply patches=17204589 hotpatch=yes options=forceapply

How To Check If a Patch is Applied in 12.2.x (Doc ID 1963046.1)

In EBS 12.2.x you cannot simply query the AD_BUGS table. This table may have entries for patches that were applied but later the patching cycle was aborted (not really applied).

The way to check whether a patch is really applied is to use the AD_PATCH.IS_PATCH_APPLIED pl/sql function

Usage:
select AD_PATCH.IS_PATCH_APPLIED(\'$release\',\'$appltop_id\',\'$patch_no\',\'$language\') from dual;

example sql:
SELECT adb.bug_number,ad_patch.is_patch_applied('11i', 1045, adb.bug_number)
FROM ad_bugs adb
WHERE adb.bug_number in (20034256);

or for single app tier installations:
select ad_patch.is_patch_applied('R12',-1,20034256) from dual;

expected results:
EXPLICIT = applied
NOT APPLIED = not applied / aborted

Troubleshoot troubleshoot issues on script POS_SUPPLIER_SEARCH_INDEX.sql When upgrading to 12.2.x

Please refer Metalink Doc ID 1677737.1

sqlplus -s APPS/***** @/$APPL_TOP/pos/12.0.0/patch/115/sql/POS_SUPPLIER_SEARCH_INDEX.sql
Connected.
DECLARE
*
ERROR at line 1:
ORA-20000: possearchindex.sql(500): ORA-20000: Exception at
POS_SUPPLIER_SEARCH_INDEX_PKG.create_index(1800): ORA-20000: Exception at
POS_SUPPLIER_SEARCH_INDEX_PKG.create_index(1800): ORA-29855: error occurred in
the execution of ODCIINDEXCREATE routine
ORA-20000: Oracle Text error:
DRG-10502: index POS_SUPPLIER_SEARCH_INDEX does not exist
DRG-11135: feature not generally available
ORA-06512: at line 57

122 Adding an Additional New Node

The following must all be true In a shared file system:

User ID and Group ID should be consistent across all nodes to avoid file access permission issues.
The same absolute path must be retained for the shared file system mount points on each node.
The value for the context variable "s_atName" must be same across all the application tier node context files.


Ensure that value of the AutoConfig variable " s_shared_file_system" is set to "true" ( without the quote)
If not Change the value to true and run AutoConfig on both RUN & PATCH FS

Make sure to run AutoConfig  If you chenge Autoconfig variable " s_shared_file_system"

Source the RUN FS:
Bring down the Application Services

$adautocfg.sh
Enter the APPS user password:

Source the RUN fs and start the WebLogic Administration process
$ cd <inst-top-run-fs>/admin/scripts
$ adadminsrvctl.sh start
$admanagedsrvctl.sh start oacore_server1
$admanagedsrvctl.sh start oafm_server1
$admanagedsrvctl.sh start forms-c4ws_server1
$admanagedsrvctl.sh start forms_server1
$ perl $INST_TOP/admin/scripts/perl adpreclone.pl appsTier    (When success GOTO next step)
$sh $ADMIN_SCRIPTS_HOME/adstpall.sh apps/apps

Source the PATCH FS:
Modify AutoConfig variable " s_shared_file_system" is set to "true" on Patch FS context file

Source the PATCH fs and start the WebLogic Administration process

$adadminsrvctl.sh start forcepatchfs
$admanagedsrvctl.sh start oacore_server1 forcepatchfs
$admanagedsrvctl.sh start oafm_server1 forcepatchfs
$admanagedsrvctl.sh start forms-c4ws_server1 forcepatchfs
$admanagedsrvctl.sh start forms_server1 forcepatchfs
$perl $INST_TOP/admin/scripts/adpreclone.pl appsTier   (When success GOTO next step)
$sh $ADMIN_SCRIPTS_HOME/adstpall.sh apps/apps forcepatchfs


NB: Assuming that all below are in place Before we proceed ahead to add a node.

The fully qualified hostname of the application tier node to be added must be present in the sqlnet.ora file in the <Database_Oracle_ Home>/network/admin/<context-name> directory. (See tcp.invited_nodes parameter.)
The database and TNS listener must be running before the steps listed below are performed.
In a shared file system, User ID and group ID should be consistent across all nodes to avoid file access permission issues.
The same absolute path must be used for the shared file system mount points on each node.
Ensure that value of the AutoConfig variable "s_atName" is same across all the application tier node context files.
Ensure that value of the AutoConfig variable " s_shared_file_system" is set to "true" ( without the quote) on the primary application tier node. This variable will be automatically set to "true" if the shared file system u01ion was chosen during the Rapid Install.
The oraInventory directory from the primary application tier and the oraInst.loc file must be accessible to all nodes sharing the application tier file system.
It is recommended to keep the Instance Top ( INST_TOP) on the shared file system for 1) Ease of maintenance 2) The number of application tier processes writing to this location is limited when compared with the previous releases.

STEP#
Add the Secondary Application Tier Node to the Farm

The primary decision that an administrator need to make before proceeding with the steps given below is to decide what services are going to be configured on the secondary node. The new node that you are planning to add can run any service except for WebLogic Administration Server, which is only configured on the primary application tier node. Follow the steps given below to add a node.

prepare the PairsFile for Configuring the Run File System
A sample pairsfile for the run file system is instantiated into the relevant instance home on the primary application tier node. The name of the file is <SID>_<primary_node_name>_<file_edition_type>.txt, located in the <INST_TOP>/appl/admin/ directory. For a configuration with an instance name of VIS, the pairsfile will be /u01/12.2/fs1/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1_run.txt.

$mkdir -p $INST_TOP/appl/admin/run
$cd $INST_TOP/appl/admin/run
$cp $INST_TOP/appl/admin/run/OSRIP_auohsdevapp01_run.txt myrunpairsfile.txt

Note: The sections that you need to fill in are the following in myrunpairsfile.txt
[Instance Specific] - This is instance specific information for the node you are going to add. Refer to the source context file for reference.
[Services]

s_temp=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp02/temp
s_contextname=OSRIP_auohsdevapp02
s_hostname=auohsdevapp02
s_domainname=domain.com
s_cphost=auohsdevapp02
s_webhost=auohsdevapp02
s_config_home=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp02
s_inst_base=/u01/oracle/OSRIP
s_display=auohsdevapp02:0.0
s_forms-c4ws_display=auohsdevapp02:0.0
s_ohs_instance=EBS_web_OSRIP_OHS1
s_webport=8020
s_http_listen_parameter=8020
s_https_listen_parameter=4463

[Services]
s_web_applications_status=enabled
s_web_entry_status=enabled
s_apcstatus=enabled
s_root_status=enabled
s_batch_status=enabled
s_other_service_group_status=disabled
s_adminserverstatus=disabled

export TWO_TASK=OSRIP
export PATH=/u01/oracle/OSRIP/fs1/FMW_Home/webtier/perl/bin:$PATH

cd $COMMON_TOP/clone/bin
/u01/oracle/OSRIP/fs1/FMW_Home/webtier/perl/bin/perl adclonectx.pl addnode contextfile=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp01/appl/admin/OSRIP_auohsdevapp01.xml \
pairsfile=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp01/appl/admin/run/myrunpairsfile.txt \
outfile=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp02/appl/admin/OSRIP_auohsdevapp02.xml

=Execution log of above Command, Fyi..=

<code>
[applmgr@auohsdevapp02 bin]$ /u01/oracle/OSRIP/fs1/FMW_Home/webtier/perl/bin/perl adclonectx.pl addnode contextfile=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp01/appl/admin/OSRIP_auohsdevapp01.xml \
> pairsfile=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp01/appl/admin/run/myrunpairsfile.txt \
> outfile=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp02/appl/admin/OSRIP_auohsdevapp02.xml

                     Copyright (c) 2011 Oracle Corporation
                        Redwood Shores, California, USA

                        Oracle E-Business Suite Rapid Clone

                                 Version 12.2

                      adclonectx Version 120.30.12020000.10


Enter the APPS passwd :

Enter the Weblogic AdminServer password :
Running:
perl /u01/oracle/OSRIP/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/adProvisionEBS.pl ebs-create-node -contextfile=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp01/appl/admin/OSRIP_auohsdevapp01.xml -configfile=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp01/appl/admin/run/myrunpairsfile.txt -machinelistenaddress=auohsdevapp02.domain.com -logfile=/u01/oracle/OSRIP/fs1/EBSapps/comn/clone/bin/EBSProvision.log  -promptmsg=hide

Log file located at /u01/oracle/OSRIP/fs1/EBSapps/comn/clone/bin/EBSProvision.log

Target System Instance Top set to /u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp02
Database port is 1541
Report file located at /u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp02/admin/out/portpool.lst
Complete port information available at /u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp02/admin/out/portpool.lst

Creating the new APPL_TOP Context file from :
  /u01/oracle/OSRIP/fs1/EBSapps/appl/ad/12.0.0/admin/template/adxmlctx.tmp

The new APPL_TOP context file has been created :
  /u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp02/appl/admin/OSRIP_auohsdevapp02.xml

Log file located at /u01/oracle/OSRIP/fs1/EBSapps/comn/clone/bin/EBSProvision.log
contextfile=/u01/oracle/OSRIP/fs1/inst/apps/OSRIP_auohsdevapp02/appl/admin/OSRIP_auohsdevapp02.xml
NMProcess: <Apr 16, 2015 1:04:31 PM> <INFO> <Loading domains file: /u01/oracle/OSRIP/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.domains>
NMProcess: Apr 16, 2015 1:04:31 PM weblogic.nodemanager.server.NMServerConfig initDomainsMap
NMProcess: INFO: Loading domains file: /u01/oracle/OSRIP/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.domains
NMProcess: <Apr 16, 2015 1:04:32 PM> <WARNING> <Node manager configuration properties file '/u01/oracle/OSRIP/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.properties' not found. Using default settings.>
NMProcess: Apr 16, 2015 1:04:32 PM weblogic.nodemanager.server.NMServer <init>
NMProcess: WARNING: Node manager configuration properties file '/u01/oracle/OSRIP/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.properties' not found. Using default settings.
NMProcess: <Apr 16, 2015 1:04:32 PM> <INFO> <Saving node manager configuration properties to '/u01/oracle/OSRIP/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.properties'>
NMProcess: Apr 16, 2015 1:04:32 PM weblogic.nodemanager.server.NMServer <init>
NMProcess: INFO: Saving node manager configuration properties to '/u01/oracle/OSRIP/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.properties'
NMProcess: Node manager v10.3
NMProcess:
NMProcess: Configuration settings:
NMProcess:
NMProcess: NodeManagerHome=/u01/oracle/OSRIP/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2
NMProcess: ListenAddress=auohsdevapp02.domain.com
NMProcess: ListenPort=5576
NMProcess: ListenBacklog=50
NMProcess: SecureListener=false
NMProcess: AuthenticationEnabled=true
NMProcess: NativeVersionEnabled=true
NMProcess: CrashRecoveryEnabled=false
NMProcess: JavaHome=/u01/oracle/OSRIP/fs1/EBSapps/comn/util/jdk64/jre
NMProcess: StartScriptEnabled=false
NMProcess: StopScriptEnabled=false
NMProcess: StartScriptName=startWebLogic.sh
NMProcess: StopScriptName=
NMProcess: LogFile=/u01/oracle/OSRIP/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.log
NMProcess: LogLevel=INFO
NMProcess: LogLimit=0
NMProcess: LogCount=1
NMProcess: LogAppend=false
NMProcess: LogToStderr=true
NMProcess: LogFormatter=weblogic.nodemanager.server.LogFormatter
NMProcess: DomainsFile=/u01/oracle/OSRIP/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.domains
NMProcess: DomainsFileEnabled=true
NMProcess: StateCheckInterval=500
NMProcess: QuitEnabled=true
NMProcess: UseMACBroadcast=false
NMProcess: DomainRegistrationEnabled=false
NMProcess: DomainsDirRemoteSharingEnabled=false
NMProcess:
NMProcess: Domain name mappings:
NMProcess:
NMProcess: EBS_domain_OSRIP -> /u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP
NMProcess:
NMProcess: <Apr 16, 2015 1:05:21 PM> <INFO> <EBS_domain_OSRIP> <AdminServer> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/AdminServer/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 1:05:21 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/AdminServer/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 1:05:21 PM> <INFO> <EBS_domain_OSRIP> <forms_server1> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/forms_server1/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 1:05:21 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/forms_server1/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 1:05:22 PM> <INFO> <EBS_domain_OSRIP> <oacore_server1> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/oacore_server1/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 1:05:22 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/oacore_server1/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 1:05:22 PM> <INFO> <EBS_domain_OSRIP> <forms-c4ws_server1> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/forms-c4ws_server1/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 1:05:22 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/forms-c4ws_server1/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 1:05:22 PM> <INFO> <EBS_domain_OSRIP> <oafm_server1> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/oafm_server1/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 1:05:22 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs1/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/oafm_server1/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 1:05:22 PM> <INFO> <Plain socket listener started on port 5576, host auohsdevapp02.domain.com>
NMProcess: Apr 16, 2015 1:05:22 PM weblogic.nodemanager.server.Listener run
NMProcess: INFO: Plain socket listener started on port 5576, host auohsdevapp02.domain.com
Node added successfully.

Node auohsdevapp02.domain.com is added successfully
</code>

=Source the PATCH fs on Primary Node=

$mkdir -p $INST_TOP/appl/admin/run
$cd $INST_TOP/appl/admin/run
$cp $INST_TOP/appl/admin/run/OSRIP_auohsdevapp01_patch.txt mypatchpairsfile.txt

#Make necessary modifications to the pairs file
Note: The sections that you need to fill in are the following.
[Instance Specific] - This is instance specific information for the node you are going to add. Refer to the source context file for reference.
[Services]

s_temp=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp02/temp
s_contextname=OSRIP_auohsdevapp02
s_hostname=auohsdevapp02
s_domainname=domain.com
s_cphost=auohsdevapp02
s_webhost=auohsdevapp02
s_config_home=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp02
s_inst_base=/u01/oracle/OSRIP
s_display=auohsdevapp02:0.0
s_forms-c4ws_display=auohsdevapp02:0.0
s_ohs_instance=EBS_web_OSRIP_OHS1
s_webport=8020
s_http_listen_parameter=8020
s_https_listen_parameter=4463

[Services]
s_web_applications_status=enabled
s_web_entry_status=enabled
s_apcstatus=enabled
s_root_status=enabled
s_batch_status=enabled
s_other_service_group_status=disabled
s_adminserverstatus=disabled


$adadminsrvctl.sh start forcepatchfs
$admanagedsrvctl.sh start oacore_server1 forcepatchfs
$admanagedsrvctl.sh start oafm_server1 forcepatchfs
$admanagedsrvctl.sh start forms-c4ws_server1 forcepatchfs
$admanagedsrvctl.sh start forms_server1 forcepatchfs


Re-Log into Node2

[applmgr@auohsdevapp02 ~]$ export TWO_TASK=OSRIP
[applmgr@auohsdevapp02 ~]$ export PATH=/u01/oracle/OSRIP/fs2/FMW_Home/webtier/perl/bin:$PATH
[applmgr@auohsdevapp02 bin]$ /u01/oracle/OSRIP/fs2/FMW_Home/webtier/perl/bin/perl adclonectx.pl \
> addnode contextfile=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp01/appl/admin/OSRIP_auohsdevapp01.xml \
> pairsfile=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp01/appl/admin/patch/mypatchpairsfile.txt \
> outfile=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp02/appl/admin/OSRIP_auohsdevapp02.xml

[applmgr@auohsdevapp02 bin]$ /u01/oracle/OSRIP/fs2/FMW_Home/webtier/perl/bin/perl adclonectx.pl \
> addnode contextfile=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp01/appl/admin/OSRIP_auohsdevapp01.xml \
> pairsfile=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp01/appl/admin/patch/mypatchpairsfile.txt \
> outfile=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp02/appl/admin/OSRIP_auohsdevapp02.xml

                     Copyright (c) 2011 Oracle Corporation
                        Redwood Shores, California, USA

                        Oracle E-Business Suite Rapid Clone

                                 Version 12.2

                      adclonectx Version 120.30.12020000.10


Enter the APPS passwd :

Enter the Weblogic AdminServer password :
Running:
perl /u01/oracle/OSRIP/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/adProvisionEBS.pl ebs-create-node -contextfile=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp01/appl/admin/OSRIP_auohsdevapp01.xml -configfile=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp01/appl/admin/patch/mypatchpairsfile.txt -machinelistenaddress=auohsdevapp02.domain.com -logfile=/u01/oracle/OSRIP/fs2/EBSapps/comn/clone/bin/EBSProvision.log  -promptmsg=hide

Log file located at /u01/oracle/OSRIP/fs2/EBSapps/comn/clone/bin/EBSProvision.log

Target System Instance Top set to /u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp02
Database port is 1541
Report file located at /u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp02/admin/out/portpool.lst
Complete port information available at /u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp02/admin/out/portpool.lst

Creating the new APPL_TOP Context file from :
  /u01/oracle/OSRIP/fs2/EBSapps/appl/ad/12.0.0/admin/template/adxmlctx.tmp

The new APPL_TOP context file has been created :
  /u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp02/appl/admin/OSRIP_auohsdevapp02.xml

Log file located at /u01/oracle/OSRIP/fs2/EBSapps/comn/clone/bin/EBSProvision.log
contextfile=/u01/oracle/OSRIP/fs2/inst/apps/OSRIP_auohsdevapp02/appl/admin/OSRIP_auohsdevapp02.xml
NMProcess: <Apr 16, 2015 3:25:03 PM> <INFO> <Loading domains file: /u01/oracle/OSRIP/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.domains>
NMProcess: Apr 16, 2015 3:25:03 PM weblogic.nodemanager.server.NMServerConfig initDomainsMap
NMProcess: INFO: Loading domains file: /u01/oracle/OSRIP/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.domains
NMProcess: <Apr 16, 2015 3:25:03 PM> <WARNING> <Node manager configuration properties file '/u01/oracle/OSRIP/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.properties' not found. Using default settings.>
NMProcess: Apr 16, 2015 3:25:03 PM weblogic.nodemanager.server.NMServer <init>
NMProcess: WARNING: Node manager configuration properties file '/u01/oracle/OSRIP/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.properties' not found. Using default settings.
NMProcess: <Apr 16, 2015 3:25:03 PM> <INFO> <Saving node manager configuration properties to '/u01/oracle/OSRIP/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.properties'>
NMProcess: Apr 16, 2015 3:25:03 PM weblogic.nodemanager.server.NMServer <init>
NMProcess: INFO: Saving node manager configuration properties to '/u01/oracle/OSRIP/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.properties'
NMProcess: Node manager v10.3
NMProcess:
NMProcess: Configuration settings:
NMProcess:
NMProcess: NodeManagerHome=/u01/oracle/OSRIP/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2
NMProcess: ListenAddress=auohsdevapp02.domain.com
NMProcess: ListenPort=5577
NMProcess: ListenBacklog=50
NMProcess: SecureListener=false
NMProcess: AuthenticationEnabled=true
NMProcess: NativeVersionEnabled=true
NMProcess: CrashRecoveryEnabled=false
NMProcess: JavaHome=/u01/oracle/OSRIP/fs2/EBSapps/comn/util/jdk64/jre
NMProcess: StartScriptEnabled=false
NMProcess: StopScriptEnabled=false
NMProcess: StartScriptName=startWebLogic.sh
NMProcess: StopScriptName=
NMProcess: LogFile=/u01/oracle/OSRIP/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.log
NMProcess: LogLevel=INFO
NMProcess: LogLimit=0
NMProcess: LogCount=1
NMProcess: LogAppend=false
NMProcess: LogToStderr=true
NMProcess: LogFormatter=weblogic.nodemanager.server.LogFormatter
NMProcess: DomainsFile=/u01/oracle/OSRIP/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome2/nodemanager.domains
NMProcess: DomainsFileEnabled=true
NMProcess: StateCheckInterval=500
NMProcess: QuitEnabled=true
NMProcess: UseMACBroadcast=false
NMProcess: DomainRegistrationEnabled=false
NMProcess: DomainsDirRemoteSharingEnabled=false
NMProcess:
NMProcess: Domain name mappings:
NMProcess:
NMProcess: EBS_domain_OSRIP -> /u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP
NMProcess:
NMProcess: <Apr 16, 2015 3:25:51 PM> <INFO> <EBS_domain_OSRIP> <AdminServer> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/AdminServer/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 3:25:51 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/AdminServer/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 3:25:51 PM> <INFO> <EBS_domain_OSRIP> <oacore_server1> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/oacore_server1/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 3:25:51 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/oacore_server1/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 3:25:51 PM> <INFO> <EBS_domain_OSRIP> <forms_server1> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/forms_server1/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 3:25:51 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/forms_server1/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 3:25:51 PM> <INFO> <EBS_domain_OSRIP> <oafm_server1> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/oafm_server1/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 3:25:51 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/oafm_server1/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 3:25:51 PM> <INFO> <EBS_domain_OSRIP> <forms-c4ws_server1> <Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/forms-c4ws_server1/data/nodemanager/startup.properties">
NMProcess: Apr 16, 2015 3:25:51 PM weblogic.nodemanager.server.AbstractServerManager log
NMProcess: INFO: Startup configuration properties loaded from "/u01/oracle/OSRIP/fs2/FMW_Home/user_projects/domains/EBS_domain_OSRIP/servers/forms-c4ws_server1/data/nodemanager/startup.properties"
NMProcess: <Apr 16, 2015 3:25:51 PM> <INFO> <Plain socket listener started on port 5577, host auohsdevapp02.domain.com>
NMProcess: Apr 16, 2015 3:25:51 PM weblogic.nodemanager.server.Listener run
NMProcess: INFO: Plain socket listener started on port 5577, host auohsdevapp02.domain.com
Node added successfully.

Node auohsdevapp02.domain.com is added successfully

Bring up all services on both nodes.

Ref# Sharing The Application Tier File System in Oracle E-Business Suite Release 12.2 (Doc ID 1375769.1)

TROUBLESHOOTING HINTS:
=======================
All 4 ORACLE HOMES entries exist in oraInventory location.

<ORACLE_HOME>/oui/bin/attachHome.sh -silent -local -invPtrLoc /u01/oracle/OSRIP/fs1/FMW_Home/webtier/oraInst.loc
<ORACLE_HOME>/oui/bin/attachHome.sh -silent -local -invPtrLoc /u01/oracle/OSRIP/fs1/FMW_Home/oracle_common/oraInst.loc
<ORACLE_HOME>/oui/bin/attachHome.sh -silent -local -invPtrLoc /u01/oracle/OSRIP/fs1/FMW_Home/Oracle_EBS-app1/oraInst.loc
<ORACLE_HOME>/oui/bin/attachHome.sh -silent -local -invPtrLoc /u01/oracle/OSRIP/fs1/EBSapps/10.1.2/oraInst.loc

The fully qualified hostname of the application tier node to be added must be present in the sqlnet.ora file in the <Database_Oracle_ Home>/network/admin/<context-name> directory. (See tcp.invited_nodes parameter.)
The database and TNS listener must be running before the steps listed below are performed.
In a shared file system, User ID and group ID should be consistent across all nodes to avoid file access permission issues.
The same absolute path must be used for the shared file system mount points on each node.
Ensure that value of the AutoConfig variable "s_atName" is same across all the application tier node context files.
Ensure that value of the AutoConfig variable " s_shared_file_system" is set to "true" ( without the quote) on the primary application tier node. This variable will be automatically set to "true" if the shared file system u01ion was chosen during the Rapid Install.
The oraInventory directory from the primary application tier and the oraInst.loc file must be accessible to all nodes sharing the application tier file system.


=ISSUES =

<CODE>
*******FATAL ERROR*******
PROGRAM : (/u01/oracle/OSRIP/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetConfig.pl)
TIME    : Wed Apr 15 19:31:58 2015
FUNCTION:  [ Level 1 ]
ERRORMSG: *******FATAL ERROR*******
PROGRAM : (/u01/oracle/OSRIP/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetConfig.pl)
TIME    : Wed Apr 15 19:31:58 2015
FUNCTION: TXK::Process::run [ Level 3 ]
MESSAGES:
Command error: <rc> = 18688, <command> = /u01/oracle/OSRIP/fs1/FMW_Home/webtier/OPatch/opatch lsinventory -invPtrLoc
/u01/oracle/OSRIP/fs1/FMW_Home/webtier/oraInst.loc -oh /u01/oracle/OSRIP/fs1/FMW_Home/webtier -detail -jdk /u01/oracle/OSRIP/fs1/FMW_Home/webtier/jdk


STACK TRACE
 at /u01/oracle/OSRIP/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Error.pm line 168
        TXK::Error::abort('TXK::Error', 'HASH(0xc521b8)') called at /u01/oracle/OSRIP/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Common.pm line 299
        TXK::Common::doError('TXK::Process=HASH(0x1eb0d00)', 'Command error: <rc> = 18688, <command> = /u01/oracle/OMSPRJ...', undef) called at /u01/oracle/OSRIP/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Common.pm line 314
        TXK::Common::setError('TXK::Process=HASH(0x1eb0d00)', 'Command error: <rc> = 18688, <command> = /u01/oracle/OMSPRJ...') called at /u01/oracle/OSRIP/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Process.pm line 449
        TXK::Process::run('TXK::Process=HASH(0x1eb0d00)', 'HASH(0x1ab5b38)') called at /u01/oracle/OSRIP/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Techstack.pm line 5974
        TXK::Techstack::_txkCheckIASVersion('TXK::Techstack=HASH(0x1b3c410)', undef) called at /u01/oracle/OSRIP/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Techstack.pm line 5876
        TXK::Techstack::txkCheckIASVersion('TXK::Techstack=HASH(0x1b3c410)') called at /u01/oracle/OSRIP/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetConfig.pl line 233
        main::getIASOracleHomeVersion() called at /u01/oracle/OSRIP/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetConfig.pl line 98
        eval {...} called at /u01/oracle/OSRIP/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetConfig.pl line 77


STACK TRACE
 at /u01/oracle/OSRIP/fs1/EBSapps/appl/au/12.0.0/perl/TXK/Error.pm line 220
        TXK::Error::printMsg('TXK::Error', '*******FATAL ERROR*******\x{a}PROGRAM : (/u01/oracle/OSRIP/f...') called at
        /u01/oracle/OSRIP/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetConfig.pl line 115

.end err out.

Issues Fix: ORACLE Inventory rebuild.
=====================================
attachHome.sh -silent -local -invPtrLoc /u01/oracle/OSRIP/fs1/FMW_Home/webtier/oraInst.loc
attachHome.sh -silent -local -invPtrLoc /u01/oracle/OSRIP/fs1/FMW_Home/oracle_common/oraInst.loc
attachHome.sh -silent -local -invPtrLoc /u01/oracle/OSRIP/fs1/FMW_Home/Oracle_EBS-app1/oraInst.loc
attachHome.sh -silent -local -invPtrLoc /u01/oracle/OSRIP/fs1/EBSapps/10.1.2/oraInst.loc


</CODE>

Materialized View Limitation on 12.2.x, Can be checked via GLOBAL STANDARDS COMPLIANCE CHECKER

The Materialized View is a non-editioned object type, and therefore a materialized view cannot directly reference editioned objects. To avoid this
limitation, Oracle E-Business Suite Online Patching technology implements a new Effectively Editioned Materialized View compound object. Application developers
create and maintain the Materialized View Definition (query) in an ordinary view. The Online Patching technology then automatically maintains a
corresponding Materialized View Implementation that is legal for editioned databases.

MV Definition Standards:
A Materialized View Name must be unique within the first 29 bytes.
A Materialized View Definition must be stored in an ordinary view called MV_NAME||'#'.
Create or replace the Materialized View Definition as an ordinary view calledmv_name||'#'.
Test the MV Definition for accuracy before generating the MV Implementation.

For example:
create or replace view FND_EXAMPLE_MV# as select ... ;
select * from fnd_example_mv#;
The Materialized View Implementation is automatically generated from the MV Definition using the AD_ZD_MVIEW.UPGRADE procedure.
The syntax is exec ad_zd_mview.upgrade(<MV_OWNER>, <MV_NAME>)
Do not attempt to directly create or replace the Materialized View Implementation Query. To recreate an MV Implementation, call the
AD_ZD_MVIEW.UPGRADE procedure.

A Materialized View Definition must specify a column alias for each item in the select list.

In this scenario how we need to make this work for custom materialized views?

Soft Links not recognized or Not comaptible in 12.2.x

When trying to apply patch using command 

“adop phase=apply patches=19711877 hotpatch=yes”, Its failing to apply on both nodes, though SSH success.

So in this case we can be success with the below commands

adop phase=apply patches=19711877 hotpatch=yes flags=autoskip è This also will skip the failed nodes and will proceed with the existing nodes.

adop phase=apply patches=19711877 hotpatch=yes options=forceapply => When you want to apply again, it will skip the issue node and continue with the available nodes.

So I applied the patch with the below command:

adop phase=apply patches=19711877 hotpatch=yes allnodes=no action=db è which applies to only current node. And fs_clone will give below issue.

“The following nodes are not in sync : isupplyNode02

Please bring the nodes in sync and then continue”

When I try to go and apply on other node, its failing with the below issue.

adop phase=apply patches=19711877 hotpatch=yes allnodes=no action=nodb

Its failing with the below issue.

RUN file system context file: /opt/app/OCLEP/fs2/inst/apps/OCLEP_isupplyNode02/appl/admin/OCLEP_isupplyNode02.xml*******FATAL ERROR*******

PROGRAM : (/opt/appr12/......../fs2/EBSapps/appl/ad/12.0.0/bin/adzdoptl.pl)

TIME    : Fri Mar 27 17:17:56 2015

FUNCTION: ADOP::GlobalVars::replaceRunEditionNameWithPatch [ Level 1 ]

ERRORMSG: ERROR: /opt/app/......../fs2/inst/apps/OCLEP_isupplyNode02.xml/appl/admin/OCLEP_isupplyNode02.xml path should contain either /opt/appr12/OCLEP/fs1 or /opt/appr12/OCLEP/fs2 as a base.

The suspected issue is “SOFT LINK”

[applmgr@OCLEP_isupplyNode02 opt]$ ls -ltr

total 4

lrwxrwxrwx  1 root root    3 May 30  2014 appr12 -> app

drwxrwxrwx 10 root root 4096 Mar 20 22:23 app

To Fix Sync  issue Please follow Below Plan.

-  Remove the soft link
           (Requires to regenerate the configuration Information Again, All other adding node Steps, according to the scenario)
- Re apply patch with force option Or Apply Patch to only 2nd node

-  Apply the patch on this node “isupplyNode02”
           adop phase=apply patches=19711877 hotpatch=yes allnodes=no action=nodb

-   Then RUN adop phase=fs_clone to synchronize the run FS with patch FS

JBO-30012 Error While Logging Into R12.2.4

ERROR
-----------------------
Error while invoking Main Menu. JBO-30012: A cookie for session g5FHanr4vzZEfS3kbZs5fXxERN and application oracle.apps.fnd.framework.navigate.server.OANavigatePortletAM has already been registered with application pool oracle.prod.orgPAYoracle.apps.fnd.framework.navigate.server.OANavigatePortletAM. The cookie must be removed first.

CHANGES

 Upgrade from 12.1.3 to 12.2.4

SOLUTION

Run the 'Profiles Options Query' that is documented in Note: 364439.1 Tips and Queries for Troubleshooting Advanced Topologies
Make sure that the profile options are pointing to the correct host and url. 
For information on what the profile options should be set to, review Note: 1373537.1 Oracle Application Framework Profile Options Release 12.2

Implementing customizations in 12.2.4 or 12.2.X

1) Set classpath for customizations
"s_adovar_classpath" set /u01/oracle/OSRIP/fs1/EBSapps/appl/xxsr/12.0.0/java/classes: by adding xxsr java classes at the very beginning

2) Move or Copy the Custom class files to
/u01/oracle/OSRIP/fs1/EBSapps/appl/xxsr/12.0.0/java/classes

3) Edit the manifest file and change Entries as below
vi $FND_TOP/admin/template/ebsProductManifest_xml.tmp
Make sure customall.jar section is properly finshed by
      </libraries>
Add below part:
    <!-- ONSEMI customization for OAF - BEGIN -->
    <classpath>
      <absolute-path>%s_xxsrtop%/java/classes</absolute-path>
      <relative-path>../../../../../appl/xxsr/12.0.0/java/classes</relative-path>
      <windows-path>@BEA_HOME@/../EBSapps/appl/xxsr/12.0.0/java/classes</windows-path>
      <libraries>
        <library>customprod.jar</library>
      </libraries>
    </classpath>
    <!-- ONSEMI customization for OAF - END -->

NB:  Run autoconfig
$ adautocfg.sh
Enter the APPS user password:

4) Create custom classes jar file, cleanup is needed first

find /u01/oracle/OSRIP/fs1/EBSapps/appl/xxsr/12.0.0/java/classes -type f -not \( -name '*.xml' -o -name '*.class' \) -exec rm -f {} \;
find /u01/oracle/OSRIP/fs1/EBSapps/appl/xxsr/12.0.0/java/classes -type d -name 'common' -empty -exec rm -rf {} \;

5) cd $XXSR_TOP/java/classes

Delete temporary customprod.zip

zip -r customprod.zip *

6) Identify the existing keystore and key passwords by running the following SQL script connected as the APPS user:

SQL> set serveroutput on

declare

spass varchar2(30);

kpass varchar2(30);

begin

ad_jar.get_jripasswords(spass, kpass);

dbms_output.put_line(spass);

dbms_output.put_line(kpass);

end;

/

7) Sign custom jar file 

adjava oracle.apps.ad.jri.adjmx -areas customprod.zip -outputFile customprod.jar -jar $CONTEXT_NAME 1 CUST jarsigner -storePass changeit keyPass changeit

Or

Sign custom jar file using store pass and key pass from the above query

adjava oracle.apps.ad.jri.adjmx -areas $XXSR_TOP/java/classes/XXSRall.zip -outputFile $XXSR_TOP/java/classes/XXSRall.jar -jar $CONTEXT_NAME 1 CUST

OTHER Approach,
=============


=> Place a Custom directory Under JAVA_TOP
=> Create customall.jar file using "adcgnjar" utility.

Verification:
========

=> copy the customall.jar file to /tmp location.
=> Unzip the jar file using "unzip" utility and review all the intended directories taken
by the jar file.

=> Make sure JAVA_TOP path included in the CLASS PATH.
=>  Restart the oacore
admanagedsrvctl.sh stop oacore_server1
admanagedsrvctl.sh start oacore_server1

R12.2 How to Clear a Cache

Apache / iAS 

For 11i and earlier versions:

- shutdown iAS server
- go to $OA_HTML (for 11.5.9) or $COMMON_TOP (for 11.5.10.x) directory
- backup the directory _pages and delete its contents by running for instance:

  rm -rf $COMMON_TOP/_pages/*

- for modplsql caches remove contents of  $IAS_ORACLE_HOME/Apache/modplsql/cache directory
- restart iAS server


To clear middle tier cache in release 12:

- go to "Functional Administrator" responsibility
- select Core Services => Caching Framework => Global Configuration => Clear cache
(please review Note 759038.1 for details).

In case you have login issue after accidentally cleared the _pages instead of using the method above for r12
please review Note 433386.1 to recompile jsp files.

Source# Noted ID: 742107.1