Wednesday, March 29, 2023

EBS 12.2 -- Failed to load webapp: /OA_HTML , java.lang.NullPointerException , WebAppModule.java:397 & ClassFinderMetaDataEnumaration.java:32

Today, I want to share an interesting issue that I came across in an EBS 12.2 environment. The issue started after applying an EBS CPU... When the issue was escalated to me, the limits of tolerance had already been crossed, so we had to save the day.

Issue: 

After applying an EBS CPU (2022), oacore server couldn't be started.. It was just putting itself to the ADMIN state and normally didn't service anything.. This issue resulted service interruption, as the EBS application lost a large part of its functionality.(login page was throwing HTTP - Error 404 Not Found)

Running autoconfig and taking some general actions didn't solve it. (Regeneration tasks... In case we might have a corrupted/or irregular ebs3rdpartyManifest_xml.tmp).  

Applying a more recent CPU came to mind, but it was an intense work, because all the tests were done for CPU 2022, and those tests should be repeated for 2023 as well.. Besides, we needed to save the day, cause EBS was not functioning.

Here is  part of the actual call/error stack:

weblogic.application.ModuleException: Failed to load webapp: /OA_HTML because of DeploymentException: java.lang.NullPointerException

        at weblogic.servlet.internal.WebAppModule.prepare(WebAppModule.java:397)

        at weblogic.application.internal.flow.ScopedModuleDriver.prepare(ScopedModuleDriver.java:176)

        at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:199)

        at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:517)

        at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)

        .....

        ..................

Caused By: java.lang.NullPointerException

        at weblogic.application.utils.ClassFinderMetaDataEnumaration.hasMoreElements(ClassFinderMetaDataEnumaration.java:32)

        at weblogic.servlet.internal.WebAnnotationProcessorImpl.getAnnotatedClasses(WebAnnotationProcessorImpl.java:139)

        at weblogic.servlet.internal.War.getAnnotatedClasses(War.java:1038)

Cause:

Some nonEBS-related files (for example: backup files created manually before applying some apps patches) were present in the APPS filesystem. Weblogic (oacore managed server in this case) was trying to use them, and that was creating the misbehaviour. 

Note that, in some rare cases;  file permissions can also be a cause of this issue..

The solution:

*Remove any nonEBS-related files which reside in $OA_HTML/WEB_INF .. (there were some backups in our case)

*Remove any nonEBS-related files which reside in $OA_HTML (some backup JSP files were there)

*Recompile JSP files.

cd $FND_TOP/patch/115/bin
$ perl -x ojspCompile.pl --compile –flush

*Restart the Oacore Services (managed servers) and that's it.

Some References:

java.lang.NullPointerException at weblogic.application.utils.ClassFinderMetaDataEnumaration.hasMoreElements During The Deployment Of Applications At The Server Startup (Doc ID 1937917.1)

12.2 E-Business Technology Stack Weblogic Service Oacore Services Are Down And Will Not Start Due To Error 'ModuleException: Failed to load webapp' And 'DeploymentException: java.lang.ClassNotFoundException: csrfguard.servlet.JavaScriptServlet' (Doc ID 2533082.1)

Wednesday, March 22, 2023

Oracle Systems Event -- "Maximizing The Gains and Carrying Them Into The Future with Oracle Systems", Exadata, PCA, ODA, ZFS, PMEM, PMEM Commit and Data Accelerators, ROCE, KVM, OCI, ATP and more.

At yesterday's event, I shared my experience on positioning Oracle Systems on mission critical customer environments ((including Core Banking and ERP). Health checks, assessments, migration strategies, replatforming, design, failback scenarios, bundling, readiness, improvements and execution... 

I supported the benefits that I underlined and explained throughout the presentation, with 4 real life cases at the end of my talk. 4th use case (as a bonus --considering it was an Oracle Systems event) was related with Oracle Cloud Infrastructure (OCI). It was about the Auto Scale Core Banking solution (both scale-out and scale-in capabilities),  that we implemented on OCI. (by using a multi node IAS Weblogic Cluster, some cloud level customizations/coding and an Autonomous Transaction Processing Database).

This Oracle Event was inWyndham Grand Istanbul Kalamis Marina Hotel, Istanbul. 

All the attendees were Turkish (mostly tech managers & directors). So that, the invitation and the slides were mostly in Turkish, but I will still share them. Good news is, even if you don't know Turkish, I think you still get the idea once you check the slides.(as always; even the main language of the presentation is Turkish, there are still lots of English words out there.) Anyways; I will share the slides at the end of this post, but I'm sharing the event invitation right away, as a memory ->

The subject of my presentation was "Maximizing The Gains and Carrying Them Into The Future with Oracle Systems". 

I started by introducing our service areas, including Oracle Consultancy and Advanced Customer Support and them jumped into the real, existing topic, which was the Oracle Systems and the innovations offered with them. (and seeing them in action with our success stories). 

I introduced the new (still considered new)  Exadata X9-2M and PCA X9 machines, and also explained what else we have in Oracle System family, by giving the whole picture from Exadata to ODA and Oracle Servers. I also shared my experience on ODA and Supercluster(EOF but still in the field) engineered systems.


"The Oracle Way":

Attention was mostly on Exadata and ODA. Event attendees found the new and innovative features of Exadata very interesting. That part was also my favorite. While explaining the PMEM (persistent memory - Intel Optane),  Persistent Data Accelerator and Persistent Commit Accelerator, I felt like I was talking about Quantum Computing:) -- Yes, I admit I'm exaggerating a bit :) 

ROCE (RDMA Over Converged Ethernet) wasn't new for Exadata users, but explaining how ROCE supports the super fast PMEM I/O Path, was a pleasure, as well as mentioning how well the Oracle Database integrates with the newest hardware. Write through PMEM cache, fast LGWR I/O - write, best fit for OLTP,  database utilizing the PMEM in AppDirect mode using RDMA transparently, no need for configuring or managing anything, 1.5 TB PMEM per cell, the improvements in existing Exadata unique features.. Well...These topics were already enough to win the hearts.

Private Cloud Appliance (PCA) also got people excited.. We as GTech already completed a big Exadata and PCA replatforming project recently.. We consolidated lots of FMW apps in a single PCA X8 machine in that project. Sharing our experience along with the capabilities of the machine and shedding some lights on the motivations for positioning this machine helped a lot for getting the attention. 

Being able to run both the modern apps technology (containers, Kubernetes, microservices and all that) and the traditional apps (like java apps on Weblogic Clusters) on the same platform, being ready for the cloud (especially for OCI), the things like GiraalVM, the ZFS storage inside, isolation and virtualization, ease of implementation and management, fault tolerancy and performance...  These were more than enough for justifying the latest Oracle Apps Engineered System known as PCA.

I spoke almost for 40 minutes in this presentation and it is difficult to summarize it all here.  Don't worry I have lots of good news :) This time the good news is, I'm sharing the slides below :)

















Wednesday, March 15, 2023

RDBMS -- Handy App for Checking Oracle Database Features and Licensing

Following is an introduction for the Oracle Database Features and Licensing Application.

It is a web/Apex application. It is fast, easy-to-use, up-to-date, and  quite handy.  You can get all the details about Oracle features and options.. Licensing is also included.

Suppose you are wondering what is delivered with Advanced Security Option. Well, just click on the Licensing button, Choose Advanced Security Option which will be in the right pane and get all the information you need.

What I mean by "all the information" is actually the availability (release availability), the functional category (for instance: security) and the option details (the features delivered with the option -- with some additional notes)

Just check the screenshots below to see the details of the delivered information.

So using these app, you won't be looking for your Oracle Salesman much. (at least for non-commercial matters)

You can also use this app during your presales/sales activities. You can even populate your slides by using the information you get from this app.

Here is a screenshot that I took while checking the Oracle Advanced Security option from the licensing perspective.


Here is another screenshot that I got while checking the PMEM Support.

Links:

Oracle Database Features

https://apex.oracle.com/pls/apex/r/features/dbfeatures/home

Erman Arslan's Oracle Forum / FEB 20 - MAR 15, 2023 - "Q & A Series"

Supporting the Oracle users around the world. Let's check what we have in the last 23 days.

Ask Me Anything -> Oracle 20 FEB - 15 MAR 2023

Remember, you can ask questions and get remote support using my forum. Just click on the link named "Erman Arslan's Oracle Forum is available now". Click here to ask a question", which is available on the main page of Erman Arslan's Oracle Blog. A total of 2133 questions were asked and here is the links to the latest questions from the last period.

-- or just use the direct link: