Sunday, February 27, 2022

Erman Arslan's Oracle Forum / January and February 2022- "Q & A Series"

I still did not break the tradition (even in 2022!) and continued to support customers and the community despite the load of my work (leading my department, mission critical support activities & projects + intellectual gymnastics - physics and stuff like that ) ! :) 

Remember, you can ask questions and get remote support using my forum. Just click on the link named "Erman Arslan's Oracle Forum is available now". Click here to ask a question", which is available on the main page of Erman Arslan's Oracle Blog.



-- or just use the direct link:


Come on, let's see what we've been up to in January and February 2022.

#amaerman

Jan & Feb 2022 Issues:

row lock by Roshan

FIPH_WS_GBCP_PKG.pls by big

Migration 2 node rac to new server by satish

R12.1.3 migration from el5 32 bitto 64bit by satish

Standard to enterprise edition by satish

19c upgrade with EBS 12.1.3 environment by raiq1

Password file 12c by satish

OEM 13C by Arsalan

CONTEXT_FILE when cloning by big

Separate Remittance Advice by big

Add target agent by Arsalan

COLMAP by Roshan

session character set in SQL DEV by big

windows11 by serdar

User who read dictionary tables by big

large lreg trace file by big

SSO by Zakia

FRM-92101: there was a failure in the forms server during startup by baig

Request Header for Html pages by big

Note Java 1530033.1 and JRE on 19c DB tier by Laurel

restore rman backup from windows to linux by Arsalan

Patch 21916712:R12.AP.C by big

Workflow mailer not coming up. by baig

CVE Jan 2022 by big

HTTP 400 by big

NFS slowness by Roshan

R12.2 Installation by satish

Last PSU by big

Change Server Management to another VLAN by kuMan

config.xml and connection-filter-rule by Laurel

Secure Headers Normalized TLS by big

EBS_system schema by Laurel

row cache lock by Roshan

Form & report upgrade by raiq1

Wednesday, February 23, 2022

Hyperion -- Failure of Webserver Bridge -- After SSL/TLS implementation

A short story for today:)

An issue on a SSL/TLS enabled Hyperion 11.2.7 environment reported to me.. This issue was directly related with the SSL/TLS implementation. This is because it was reported that the issue started to appear just after enabling SSL/TLS on Hyperion.



Okay.. I will keep it short this time.. 
This is related with the wrong config in OHS-Weblogic..

OHS logs and Weblogic Managed Server logs told us the details, but as it has started happening after SSL/TLS config, it was already clear that, the cause was something related with the configuration.. 

(Note that, these types of issue may also caused by some incompatibilities between Hyperion tech. and the SSL/TLS versions used in implementation.. Also note that, there are few bugs around these things..

Anyways, It is good to go through MOS documents below.. (of course after analyzing the logs..)

After Applying OHS/Web-Tier Patch Set 11.1.1.9 : SSL Connection to WLS fails with "Failure of Web Server bridge" (Issue 1 - SSL Protocols) (Doc ID 2087174.1)

"Failure of Web Server bridge" If Mod_wl_Ohs Is Configured to Talk SSL with WLS and Strong Ciphersuites Are In Use (Doc ID 1604551.1)

After Configuring SSL between OHS and WLS, the Application from the Browser Fails with "Failure of Web Server bridge" (Doc ID 2198073.1)

After Upgrading Oracle HTTP Server to 11.1.1.9 SSL Connection to Weblogic Fails with Error "Failure of Web Server bridge" and "wl_ssl_open failed. Failed to initialize secure connection" (Doc ID 2573369.1)


*In our case, the solution was found while reviewing the setup with the MOS Note -> "Steps to Setting Up SSL Offloading with OHS Webserver From EPM 11.1.2.x (Doc ID 1530169.1)"

Just wanted to share.. This is a direct info for a specific case I know, but it may save you time! (at least the context & the error & MOS document mappings will ease your work for diagnosing these issues on Hyperion :)

Tuesday, February 8, 2022

ODA X8-2 -- Quick Info for Presales + Backup VMs using KVMBR on Virtualized environments

This blog post is about ODA X8-2, the latest generation of Oracle Database Appliance, which is an engineered system family that I have written about lots of times earlier. But! this time it is a little different, as this post is a little defensive :) I m actually writing to defend ODA against the doubts on virtual machine backup & recovery.

Just a little background information, before getting straight to the point;

ODA engineered system family gives us multiple options in terms of  machine size and scalability. We have the HA model for high availability and we have M (Medium) and S(small) models for having fast and reliable single node database (and apps) environments.

The purpose of this blog post is not to give you a detailed information about ODA X8 model family.. 

I will just give a quick, general info about ODA X8 HA and then I 'll get straight to the point.. My actual purpose is to give you some insights that you can use for defending ODA in the presales activities.

In general, if it's the case; I mean if the sizing tells us something like "Exadata is a little too much for the customer environment", we may consider ODA to be placed for the customer's needs. 

For hosting PROD, TEST and DEV environments, we may recommend the ODA X8-2HA. In such a scenario, where we have ODA X8-2 HA for hosting the PROD, ODA X8-2M can be placed as the DR platform.. -- as long as things like computational power and disk capacity of the proposed ODA solution is aligned with the outputs of sizing, and the requirements of the customer.

With its virtualized structure, X8-HA can run both database and application layers in clustered mode (active active or active passive). X8-2M &S can also host both database and applications. (in a non-clustered manner)

Production environments along with the test environments, can be hosted on the ODA machine.. In such an environment, Production environments can be isolated  from the  TEST/DEV/UAT environments (if desired).. 

As for lowering the costs, ODA X8-2M or S can be placed in the DR for hosting standby databases and standby application nodes.

Following is a quick info for giving you the benefits quickly;


ODA X8-2 HA and ODA X8-2 M/S


I am attaching the data sheets of the products. I briefly list the advantages of ODA below;

ODA X8-2 HA Data Sheet

ODA X8-2 S/M Data Sheet

I briefly list the advantages of ODA below;

  • Simple, Optimized, Affordable Database System with Built-in Automation (Capabilities and resources for hosting application servers as well.)
  • Integrated patching facility. (HW + SW)
  • Oracle Database and Application server Licensing with Pay As You Grow and Get Capacity On Demand approach
  • Cost-Effective Consolidation Platform for Databases and Applications
  • High performance and modern hardware
  • Easy installation and setup
  • Single point support.. (Oracle supports hardware, OS, DB and Apps tiers)
  • On-Premises Database and Application Platform aligned with the cloud (easy pathway for the Cloud) 
  • Simplified operations via the easy-to-use Appliance GUI
  • Stable, cost-free and  easy-to-manage virtualization (with Oracle Linux KVM)
  • Solutions for Database & Guest VM backup recovery

The virtualization solution used with the ODA X8-2 is Oracle Linux KVM. 
KVM is the virtualization used in Oracle Cloud Infrastructure as well. 
Oracle invests heavily in Linux and KVM areas. In addition to the Linux Guests, we can also run Windows Guest VMs on ODA/on KVM  -- if we desired to do so..

Of course, ODA shouldn't be thought as a general purpose, an enterprise level consolidation solution. 
It is not a replacement for VMware. But! in some cases, it can replace VMware-like environments.. Especially in smaller project based cases... 

For instance, we can consolidate an Oracle EBS platform as a whole on a virtualized ODA X8-2 HA.. 

EBS TEST, PROD, UAT, DEV database and apps tiers can be hosted on this platform isolated from each other.. 
But! Don't expect all the tools and capabilities that you have on Vmware-like environments to be available on ODA. 
Once again; our real purpose with ODA is not to replace big Vmware-like environments.. 
Our purpose is something different.. It is having a low cost, high tech, reliable and robust engineered system for meeting  the platform requirements of our mid-sized projects or our product based solutions..  Remember the EBS examples that I gave above...

Let's get to the main topic now.. The main reason why I wrote this blog post... It is the backup & recovery on ODA. 

Yes, we have RMAN, RSYNC and ACFS snapshot feature which can be used on ODA environments. 

RMAN (with or without all integrated 3rd party backup tools) can be used for DB backups. 
The filesystem agents of those 3rd party backup tools can also be used for backing up application filesystems and Oracle Homes if needed.

I don't see a need for giving details for RMAN, RSYNC and other agent-based backup solutions, as we all already know those things perfectly well.

Snapshot feature is a little interesting but it is not a big news for us, because it's been around for a long time already. 
Check following blog post, where I demonstrate ACFS snapshot-based database backup & recovery on ODA -> 


ACFS Snapshots can also be used for Virtual Machine (KVM Guest) backup & recovery on ODA.

Being able to use such a feature, I mean the ACFS snapshot feature for Virtual machine or Database backup & recovery is nice to have, but some customers (especially the ones using Hyper-V or Vmware) may want to be able to backup their Virtual Machines using a similar technique that they are used to.. 

I mean, they may want to use a Veeam-like way for backing up their virtual machines, rather than using a snapshot technology. In other words; they may want a real backup for their virtual machines.

This type of a requirement can give us a hard time but! luckily, we have KVMBR tool which can be used on ODA/KVM. (This one is the actual reason that made me write this blog..) 
So, we have an answer for the ones questioning the online VM guest backup capabilities of ODA!

KVMBR the the tool for those purposes.. I mean to to backup/restore KVM domains running from ACFS/LVM or a generic folder repository. 

We can execute our backups without downtime and with limited CPU/IO impact as the file operations are executed with nice/ionice.

KVMBR supports Guest VM repositories on Oracle ACFS, LVM and generic folders.




Please see the following MOS notes for more information on KVMBR and ACFS snapshot method for backing up KVM guest machines on ODA environments.

KVMBR - Tool to backup/restore KVM domains (Doc ID 2688239.1)

Backup of KVM guests on ODA 19.9 BM and later (Doc ID 2779329.1)

That's it for today :) See you in my next post..