OBIEE 12C / Weblogic -- Authentication for user weblogic denied , The specified user failed to log in. javax.security.auth.login.FailedLoginException

This is about an OBIEE 12C issue that was escalated to me today. OBIEE admin was trying to implement a custom auth method for OBIEE, and due to that, she restarted the Weblogic Services of OBIEE multiple times.. Suddenly, Admin Server started to fail. It wasn't about weblogic username and password, it wasn't about boot.properties, it wasn't about any lock files or something like that.. But! it was about the corrupted weblogic user pass information in a file (under the ldap directory of the Admin Server) located under the OBIEE Weblogic domain.

After a lot of diagnostic work, and after lots of tries, the solution for us was the following;

*Backup & rename/move/remove the ldap directory located under the directory named "/home/erm/Oracle/Middleware/Oracle_Home/user_projects/domains/bi/servers/AdminServer/data/"

*set the domain env :
cd /home/erm/Oracle/Middleware/Oracle_Home/user_projects/domains/bi/bin
. ./setDomainEnv.sh

*change(actually rechange) the Weblogic user's password to have a fresh and proper record in the related files:
cd /home/gtech/Oracle/Middleware/Oracle_Home/user_projects/domains/bi/security
java weblogic.security.utils.AdminAccount weblogic weblogic123 .
--note that , "." needs to be there at the end.

*Recreate the boot.properties file

*Start the Weblogic Managed Server and that's it.

I shared the call stack, the error stack below for the record.. I mean if you feel like you are hitting the same issue, you can take a look at the following call stack and check whether the solution I have provided is suitable for you.

A MultiException has 6 exceptions.  They are:

weblogic.security.SecurityInitializationException: Authentication for user weblogic denied.
java.lang.IllegalStateException: Unable to perform operation: post construct on weblogic.security.SecurityService
java.lang.IllegalArgumentException: While attempting to resolve the dependencies of weblogic.jndi.internal.RemoteNamingService errors were found
java.lang.IllegalStateException: Unable to perform operation: resolve on weblogic.jndi.internal.RemoteNamingService
java.lang.IllegalArgumentException: While attempting to resolve the dependencies of weblogic.connector.common.ConnectorServiceActivator errors were found
java.lang.IllegalStateException: Unable to perform operation: resolve on weblogic.connector.common.ConnectorServiceActivator

at org.jvnet.hk2.internal.Collector.throwIfErrors(Collector.java:89)
at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:250)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:358)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:487)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:305)
Truncated. see log file for complete stacktrace
Caused By: weblogic.security.SecurityInitializationException: Authentication for user weblogic denied.
at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.doBootAuthorization(CommonSecurityServiceManagerDelegateImpl.java:1158)
at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.postInitialize(CommonSecurityServiceManagerDelegateImpl.java:1272)
at weblogic.security.service.SecurityServiceManager.postInitialize(SecurityServiceManager.java:586)
at weblogic.security.SecurityService.start(SecurityService.java:130)
at weblogic.server.AbstractServerService.postConstruct(AbstractServerService.java:76)
Truncated. see log file for complete stacktrace
Caused By: javax.security.auth.login.FailedLoginException: [Security:090938]Authentication failure: The specified user failed to log in. javax.security.auth.login.FailedLoginException: [Secu
rity:090302]Authentication Failed: User specified user denied
at com.bea.common.security.utils.ExceptionHandler.throwFailedLoginException(ExceptionHandler.java:62)
at weblogic.security.providers.authentication.LDAPAtnLoginModuleImpl.login(LDAPAtnLoginModuleImpl.java:380)
at com.bea.common.security.internal.service.LoginModuleWrapper$1.run(LoginModuleWrapper.java:117)
at java.security.AccessController.doPrivileged(Native Method)
at com.bea.common.security.internal.service.LoginModuleWrapper.login(LoginModuleWrapper.java:114)