Thursday, March 29, 2012

Oracle Enterprise Manager 12c Cloud Control: Plugin Deployment

Oracle Enterprise Manager 12c Cloud Control incorporates the use of plugins to extend its functionality for management of the complete cloud stack. Plugins are provided for databases, middleware, virtualization among others.

For a few weeks I had been struggling to deploy Oracle Enterprise Manager 12c agents on IBM AIX 6.1 targets. This became a very lengthy cycle of patching, searching and tweeting in an attempt to get things going. I finally had the agent deployed on the hosts but no targets were being discovered. After coming across MOS Note [ID 1388143.1] I discovered that I needed to update and deploy the database plugin in order to discover the database targets.

To deploy plugins go to Setup->Extensibility->Self Update

From this screen you can see a list of plugins and their status. If there is an updated plugin available it will have a non-zero revision number in the Revision column and the status will be available. The Oracle Database plugin update (20111221) above was downloaded by selecting download from the Actions drop-down menu. Under the Past Activities section you can see the different activities that were performed and the status. After the plugin has been downloaded it first needs to be deployed on the Management Server and then the Management Agents.
Click the Plug-in Icon to go to the plugin deployment screen.


In the Plug-ins screen you can see a list of plugins with the version available and downloaded. You may have to click on the icon beside the Databases folder to expand all database plugins. Clicking on the Oracle Database plugin will show the details in the bottom section of the screen. This displays the plugin versions downloaded, plugin ID, Vendor, version deployed on Management Server and Agents. Here you can see that three versions of the oracle.sysman.db plugin have been downloaded. Only the base version 12.1.0.1.0 has been deployed on Management Server and Agents. To deploy the latest downloaded version click on the Deploy On menu item then select Management Server.


I received the above error when I attempted to deploy the plugin. What? But the plugin was  already downloaded. At this point I was stuck again! After several futile attempts and twitter rants I created a SR for the issue. Surprisingly, Oracle Support was very responsive and proceeded with a series of calls and web conferences to try and help me resolve the issue. However, after many attempts and hours of phone support they were unable to find the cause of the error. We tried deleting and downloading the plugins again both in online and offline mode. Offline mode requires the use of emcli. At this time the recommendation was to apply Bundle Patch 1 for Enterprise Manager 12c or do a complete reinstall. Since this was a test system I was fairly comfortable with either approach. However, I decided to try to use emcli command to deploy the plugin to see if it made any difference.
The emcli command is installed by default in the OMS_HOME/bin directory. You first need to login using
emcli login -username=SYSMAN

After logging I issued the commands below:

-bash-3.2$ ./emcli deploy_plugin_on_server -plugin=oracle.sysman.db:12.1.0.1.0
Enter repository DB sys password:

Performing pre-requisites check... This will take a while.
Pre-requisites check succeeded
Deployment of plug-in on the management servers is in progress
Use "emcli get_plugin_deployment_status -plugin_id=oracle.sysman.db" to track plug-in deployment status.

 To check the status of the deployment I issued the following command:

-bash-3.2$ ./emcli get_plugin_deployment_status -plugin_id=oracle.sysman.db
Plugin Deployment/Undeployment Status

Destination          : OMS - lnxvmoidt02.smrcy.com:4890_Management_Service
Plugin Name          : Oracle Database
Version:             : 12.1.0.1.0
ID:                  : oracle.sysman.db
Content              : Plugin
Action               : Deployment
Status               : Deploying
Steps Info:
---------------------------------------- ------------------------- ------------------------- ----------
Step                                     Start Time                End Time                  Status
---------------------------------------- ------------------------- ------------------------- ----------
Start deployment                         3/27/12 11:06:56 AM CDT   3/27/12 11:06:56 AM CDT   Success

Initialize                               3/27/12 11:07:14 AM CDT   N/A                       Running

---------------------------------------- ------------------------- ------------------------- ----------

Here I could see some definite progress. Things looking good so far. Issue the same command after a few minutes to check the status.

-bash-3.2$ ./emcli get_plugin_deployment_status -plugin_id=oracle.sysman.db
Plugin Deployment/Undeployment Status

Destination          : OMS - lnxvmoidt02.smrcy.com:4890_Management_Service
Plugin Name          : Oracle Database
Version:             : 12.1.0.1.0
ID:                  : oracle.sysman.db
Content              : Plugin
Action               : Deployment
Status               : Success
Steps Info:
---------------------------------------- ------------------------- ------------------------- ----------
Step                                     Start Time                End Time                  Status
---------------------------------------- ------------------------- ------------------------- ----------
Start deployment                         3/27/12 11:06:56 AM CDT   3/27/12 11:06:56 AM CDT   Success

Initialize                               3/27/12 11:07:14 AM CDT   3/27/12 11:07:22 AM CDT   Success

Validate plug-in home                    3/27/12 11:07:24 AM CDT   3/27/12 11:07:24 AM CDT   Success

Check mandatory patches                  3/27/12 11:07:24 AM CDT   3/27/12 11:07:25 AM CDT   Success

Update inventory                         3/27/12 11:07:25 AM CDT   3/27/12 11:07:26 AM CDT   Success

---------------------------------------- ------------------------- ------------------------- ----------


Success! Now that's what I'm talking about. How do I check if the plugin is actually deployed on the server. Oh, there's a command for that too.

-bash-3.2$ ./emcli list_plugins_on_server
OMS name is EMGC_OMS1
Plug-in Name                                                                                        Version [revision]

Oracle MOS (My Oracle Support)                                                                      12.1.0.1.0
Oracle Fusion Middleware                                                                            12.1.0.1.0
Oracle Database                                                                                     12.1.0.1.0[20111221]
Oracle Exadata                                                                                      12.1.0.1.0


Here you can see the highlighted plugin with the latest update. You can also check from the Enterprise Manager console Setup-> Extensibility-> Self-Update


Here you can see the status of the updated plugin is Applied. Go to the Plug-ins section to verify the updated plugin has been deployed to the Management server.


The next step is to deploy the plugin to the targets. In my environment, I wanted to deploy plugin on to AIX targets consisting of Oracle 11gR2 Real Application Clusters databases.

Using emcli again to deploy the plugins on the management agents.

-bash-3.2$ ./emcli deploy_plugin_on_agent -plugin=oracle.sysman.db:12.1.0.1.0 -agent=oradba10t:3872
Agent side plug-in deployment is in progress
Use "emcli get_plugin_deployment_status -plugin_id=oracle.sysman.db" to track plug-in deployment status.
-bash-3.2$ ./emcli deploy_plugin_on_agent -plugin=oracle.sysman.db:12.1.0.1.0 -agent=oradba11t:3872
Agent side plug-in deployment is in progress
Use "emcli get_plugin_deployment_status -plugin_id=oracle.sysman.db" to track plug-in deployment status.

Note that both targets could have been deployed at the same time by separating them with a semicolon ";".
Check on the deployment status
-bash-3.2$ ./emcli get_plugin_deployment_status -plugin_id=oracle.sysman.db
Plugin Deployment/Undeployment Status

Destination          : AGENT - oradba11t:3872
Plugin Name          : Oracle Database
Version:             : 12.1.0.1.0
ID:                  : oracle.sysman.db
Content              : Plugin
Action               : Deployment
Status               : Success
Steps Info:
---------------------------------------- ------------------------- ------------------------- ----------
Step                                     Start Time                End Time                  Status
---------------------------------------- ------------------------- ------------------------- ----------
Start deployment                         3/27/12 11:18:41 AM CDT   3/27/12 11:18:41 AM CDT   Success

Initialize                               3/27/12 11:21:20 AM CDT   3/27/12 11:21:20 AM CDT   Success

Copy archives                            3/27/12 11:21:20 AM CDT   3/27/12 11:21:20 AM CDT   Success

Configure plug-in on management agent    3/27/12 11:21:20 AM CDT   3/27/12 11:23:56 AM CDT   Success

Update inventory                         3/27/12 11:21:20 AM CDT   3/27/12 11:23:56 AM CDT   Success

---------------------------------------- ------------------------- ------------------------- ----------

Destination          : AGENT - oradba11t:3872
Plugin Name          : Oracle Database
Version:             : 12.1.0.1.0
ID:                  : oracle.sysman.db
Content              : Discovery
Action               : Deployment
Status               : Success
Steps Info:
---------------------------------------- ------------------------- ------------------------- ----------
Step                                     Start Time                End Time                  Status
---------------------------------------- ------------------------- ------------------------- ----------
Start deployment                         3/27/12 11:18:41 AM CDT   3/27/12 11:18:41 AM CDT   Success

Initialize                               3/27/12 11:18:53 AM CDT   3/27/12 11:18:53 AM CDT   Success

Copy archives                            3/27/12 11:18:53 AM CDT   3/27/12 11:18:53 AM CDT   Success

Configure plug-in on management agent    3/27/12 11:18:53 AM CDT   3/27/12 11:21:20 AM CDT   Success

Update inventory                         3/27/12 11:18:53 AM CDT   3/27/12 11:21:20 AM CDT   Success

---------------------------------------- ------------------------- ------------------------- ----------



You can also verify the updated plugin has been deployed in Enterprise Manager console. 



Click the Recent Deployments tab in the details section to see a list of deployments to both the management server and agent.


To view a list of all plugins deployed on agents using emcli execute the following: 
(Output truncated for brevity)
-bash-3.2$ ./emcli list_plugins_on_agent
The Agent URL is https://oradba11t:3872/emd/main/ -
Plug-in Name                                                                                        Version

Oracle Database                                                                                     12.1.0.1.0[20111221]
Oracle Home                                                                                         12.1.0.1.0
Oracle Home                                                                                         12.1.0.1.0
Oracle Database                                                                                     12.1.0.1.0
Oracle Home                                                                                         12.1.0.1.0
Oracle Fusion Middleware                                                                            12.1.0.1.0
Oracle Beacon                                                                                       12.1.0.1.0
Management Services and Repository                                                                  12.1.0.1.0
Oracle Home                                                                                         12.1.0.1.0
Oracle Database                                                                                     12.1.0.1.0
Oracle Home                                                                                         12.1.0.1.0
Oracle Fusion Middleware                                                                            12.1.0.1.0
Oracle Database                                                                                     12.1.0.1.0
Oracle Fusion Middleware                                                                            12.1.0.1.0
Oracle Home                                                                                         12.1.0.1.0
Oracle Database                                                                                     12.1.0.1.0
Oracle Home                                                                                         12.1.0.1.0
Oracle Database                                                                                     12.1.0.1.0[20111221]
Oracle Home                                                                                         12.1.0.1.0
Oracle Database                                                                                     12.1.0.1.0[20111221]

After the updated plugins were deployed to the Management Server and Agents I was able to successfully discover all targets on AIX. This leads me to my next post on managing RAC 11gR2 with Enterprise Manager 12c. Stay tuned :) 



12 comments:

  1. Thanks Leighton, good post! I experienced an issue installing the Oracle Database Plug-in on an AIX 5.3 host where it said "OS not supported". After I applied the EM12c BP1, uninstalled the AIX 5.3 agent and downloaded the latest and greatest plug-ins my deployment succeeded and I'm able to monitor a DB on AIX 5.3. Unfortunately AIX doesn't get the support Linux/Solaris is getting right now.. so we have to take things a bit slower :(

    ReplyDelete
  2. Hi Richard,
    Glad you got it working. We received the same recommendation to reinstall or upgrade with BP1 from Oracle Support.

    Yes AIX is treated like a 'second class' OS where Oracle is concerned. Not as bad a HP-UX though ;)

    ReplyDelete
  3. Thanks Nelson,

    Very informative post. Definately helped me. I had one more question.
    So while doing a OEM12c install, it selects all the mandatory Plugins only. Let's say if I needed one of those optional plugins later. So can I download it as a saperate plugin from OTN and install ? OR will you see options from OEM 12c console to download the optional Plugin?

    Regards,
    Tom

    ReplyDelete
  4. Hi Tom,
    You download additional plugins using the Self-Update feature in OEM 12c Console. This can be done in either online or offline mode. In offline mode it will direct you to the appropriate 'patch' number to download via My Oracle Support. You then will have manual steps to stage and register the plugins before deploying it to the OMS and agents if appropriate. In online mode your OMS needs to be able to connect to MOS. You can choose the plugin to download via the Self-Update console and then deploy it from there.

    Hope this helps.

    ReplyDelete
  5. Thanks Nelson,

    Yes that worked in online mode !

    Regards,
    Tom

    ReplyDelete
  6. Hi,

    Can some one please help me with the OEM 12c agent patch number for Sun sparc 64bit and IBM AIX. As we donot have internet enabled on our OEM server and hence the download link is greyed out.

    Thank You
    TAI

    ReplyDelete
  7. To my question earlier have got a solution via Acquiring or Updating the Enterprise Manager Cloud Control 12.1.0.1 Management Agent Software Using the Self Update Feature [ID 1369575.1]

    Thanks
    TAI

    ReplyDelete
  8. If you got the following error while deploying with OMS 12c BP1:

    ERROR agentdeploy.AgentPluginDeploy deployPlugin.534 - ORA-20406: The following targets are invalid:
    ORA-06512: at "SYSMAN.EM_JOB_OPS", line 235
    ORA-06512: at "SYSMAN.GC_JOB", line 29
    ORA-06512: at line 1

    Is a bug! (with a patch on Metalink):
    BUG 13950434 - ERROR OCCURRED WHILE DEPLOYING AGENT PLUG-IN: ORA-20406 ORA-06512

    ReplyDelete
  9. Hi Richard,

    could you please give me advice how can I cancel plugin deployment? I tried to import plugin some days before (/oms/bin/emcli import_update -file=/tmp/12.1.0.1.1_vordel.gateway.mtrc_2000_0.opar -omslocal), but it stuck in status 'deploying'.

    -bash-3.2$ ./emcli get_plugin_deployment_status -plugin_id="vordel.gateway.mtrc"
    Plugin Deployment/Undeployment Status

    Destination : OMS - server.domain:4890_Management_Service
    Plugin Name : Gateway Metrics Plugin
    Version: : 12.1.0.1.2
    ID: : vordel.gateway.mtrc
    Content : Plugin
    Action : Deployment
    Status : Deploying
    Steps Info:
    ---------------------------------------- ------------------------- ------------------------- ----------
    Step Start Time End Time Status
    ---------------------------------------- ------------------------- ------------------------- ----------
    Start deployment 10/15/12 2:51:29 PM EEST 10/15/12 2:51:29 PM EEST Success

    ---------------------------------------- ------------------------- ------------------------- ----------

    ReplyDelete
  10. Hi Experts,

    I am installing Oracle Enterprise Manager 12c Cloud Control release on on OEL 5.7 64 bit
    as i run ./runInstaller getting following error please experts suggest me what me what i should
    i do, i have already spend so much time for installing but can not resolve the issue.


    e@cloud u02]$ ./runInstaller
    Starting Oracle Universal Installer...

    Checking Temp space: must be greater than 400 MB. Actual 18749 MB Passed
    Checking swap space: must be greater than 150 MB. Actual 12001 MB Passed
    Checking monitor: must be configured to display at least 256 colors. Actual 65536 Passed
    Preparing to launch Oracle Universal Installer from /tmp/OraInstall2013-09-14_11-49-06AM. Please wait ...[oracle@cloud u02]$



    ERROR: Unable to proceed with the installation. The following plug-ins are not present in the /u02//plugins directory of the Enterprise Manager software.
    oracle.sysman.emas
    oracle.sysman.db

    To resolve this issue, extract all the ZIP files of the Enterprise Manager software in one directory, and the invoke the installer again. If the issue persists, download the entire Enterprise Manager software again.

    ReplyDelete
  11. Hi,
    Which version of EM12c are you installing? Are you doing a fresh installation or an upgrade? Can you try downloading them again into a separate directory from http://www.oracle.com/technetwork/oem/grid-control/downloads/linuxx8664soft-085949.html and then unzipping them. There should be three zip files in total. Also double-check the cksum to make sure the files aren't corrupt.

    ReplyDelete
    Replies
    1. Hi,
      I am doing fresh installation and the version is 12c Release 2 (12.1.0.2) for 64 bit,
      the software is fine not corrupted
      please suggest.

      Delete

IOUG Collaborate 14

IOUG Collaborate 14
IOUG Collaborate 14 Las Vegas