introduction to enterprise manager (em) bda plug-in · in this course, we'll talk about the...

Hello and welcome to this online, self-paced course titled Administering and Managing the

Oracle Big Data Appliance (BDA). This course contains several lessons. This lesson is titled

Introduction to Enterprise Manager (EM) BDA Plug-in. My name is Lauran Serhal. I am a

curriculum developer at Oracle and I have helped educate customers on Oracle products

since 1995. I'll be guiding you through this course, which consists of lectures, demos, and

review sessions.

The goal of this lesson is to review Enterprise Manager BDA Plug-in at a high level.

Introduction to Oracle EM BDA Plug-in - 1

Introduction

Before we begin, take a look at some of the features of this course player. If you’ve viewed a

similar self-paced course in the past, feel free to skip this slide.

Menu

This is the Menu tab. It’s set up to automatically progress through the course in a linear

fashion, but you can also review the material in any order. Just click a slide title in the outline

to display its contents.

Notes

Click the Notes tab to view the audio transcript for each slide.

Search

Use the Search field to find specific information in the course.

Player Controls

Use these controls to pause, play, or move to the previous or next slide. Use the interactive

progress bar to fast forward or rewind the current slide. Some interactive slides in this course

may contain additional navigation and controls. The view for certain slides may change so

that you can see additional details.

Resources (Optional)

Click the Resources button to access any attachments associated with this course.

Glossary (Optional)

Click the Glossary button to view key terms and their definitions.


So, you know the title of the course, but you may be asking yourself, “Is this the right course

for me?” Click the bars to learn about the course objectives, target audience, and

prerequisites.


What can you expect to get out of this course? Here are the core learning objectives.

After completing this course, you should be able to define the Hadoop ecosystem and its

components including Hadoop’s Distributed File System (HDFS), MapReduce, Spark, YARN,

and some other related projects. You will also learn how to complete the BDA Site Checklists,

run the Oracle BDA Configuration Utility, and install the Oracle BDA Mammoth software on

the Oracle BDA. You also learn about how to secure data on the Oracle BDA, how to use the

Oracle Big Data Connectors, and how to administer the CDH cluster using Cloudera

Manager. Finally, you learn how to manage the Oracle BDA using the Oracle Enterprise

Manager BDA Plug-in.


Who is this course for? Here is the intended audience.

• Application Developers

• Database Administrators

• Hadoop/Big Data Cluster Administrators

• Hadoop Programmers


Before taking this course, you should have some exposure to Big Data, and optionally some

basic database knowledge.


In this course, we'll talk about the following lessons:

In the Introduction to the Hadoop Ecosystem lesson, you define the Hadoop ecosystem and describe the Hadoop core components and some of the related projects. You will also learn about the components of HDFS and review MapReduce, Spark, and YARN.

In the Introduction to the Oracle BDA lesson, you identify the Oracle Big Data Appliance (BDA) and its hardware and software components.

In the Oracle BDA Pre-Installation Steps lesson, you learn how to download and complete the BDA Site Checklists. You also learn how to download and run the Oracle BDA Configuration Utility and then review the generated configuration files.

In the Working With Mammoth lesson, you learn how to download the Oracle BDA Mammoth Software Deployment Bundle from My Oracle Support. You also learn how to install a CDH or NoSQL cluster based on your specifications. You then learn how to install the Oracle BDA Mammoth Software Deployment Bundle using the Mammoth utility.

In the Introduction to Cloudera Manager lesson, you learn how to administer your CDH cluster and setup YARN job scheduling using Cloudera Manager. You also learn how to use Cloudera Navigator to audit various activities.

In the Introduction to Enterprise Manager plugin lesson, you learn how to manage the BDA using a consistent management framework.

In the Securing the Oracle BDA lesson, you learn how to secure data on the Oracle Big Data Appliance.

In the Working With the Oracle Big Data Connectors lessons, you learn how to use Oracle SQL Connector for Hadoop Distributed File System, Oracle Loader for Hadoop, Oracle Data Integrator, Oracle XQuery for Hadoop, and Oracle R Advanced Analytics for Hadoop.


Now that you’ve learned about other lessons in this course, let’s take a look at Oracle Enterprise Manager BDA plug-in at a high level. Let's get started.

After completing this lesson, you should be able to use Oracle Enterprise Manager BDA plug-in to monitor both hardware and software performance, manage incidents, and review some other features.


Log-in to Enterprise Manager Cloud Control 13c using the appropriate URL. Enter the username and password, and then click Login.


The Welcome to Enterprise Manager Cloud Control 13c page is displayed. You can use this page to select your personal Enterprise Manager default Home page from one of the available options such as the Welcome page, Summary page, or the Incidents page. Your selected personal Home page will appear the next time you login to EM. You can also click any of the sample images for a larger preview, and then select a radio button to choose your personal Home page.

In this example, we selected the Welcome page as our default home page.


EM supports global menus that are accessible from wherever you are in the interface.

Let's start with the Enterprise Manager menu. This menu gives you access to the key functionalities within EM. [1]

The Targets menu allows you to look at your targets by types, groups, systems, and services. [2]

The Favorites menu is equivalent to bookmarks in a Web browser. You can mark an EM page as a favorite. The Welcome page is currently our home page. [3]

The History menu shows you the last 10 targets that you visited. [4]

Use the Setup Global menu to specify your preferences which dictate how you access various areas from EM such as target passwords, email addresses, and your home page. You can also add targets, manage your agents, and setup your security.


Next, let's move to the Help menu. This is where you access Oracle resources such as the online help, documentation library, user forums, and Oracle Technology Network (OTN).

From the SYSMAN menu, click Help, and then click the EM Help. This displays the EM Online Help.

Another interesting feature is the global search. Use this feature to search by target name. In this example, we searched for a BDA target named BDA Network 1.

EM is the management platform for Oracle products: Database, Middleware, Applications, and Oracle Big Data Appliance (BDA). To access the Oracle Big Data Appliance, select Targets > Big Data Appliance. The BDA Target displays the BDA Network list. A BDA Network includes all BDAs on the same InfiniBand Network. All of the available BDAs will be available on this BDA Network 1 network. In our example, we only have one BDA. Let's click the BDA Network 1 link.


The BDA Network 1 Home page is displayed. This page would include all of the BDAs that are on this infiniband network. This page contains the Hardware Overview and the Software Overview sections.


We will be accessing this page on a regular basis, so let's save it as a favorite for quicker access.

From the Favorites menu, select Add Page to Favorites. A confirmation message is displayed. Click the Favorites menu again. The BDA Network 1 (BDA Network) page is added as a favorite. From this point on, we can use the newly added favorite to quickly access this page.


The Software Overview across the available clusters is shown on this page. You can view the services that are running across the nodes on the BDA and their status.


You can collapse the Software Overview section to display the BDAs on this network. In our example, this network has only one BDA. If the network had multiple BDAs, they would be displayed here.

The Hardware Schematic section provides you with a quick view of the status of each hardware component on the BDA.

You can view the Hardware Schematic using different views. This gives you a quick view of the status of all HW components using a Schematic (shown here), Photo-Realistic, or Table view.


In this example, the Photo-Realistic view is selected. You can see the nodes at the bottom of this BDA - and the photo represents the actual position of the servers. The details of one node is shown on this page.


In the first screen capture on this page, the Table view is selected. The table displays the slot number for each component, the component name, the component type, status, and temperature. The four servers on the BDA are highlighted. The last three columns in the table represent critical incidents, warning incidents, and fatal incidents for each listed component. For example, the IB switch has 1 critical and one fatal incidents. The switch is down.

In the second screen capture on this page, the show Empty Slot check box is used to show the available empty slots on the BDA. We will select this box.


The example on this page displays a Photo-Realistic view of a Full Rack BDA that contains 18 nodes.


1. Click the Target Navigation icon to display the Target Navigation pane for BDA Network 1.

2. You can drill-down on the BDA Network 1 using the drill icon, or you can select an option from the View drop-down list.

3. Let's drill-down on BDA Network 1. The BDA rack named scaj51 and the Hadoop cluster named scajg are displayed.


If we drill-down on the scaj51 BDA, the components of the BDA are displayed. If we drill-down on the scajg Hadoop cluster, the services that are running on this cluster are displayed such as flume, Hbase, HDFS, Hive, Hue, Impala, Solr, Spark, YARN, and more.

You may have multiple clusters on a single rack, or a single cluster may span multiple racks. Let's look at how EM monitors the services.


We’ll take a look at HDFS - but similar functionality is provided across services. Drilling down on HDFS reveals its various components: NameNodes, DataNodes, JournalNodes, and so on.

Let's look at the hdfs_scajg HDFS service which is running on the scajg Hadoop cluster. If we drill-down on the hdfs_scajg HDFS service, the various roles running on this service are displayed.


The HDFS Home page displays key metrics and information about the HDFS roles.

At the bottom of every target, you will find an Incidents section which is specific to the selected item such as the HDFS service in this example.

We’re looking at HDFS here; however, the same information is provided for other Hadoop services such as YARN, hue, Hive, and so on.


In the first screen capture on this page, we are using the Type drop-down list to filter the HDFS nodes to display only the DataNodes.

In the second screen capture, we selected the first DataNode which is currently running. We can then use the Stop icon to stop this service, or the Restart icon to stop the service and then start it. If a service is stopped, we can click the Start icon to start it. The start, stop, or restart functionality is provided across Hadoop services such as YARN, hue, Hive, and so on.


To view more metrics about the currently selected Hadoop HDFS service, navigate to Monitoring > All Metrics.


There are hundreds of metrics available across services. In this example, we are looking at the Data Node Average Alert Rate metric under HDFS Alert Metrics. The cluster is idle in this example.


Use the Modify Thresholds window to create your own alert thresholds for the metrics based on your organizations SLAs.


To monitor incidents, navigate to Monitoring > Incident Manager. The BDA plugs into EM's integrated incident management framework. BDA incidents will be handled like any other incidents in EM.


There are several incidents in this example. This is where incidents are managed to resolution. You can filter the list using the links on the left.


Let's look at our BDA. In this example, we re-displayed the Target Navigation, and then double-clicked the scaj51 BDA.

There are a couple of Fatal open incidents, and 12 open Critical incidents. Let's look at the two Fatal incidents.

Let's click the number 2 to view the two Fatal incidents. The Open Incidents page is displayed.

You can view the two incidents in-place, or you can click on the link for an incident. Let's click the first incident. The details window is shown on the next page.


The Incident Details window for the first incident that we clicked on the previous page is shown here. This page contains the following tabs: General, Events, Notifications, My Oracle Support Knowledge, All Updates, and Related Events.


You can review the details for any of the BDA servers. For example, you can view the physical attributes of server 4 on the BDA using the buttons that are highlighted on the right-hand side of this page. The Hardware View icon is selected by default. This shows the front, top, and rear of the selected server.


Click the Logical View icon to display the details on the CPU, memory, power, fan, storage, disk controller, and network ports.


Click the Energy View icon to display the server's temperature, fan speed, power consumption, and utilization.


Click the Network Connectivity icon to display the server's interfaces, data links, and ports.


Click the Service Processor Configuration icon to display the details on the firmware information, host policy configuration, SP alert configuration, and DNS and NTP information.


You can also click a host's link in the Target Navigation pane to display its details as shown on this page. The Summary details page for the selected host is displayed.


You can scroll down the Summary page to review the CPU, memory, disk, and network utilization metrics.


In addition to viewing the server's summary as shown on the last two pages, you can use the highlighted icons to view additional details on the utilization metrics.


Click the CPU icon to view the CPU details such as CPU Utilization, System Load, and CPU Threads Utilization.

Click the Host Memory icon to view memory details such as Memory Utilization, Virtual Memory, and Page Details.


Click the Storage icon to view the host details such as Disks, Filesystems, Linux LVM Volume Group(s), and SAN Configuration.

Click the Network Connectivity icon to view the host Interfaces and Data Links.


Click the Host Processes icon to view the running processes and their CPU and physical and virtual memory utilization and status.

Click the Host Services icon to view the host's stopped and running services.


In this course, we discussed the following lessons:

• Introduction to the Hadoop Ecosystem

• Introduction to the Oracle BDA

• Oracle BDA Pre-Installation Steps

• Working With Mammoth

• Introduction to Cloudera Manager (CM)

• Introduction to Oracle Enterprise Manager BDA plug-in

• Securing the Oracle BDA

• Working With the Oracle Big Data Connectors:

- Oracle SQL Connector for Hadoop Distributed File System (HDFS)

- Oracle Loader for Hadoop (OLH)

- Oracle Data Integrator (ODI)

- Oracle XQuery for Hadoop (OXH)

- Oracle R Advanced Analytics for Hadoop (ORAAH)


The Oracle Learning Library (OLL) offers other self-paced courses about the Oracle Big Data

Appliance and other related topics. Visit the Oracle Learning Library to learn about the

courses.


Oracle University offers In-Class courses about Oracle Big Data and other related topics.

Visit Oracle University to learn about the following courses:

• Oracle Big Data Fundamentals

• Oracle NoSQL Database for Developers

• Oracle NoSQL Database for Administrators

• Oracle R Enterprise Essentials


The Oracle Enterprise Manager Cloud Control Online Documentation Library Release 13.1

and the Oracle Big Data Appliance documentation and online help embedded within the

products are also valuable resources.


The Oracle Technology Network offers white papers and videos about Big Data, Oracle Big

Data Appliance, Oracle Big Data Discovery, Oracle Big Data Spatial and Graph, Oracle

Advanced Analytics, Oracle Data Mining, and Oracle R Enterprise.


introduction to enterprise manager (em) bda plug-in · in this course, we'll talk about the...

Documents