Oracle NoSQL Database: Real-Time Big Data Management for the Enterprise

by Aalok Muley, Ashok Joshi, Maqsood Alam, Chaitanya Kadaru

Overview

Publisher's Note: Products purchased from Third Party sellers are not guaranteed by the publisher for quality, authenticity, or access to any online entitlements included with the product.

Master Oracle NoSQL Database

Enable highly reliable, scalable, and available data. Oracle NoSQL Database: Real-Time Big Data Management for the Enterprise shows you how to take fulladvantage of this cost-effective solution for storing, retrieving, and updating high-volume, unstructured data. The book covers installation, configuration, application development, capacity planning and sizing, and integration with other enterprise data center products. Real-world examples illustrate the concepts presented in this Oracle Press guide.

• Understand Oracle NoSQL Database architecture and the underlying data storage engine, Oracle Berkeley DB
• Install and configure Oracle NoSQL Database for optimal performance
• Develop complex, distributed applications using a rich set of APIs
• Read and write data into the Oracle NoSQL Database key-value store
• Apply an Avro schema to the value portion of the key-value pair using Avro bindings
• Learn best practices for capacity planning and sizing an enterpriselevel Oracle NoSQL Database deployment
• Integrate Oracle NoSQL Database with Oracle Database, Oracle Event Processing, and Hadoop

Code examples from the book are available for download at www.OraclePressBooks.com.

Product Details

ISBN-13:	9780071816533
Publisher:	McGraw Hill LLC
Publication date:	12/27/2013
Edition description:	List
Pages:	256
Product dimensions:	7.30(w) x 9.00(h) x 0.60(d)

About the Author

Maqsood Alam, OCP, is currently a Senior Manager, Product Development at Oracle where he is focused on evangelizing Oracle’s products in the Big Data space with Oracle partners and customers. He is the coauthor of Achieving Extreme Performance with Oracle Exadata.

Aalok Muley is the Director, Platform Products at Oracle where he focuses on driving adoption of Oracle Engineered Systems. He is also currently leading the effort to an Oracle Big Data ecosystem with complementary technologies, solutions and services from Oracle's partners.

Chaitanya Kadaru is Principal Technologist of Product Development at Oracle where he focuses on evangelizing Oracle Engineered Systems like Oracle Exalogic, Oracle Exadata, and the Big Data appliance.

Ashok Joshi has been working in the database industry for 25 years. He is currently the senior director of development for Oracle NoSQL Database, Berkeley DB, and Database Mobile Server products at Oracle.

Chaitanya Kadaru is accomplished software professional with over 12 years of industry experience. He spent the majority of his time with Oracle working in databases, middleware and oracle applications in various roles of developer, evangelist, pre-sales, consulting and training. He recently co-founded Extuit LLC, a premier oracle consulting company and has architected solutions involving engineered systems like Exadata, Exalogic and Bigdata for a wide range of customers. He is currently responsible for a large scale oracle DB consolidation to Exadata for a large financial services company. Chaitanya Kadaru holds a Bachelor’s degree in Engineering from BITS, Pilani and a Master’s degree in Information Systems from Carnegie Mellon University.

Ashok Joshi is the senior director of development for the Oracle NoSQL Database, Berkeley DB and Database Mobile Server. Ashok has been involved in database systems technology for over two decades in an individual contributor role as well as a management role. Ashok has made extensive contributions to indexing, concurrency control, buffer management, logging and recovery and performance optimizations in a variety of products including Oracle Rdb, Oracle Database and Sybase SQL Server. He is the author or co-author of several papers as well as 12 patents on database technology. Ashok graduated from the Indian Institutes of Technology, Bombay with a bachelor’s degree in Electrical Engineering and a Master’s degree in Computer Sciences from the University of Wisconsin, Madison.

Aalok Muley is a Senior Director for Database Server Technologies at Oracle. He is responsible for driving adoption of Oracle's family of database products- Oracle NoSQL Database, Oracle Big Data Connectors, Oracle Database 12c and engineered systems such as Oracle Big Data Appliance and Oracle Exadata.Aalok has over 19 years of experience; he has lead teams on database industry standard benchmarks, database development and Fusion Middleware technologies. Aalok Muley has participated on the technology integration of many Oracle acquisitions. As part of the product development organization, he is currently focused on working closely with partners and customers to design high-throughput, highly-available enterprise-grade solutions. Aalok holds a Master’s degree in Computer Engineering from Worcester Polytechnical Institute, MA.

Table of Contents

Foreword xv

Acknowledgments xvii

Introduction xix

1 Overview of Oracle NoSQL Database and Big Data 1

Introduction to NoSQL Systems 2

Brief Historical Perspective 3

Big Data and NoSQL: Characteristics and Architectural Trade-Offs 5

Types of Big Data Processing 6

NoSQL Database vs. Relational Database 7

Types of NoSQL Databases 8

Key-Value Stores 8

Document Stores 9

Graph Stores 9

Column Stores 9

Big Data Use Cases 10

Oracle's Approach to Big Data 12

Acquire 13

Organize 14

Analyze 15

Oracle Engineered Systems for Big Data 17

Summary 21

2 Introducing Oracle NoSQL Database 23

Oracle Berkeley DB 24

Oracle NoSQL Database 27

Database System Architectures 29

Partitioning and Sharding 31

Availability 33

Eventual Consistency 35

Durability-Making Changes Permanent 36

Transactions 38

Data Modeling 39

Performance 41

Administration 41

Integration with Other Products 42

Licensing 43

Summary 43

3 Oracle NoSQL Database Architecture 45

High-Level Architecture and Terminology 46

Intelligent Client Driver 47

Shards, Storage, and Network Topology 50

Hashing, Partitions, Data Distribution 53

Changing the Number of Shards 55

Changing the Replication Factor 59

Considerations for Multiple Datacenters 60

Storing Records and the Flexible Data Model 63

Log-Structured Storage 67

Durability 69

ACID Transactions and Distributed Transactions 72

Summary 74

4 Oracle NoSQL Database Installation and Configuration 75

Oracle NoSQL Database Installation 76

Download Oracle NoSQL Database Software 78

Software Installation 78

Oracle NoSQL Database Administration Service 80

Create the Boot Configuration 82

Perform Sanity Checks 87

Oracle NoSQL Database Configuration 87

Plans 88

Configuration Steps 89

Automating the Configuration Steps 95

Verifying the Deployment 96

Summary 99

5 Getting Started with Oracle NoSQL Database Development 101

Developing on KVLite 102

A Basic Hello World Program 105

How to Model Your Key Space 108

The Basics of Reading and Writing a Single Key-Value Pair 111

Consistency and Durability from the Programmer's Perspective 112

Durability 113

Consistency 115

Summary 118

6 Reading and Writing Data 119

Development Environment Setup 120

Writing Records 121

Basic API Functionality 122

How to Specify Durability in Write API Calls 125

Reading Records 131

Read One Record or Multiple Records in Many Ways 132

Introduction to API for Enforcing Read Consistency 139

Exception Handling for Read Operations 147

Deleting Records 147

Updating Records Based on a Version 150

Summary 152

7 Advanced Programming Concepts: Avro Schemas and Bindings 153

Avro Schema 154

Schema Evolution 158

Managing Avro Schemas 162

Avro Bindings 165

Specific Bindings 167

Generic Bindings 174

JSON Bindings 181

Summary 184

8 Capacity Planning and Sizing 185

Gather Sizing Requirements 186

Application Characteristics 187

Hardware Specifications 192

Capacity Planning and Sizing 193

Size a Representative Shard 194

Determine the Total Number of Shards and Partitions 203

Summary 205

9 Advanced Topics 207

Hadoop Integration 208

RDF Graph 211

Integration with Complex Event Processing 213

Database External Tables 215

Define an External Table 217

Edit the Configuration File 218

Publish the Configuration 218

Test the nosql_stream Script 218

Use the External Table to Read Data from Oracle NoSQL Database 219

Summary 219

Index 221