Parallel R

£13.50

Parallel R

Data Analysis in the Distributed World

Mathematical and statistical software Computer programming / software engineering Programming and scripting languages: general Systems analysis and design

Authors: Q. Ethan McCallum, Stephen Weston

Dinosaur mascot

Language: English

Published by: O'Reilly Media

Published on: 21st October 2011

Format: LCP-protected ePub

Size: 864 Kb

ISBN: 9781449320331


It’s tough to argue with R as a high-quality, cross-platform, open source statistical software product—unless you’re in the business of crunching Big Data. This concise book introduces you to several strategies for using R to analyze large datasets, including three chapters on using R and Hadoop together. You’ll learn the basics of Snow, Multicore, Parallel, Segue, RHIPE, and Hadoop Streaming, including how to find them, how to use them, when they work well, and when they don’t.

With these packages, you can overcome R’s single-threaded nature by spreading work across multiple CPUs, or offloading work to multiple machines to address R’s memory barrier.

Key Packages

  • Snow: works well in a traditional cluster environment
  • Multicore: popular for multiprocessor and multicore computers
  • Parallel: part of the upcoming R 2.14.0 release
  • R+Hadoop: provides low-level access to a popular form of cluster computing
  • RHIPE: uses Hadoop’s power with R’s language and interactive shell
  • Segue: lets you use Elastic MapReduce as a backend for lapply-style operations

Show moreShow less