R Packages

Programming with Big Data in R (pbdR)

I am currently the co-lead developer of the pbdR ecosystem of packages. These are a collection of utilities and services for leveraging R in HPC environments. For more information, see the main project website http://r-pbd.org/

System Hardware Info for R and Analytics (SHINRA)

SHINRA is a set of tools for benchmarkers working with R. For more information about SHINRA, see https://shinra-dev.github.io/

Analysis Packages

Package Description Download
coop Fast, efficient implementations of the “co-operations” (covariance, correlation, cosine similarity). ghbutton
pcapack An experimental package for computing principal components and related statistical quantities in a high performance manner. ghbutton
linmod An experimental rewrite of R’s lm.fit() and glm.fit() functions. Like R’s implementation, it uses the “limited pivoting” strategy in a rank-revealing QR; unlike R, we use level 3 BLAS (and generally better memory management) when we can. ghbutton
yalda “Yet Another LDA” package. Wraps the serial portion of the Google plda program for use with R. ghbutton


Package Description Download
dequer A package offering a custom data structure for R. A deque is like a list, but with very cheap insertions (since R lists are contiguous arrays of pointers). ghbutton
lineSampler Samples a file by line; quickly read a subsample of observations from a large flat text file (e.g., a csv). Useful for downsampling; not suitable for resampling. ghbutton
RNACI A collection of utilities that make dealing with R’s native C interface more manageable. Notably the package handles simplified SEXP allocation (with automatic gc counting), and the creation and management of lists and dataframes. For instance, by making use of C99’s va_args, we can create arbitrary lists of named objects in just 2 simple function calls. ghbutton
Rth Multicore programming in R through the thrust template library. Compiles to an OpenMP, Intel Thread Buildingblocks, or CUDA backend. ghbutton
rexpokit A set of bindings and utility functions for computing matrix exponentials via the Fortran 77 package EXPOKIT. ghbutton

Just for Fun

Package Description Download
Rdym A “did you mean?” tool for R to help catch spelling mistakes in an interactive R session. ghbutton
Rfiglet R bindings for figlet; creates ascii logos. ghbutton
xkcdpw A package for making portmanteau-style passwords, as in this famous XKCD comic. Words are taken from scrapings of random Wikipedia pages. ghbutton
tfca Some methods for computing transfinite cardinal arithmetic. ghbutton
idgaf All public GitHub commits containing the “F-word” in the commit message, from 3/11/2012 to 7/24/2014. (warning: profanity) ghbutton

## Libraries

Package Description Download
libexpm High-performance C library for computing the matrix exponential of a dense matrix. ghbutton
meminfo A fully cross-platform C library for accessing basic hardware information, such as total RAM, free RAM, total swap, etc. Additionally, can get cache sizes and cache line sizes. Supports Linux, Windows, Mac OS X, and FreeBSD. Used by the R package “memuse” from the SHINRA project. ghbutton
ngram A C library for reading, processing, and “babbling” n-gram models. Used in the R package “ngram”. ghbutton

## Webapps

Large Projects

Package Description Download
TAG The Text Analytics Gateway (TAG) is an interactive webapp for performing simple analyses on unstructured text. It includes tools for importing data, preprocessing, and modeling. ghbutton
gmhelper A collection of utilities for game masters of fantasy-based role playing games, with a GUI and everything! ghbutton

Micro Projects

Package Description Download
hackR An interactive interface to the hackR package. Now you can hack the gibson without needing to learn R! ghbutton
ngram An interactive interface to the ngram package. Ever wanted to make your very own wacky sentences using markov chains? Now you can! ghbutton
RTop500 A visual summary of the performance over time (by various metrics) of the top 500 supercomputers since 1993. Written with R and shiny. Source is available in the RTop500 package. ghbutton
Figlet as a Service A demo of the Rfiglet package. Written with R and shiny. Source is available in the Rfiglet package. ghbutton