RMVL: Mappable Vector Library for Handling Large Datasets

Mappable vector library provides convenient way to access large datasets on solid state drives. This bypasses limitation of physical memory size as well as limited bandwidth of database interfaces. Memory mapped data can be shared between multiple R processes. Access speed depends on storage medium, so solid state drive is recommended, preferably with PCI Express (or M.2 nvme) interface. The data is memory mapped into R and then accessed using usual R list and array subscription operators. The layout of underlying MVL files is optimized for large datasets. The vectors are stored to guarantee alignment for vector intrinsics after memory map. The package is built on top of libMVL, which can be used as standalone C library. libMVL has simple C API making it easy to interchange of datasets with outside programs.

Depends: R (≥ 3.5.0)
Published: 2021-08-15
Author: Vladimir Dergachev ORCID iD [aut, cre]
Maintainer: Vladimir Dergachev <support at altumrete.com>
License: LGPL-2.1
NeedsCompilation: yes
CRAN checks: RMVL results


Reference manual: RMVL.pdf
Package source: RMVL_0.0.2.1.tar.gz
Windows binaries: r-devel: RMVL_0.0.2.1.zip, r-devel-UCRT: RMVL_0.0.2.1.zip, r-release: RMVL_0.0.2.1.zip, r-oldrel: RMVL_0.0.2.1.zip
macOS binaries: r-release (arm64): RMVL_0.0.2.1.tgz, r-release (x86_64): RMVL_0.0.2.1.tgz, r-oldrel: RMVL_0.0.2.1.tgz
Old sources: RMVL archive


Please use the canonical form https://CRAN.R-project.org/package=RMVL to link to this page.