The renv package helps you create reproducible environments for your R projects. This vignette introduces you to the basic nouns and verbs of renv, like the user and project libraries, and key functions like renv::init()
, renv::snapshot()
and renv::restore()
. You’ll also learn about some of the infrastructure that makes renv tick, some problems that renv doesn’t help with, and how to uninstall it if you no longer want to use it.
We assume you’re already living a project-centric lifestyle and are familiar with a version control system, like Git and GitHub: we believe these are table stakes for reproducible data science. If you’re not already using projects, we recommend Workflow: Projects from R for Data Science; if you’re unfamiliar with Git and GitHub, we recommend Happy Git and GitHub for the useR.
Before we get into how renv works, you’ll learn to fully understand two important pieces of R jargon: libraries and repositories.
A library is a directory containing installed packages. This term is confusing because you write (e.g.) library(dplyr)
, making it easy to think that you’re loading the dplyr library, not the dplyr package. That confusion doesn’t usually matter because you don’t have to think about libraries, simply installing all packages into a system library1 that’s shared across all projects. With renv, you’ll start using project libraries, giving each project its own independent collection of packages.
You can see your current libraries with .libPaths()
and see which packages are available in each library with lapply(.libPaths(), list.files)
.
A repository is a source of packages; install.packages()
gets a package from a repository (usually somewhere on the Internet) and puts it in a library (a directory on your computer). The most important repository is CRAN; you can install packages from CRAN in just about every R session. Other freely available repositories include Bioconductor, the Posit Public Package Manager, and R Universe (which turns GitHub organisations into repositories).
You can see which repositories are currently set up in your session with getOption("repos")
; when you call install.packages("{pkgname}")
, R will look for pkgname
in each repository in turn.
To convert a project to use renv, call renv::init()
. It adds three new files and directories to your project:
renv/library
, is a library that contains all packages currently used by your project2. This is the key magic that makes renv work: instead of having one library containing the packages used in every project, renv gives you a separate library for each project. This gives you the benefits of isolation: different projects can use different versions of packages, and installing, updating, or removing packages in one project doesn’t affect any other project.renv.lock
, records enough metadata about every package that it can be re-installed on a new machine. We’ll come back to the lockfile shortly when we talk about renv::snapshot()
and renv::restore()
..Rprofile
. This file is run automatically every time you start R (in that project), and renv uses it to configure your R session to use the project library. This ensures that once you turn on renv for a project, it stays on, until you deliberately turn it off.The next important pair of tools is renv::snapshot()
and renv::restore()
. snapshot()
updates the lockfile with metadata about the currently-used packages in the project library. This is useful because you can then share the lockfile and other people or other computers can easily reproduce your current environment by running restore()
, which uses the metadata from the lockfile to install exactly the same version of every package. This pair of functions gives you the benefits of reproducibility and portability: you are now tracking exactly which package versions you have installed so you can recreate them on other machines.
Now that you’ve got the high-level lay of the land, we’ll show a couple of specific workflows before discussing some of the reproducibility challenges that renv doesn’t currently help with.
One of the reasons to use renv is to make it easier to share your code in such a way that everyone gets exactly the same package versions as you. As above, you’ll start by calling renv::init()
. You’ll then need to commit renv.lock
, .Rprofile
, renv/settings.json
and renv/activate.R
to version control, ensuring that others can recreate your project environment. If you’re using git, this is particularly simple because renv will create a .gitignore
for you, and you can just commit all suggested files3.
Now when one of your collaborators opens this project, renv will automatically bootstrap itself, downloading and installing the appropriate version of renv. It will also ask them if they want to download and install all the packages it needs by running renv::restore()
.
Over time, your project will need more packages. One of the philosophies of renv is that your existing package management workflows should continue to work, so you can continue to use familiar tools like install.packages()
4. But you can also use renv::install()
: it’s a little less typing and can install packages from GitHub, Bioconductor, and more, not just CRAN.
If you use renv for multiple projects, you’ll have multiple libraries, meaning that you’ll often need to install the same package in multiple places. It would be annoying if you had to download (or worse, compile) the package repeatedly, so renv uses a package cache. That means you only ever have to download and install a package once, and for each subsequent install, renv will just add a link from the project library to the global cache. You can learn more about the cache in vignette("package-install")
.
After installing the package and checking that your code works, you should call renv::snapshot()
to record the latest package versions in your lockfile. If you’re collaborating with others, you’ll need to commit those changes to git, and let them know that you’ve updated the lockfile and they should call renv::restore()
when they’re next working on a project.
It’s worth noting that there’s a small risk associated with isolation: while your code will never break due to a change in another package, it will also never benefit from bug fixes. So for packages under active development, we recommend that you regularly (at least once a year) use renv::update()
5 to get the latest versions of all dependencies. Similarly, if you’re making major changes to a project that you haven’t worked on for a while, it’s often a good idea to start with an renv::update()
before making any changes to the code.
After calling renv::update()
, you should run the code in your project and verify that it still works (or make any changes needed to get it working). Then call renv::snapshot()
to record the new versions in the lockfile. If you get stuck, and can’t get the project to work with the new versions, you can call renv::restore()
to roll back changes to the project library and revert to the known good state recorded in your lockfile. If you need to roll back to an even older version, take a look at renv::history()
and renv::revert()
.
renv::update()
will also update renv itself, ensuring that you get all the latest features. See renv::upgrade()
if you ever want to upgrade just renv, or you need to install a development version from GitHub.
Now that you’ve got the basic usage of renv under your belt, it’s time to learn a bit more about how the lockfile works. You won’t typically edit this file directly, but you’ll see it changing in your git commits, so it’s good to have a sense for what it looks like.
The lockfile is always called renv.lock
and is a json file that records all the information needed to recreate your project in the future. Here’s an example lockfile, with the markdown package installed from CRAN and the mime package installed from GitHub:
{
"R": {
"Version": "4.1.2",
"Repositories": [
{
"Name": "CRAN",
"URL": "https://cloud.r-project.org"
}
]
},
"Packages": {
"markdown": {
"Package": "markdown",
"Version": "1.0",
"Source": "Repository",
"Repository": "CRAN",
"Hash": "4584a57f565dd7987d59dda3a02cfb41"
},
"mime": {
"Package": "mime",
"Version": "0.12.1",
"Source": "GitHub",
"RemoteType": "github",
"RemoteHost": "api.github.com",
"RemoteUsername": "yihui",
"RemoteRepo": "mime",
"RemoteRef": "main",
"RemoteSha": "1763e0dcb72fb58d97bab97bb834fc71f1e012bc",
"Requirements": [
"tools"
],
"Hash": "c2772b6269924dad6784aaa1d99dbb86"
}
}
}
As you can see the json file has two main components: R
and Packages
. The R
component contains the version of R used, and a list of repositories where packages were installed from. The Packages
contains one record for each package used by the project, including all the details needed to re-install that exact version. The fields written into each package record are derived from the installed package’s DESCRIPTION
file, and include the data required to recreate installation, regardless of whether the package was installed from CRAN, Bioconductor, GitHub, Gitlab, Bitbucket, or elsewhere. You can learn more about the sources renv supports in vignette("package-sources")
.
It is important to emphasize that renv is not a panacea for reproducibility. Rather, it is a tool that can help make projects reproducible by helping with one part of the overall problem: R packages. There are a number of other pieces that renv doesn’t currently provide much help with:
vignette("docker", package = "renv")
for recommendations on how Docker can be used together with renv.You also need to be aware that package installation may fail if a package was originally installed through a binary, but that binary is no longer available. renv will attempt to install the package from source, but this can (and often will) fail due to missing system prerequisites.
Ultimately, making a project reproducible will always require thought, not just mechanical usage of a tool: what does it mean for a particular project to be reproducible, and how can you use tools to meet that particular goal of reproducibility?
If you find renv isn’t the right fit for your project, deactivating and uninstalling it is easy.
To deactivate renv in a project, use renv::deactivate()
. This removes the renv auto-loader from the project .Rprofile
, but doesn’t touch any other renv files used in the project. If you’d like to later re-activate renv, you can do so with renv::activate()
.
To completely remove renv from a project, call renv::deactivate(clean = TRUE)
. If you later want to use renv for this project, you’ll need to start from scratch with renv::init().
If you want to stop using renv for all your projects, you’ll also want to remove renv'
s global infrastructure with the following R code6:
renv::paths$root()
root <-unlink(root, recursive = TRUE)
You can then uninstall the renv package with utils::remove.packages("renv")
.
More precisely, there can be up to three system libraries: an (optional) user library, an (optional) site library, and a default library (where base R packages are installed).↩︎
If you’d like to skip dependency discovery, you can call renv::init(bare = TRUE)
to initialize a project with an empty project library.↩︎
If you’re using another version control system, you’ll need to manually ignore renv/library
and any other directories in renv/
.↩︎
Behind the scene, renv shims install.packages()
, update.packages(),
and remove.packages()
to call the renv equivalents. Learn more in ?renv::load.
↩︎
You can also use update.packages()
, but renv::update()
works with the same sources that renv::install()
supports.↩︎
If you’ve customized any of renv’s infrastructure paths as described in ?renv::paths
, then you’ll need to find and remove those customized folders as well.↩︎