To cite package markovchain in publications use:

Discrete Time Markov Chains with R

Corresponding BibTeX entry:

  @Article{,
    title = {Discrete Time Markov Chains with R},
    author = {Giorgio Alfredo Spedicato},
    month = {07},
    year = {2017},
    journal = {The R Journal},
    url =
      {https://journal.r-project.org/archive/2017/RJ-2017-036/index.html},
    note = {R package version 0.6.9.7},
  }