`cat2cat`

procedureThe introduced `cat2cat`

procedure was designed to offer
an easy and clear interface to apply a mapping (transition) table which
was provided by the data maintainer or built by a researcher. The
objective is to unify an inconsistent coded categorical variable in a
panel dataset, where a transition table is the core element of the
process.

Examples of datasets with such inconsistent coded categorical variable are ISCO (The International Standard Classification of Occupations) or ICD (International Classification of Diseases) based one. The both classifications are regularly updated to adjust to e.g. new science achievements. More clearly we might image that e.g. new science achievements brings new occupations types on the market or enable recognition of new diseases types.

The categorical variable encoding changes are typically provided by datasets providers in the mapping (transition) table form, for each time point the changes occurred. The mapping (transition) table is the core element of the procedure A mapping table conveys information needed for matching all categories between two periods of time. More precisely it contains two columns where the first column contains old categories and the second column contains the new ones. Sometimes a mapping (transition) table has to be created manually by a researcher.

The main rule is to replicate the observation if it could be assigned to a few categories. More precisely for each observation we look across a mapping (transition) table to check how the original category could be mapped to the opposite period one. Then using simple frequencies or statistical methods to approximate weights (probabilities) of being assigned to each of them. For each observation that was replicated, the probabilities have to add up to one. The algorithm distinguishes different mechanics for panel data with and without unique identifiers.

The `cat2cat::cat2cat`

function is the implementation of
the `cat2cat`

procedure. The `cat2cat::cat2cat`

function has three arguments `data`

, `mappings`

,
and `ml`

. Each of these arguments is of a `list`

type, wherein the `ml`

argument is optional. Arguments are
separated to identify the core elements of the `cat2cat`

procedure. Although this function seems complex initially, it is built
to offer a wide range of applications for complex tasks. The function
contains many validation checks to prevent incorrect usage. The function
has to be applied iteratively for each two neighboring periods of a
panel dataset. The `cat2cat::prune_c2c`

function could be
needed to limit growing number of replications.

There are 3 important elements:

- Mapping (Transition) table, possibly a few for longer panels. Typically provided by the data maintainers like a statistical office.
- Type of the data - panel dataset with unique identifiers vs panel dataset without unique identifiers and aggregate data vs non-aggragate data.
- Direction of a mapping process, forward or backward - a new or an old encoding as a base one.

`occup`

dataset is an example of unbalance panel dataset.
This is a simulated data although there are applied a real world
characteristics from national statistical office survey. The original
survey is anonymous and take place **every two years**.

`trans`

mapping (transition) table contains mappings
between old (2008) and new (2010) occupational codes. This table could
be used to map encodings in both directions.

There were prepared two graphs for forward and backward mapping.
These graphs present how the `cat2cat::cat2cat`

procedure
works, in this case under a panel dataset without the unique identifiers
and only two periods.