Validating against a separate dataset

Some fields can be validated with reference to a known dataset. This includes unique identifiers, primary keys in database ETL, and categorical datasets.

In order to implement this, additional reference dataframe(s) need to be passed to FileProcessor.run() in the df_dict parameter and a rule of rule_type="Lookup" used.

The lookup rules have the following parameters: