Reference data
Reference data is data used to classify or categorize other data.[1] Typically, they are static or slowly changing over time.
Examples of reference data include:
- Units of measurement
- Country codes
- Corporate codes
- Fixed conversion rates e.g., weight, temperature, and length
- Calendar structure and constraints
Reference data sets are sometimes alternatively referred to as a "controlled vocabulary"[2] or "lookup" data.[3]
Reference data should be distinguished from master data. While both provide context for business transactions, reference data is concerned with classification and categorisation, while master data is concerned with business entities.[4] A further difference between reference data and master data is that a change to the reference data values may require an associated change in business process to support the change, while a change in master data will always be managed as part of existing business processes. For example, adding a new customer or sales product is part of the standard business process. However, adding a new product classification (e.g. "restricted sales item") or a new customer type (e.g. "gold level customer") will result in a modification to the business processes to manage those items.
Externally-defined reference data
For most organisations, most or all reference data is defined and managed within that organisation. Some reference data, however, may be externally defined and managed, for example by standards organizations.[5] An example of externally-defined reference data is the set of country codes as defined in ISO 3166-1.[6][7]
Reference data management
Curating and managing reference data is key to ensuring its quality and thus fitness for purpose. All aspects of an organisation, operational and analytical, are greatly dependent on the quality of an organization's reference data. Without consistency across business process or applications, for example, similar things may be described in quite different ways. Reference data gain in value when they are widely re-used and widely referenced.
Examples of good practice in reference data management include:
- Formalize the reference data management
- Use external reference data as much as possible
- Govern the reference data specific to your enterprise
- Manage reference data at enterprise level
- Version control your reference data[8]
References
- DAMA-DMBOK: Data Management Body of Knowledge (2nd ed.). Data Management Association. 2017. ISBN 978-1634622349.
- "Multilingual reference data". EU Open Data Portal. European Commission. Retrieved 2020-06-07.
- "Using reference data for lookups in Stream Analytics". Microsoft. Microsoft. Retrieved 2020-06-07.
- DAMA-DMBOK: Data Management Body of Knowledge (2nd ed.). Data Management Association. 2017. ISBN 978-1634622349.
- Chisholm, Malcolm. "The Foundations of Successful Reference Data Management" (PDF). TopQuadrant. TopQuadrant. Retrieved 2020-06-07.
- "IBM Redbooks | Reference Data Management". www.redbooks.ibm.com. 2013-05-16. Retrieved 2015-12-09.
- "Reference Data Management and Master Data: Are they Related ? (Oracle Master Data Management)". blogs.oracle.com. Archived from the original on 2015-10-11. Retrieved 2015-12-09.
- "5 best practices for managing reference data - LightsOnData". LightsOnData. 2018-07-25. Retrieved 2018-08-17.
Further reading
- Chisholm, Malcolm (2001). Managing Reference Data in Enterprise Databases. Morgan Kaufmann Publishers. ISBN 1558606971.
See also
- Master Data
- Data modeling
- Master Data Management
- Enterprise bookmarking
- Data architecture
- Transaction data
- Code_(metadata)