Common source bias is a type of sampling bias, occurring when both dependent and independent variables are collected from the same group of people. This bias can occur in various forms of research, such as surveys, experiments, and observational studies. Common source bias is a significant concern for any study as it can lead to unreliable results.[1] It is most prevalent in the field of public administration research, where performance measures subject to common source bias can produce false positives when organisational performance is evaluated with explanatory and perceptual measures from the same source.[2]
Occurrence
Common source bias can be categorised into two types: common method bias, also known as common method variance, and common source bias. Common method bias occurs when the same method or instrument is used to collect data from multiple sources, which can lead to an over-representation of certain factors. Common source bias occurs when the information or data collected is influenced by a single source, such as a single individual, group, or organisation.
One of the major causes of common source bias is the influence of the source on the data collected. For example, if a survey is conducted by a single individual, their own beliefs, biases, and perspectives can influence the responses of the participants.
Common source bias is also present in participant selection. If participants are selected based on their association with the source, then their responses may be biased towards the source’s perspective. If participants are selected based on their willingness to participate, then their responses may not be representative of the population as a whole.
Remedies
Ex ante remedies
A recently proposed ex ante remedy for common source bias is the supplementation of survey data with administrative and/or archival data, however the majority of relevant studies seem to present the view that of the proposed statistical remedies for the bias, none appear to reliably counter the issue.[3][4]
References
- ↑ Favero, N.; Bullock, J. B. (2015). "How (Not) to Solve the Problem: An Evaluation of Scholarly Responses to Common Source Bias". Journal of Public Administration Research and Theory. pp. 285–308. doi:10.1093/jopart/muu020. Retrieved 2023-02-07.
- ↑ Andersen, Lotte Bøgh; Heinesen, Eskil; Pedersen, Lene Holm (2016). "Individual Performance: From Common Source Bias to Institutionalized Assessment". Journal of Public Administration Research and Theory. 26 (1): 63–78. ISSN 1053-1858. JSTOR 44165112.
- ↑ Favero, Nathan; B. Bullock, Justin. "How (Not) to Solve the Problem: An Evaluation of Scholarly Responses to Common Source Bias".
{{cite journal}}
: Cite journal requires|journal=
(help) - ↑ Kim, Mirae; Daniel, Jamie Levine (2020-01-02). "Common Source Bias, Key Informants, and Survey-Administrative Linked Data for Nonprofit Management Research". Public Performance & Management Review. 43 (1): 232–256. doi:10.1080/15309576.2019.1657915. ISSN 1530-9576. S2CID 203468837.