User:Nicola.georgiou/sandbox/Approaches to Knowledge/Seminar group 7/ Evidence

Evidence edit

In the context of academic research, evidence is concrete proof provided in support of a certain claim or hypothesis.[1] Evidence falls into two sets of categories: primary or secondary and quantitative or qualitative. In the former case, primary evidence is presented by primary sources, which is considered to be the most reliable[2], whereas secondary evidence, hence, is provided by the secondary sources, which carry out a supplementary function, in addition to primary evidence. As for the latter category, quantitative evidence is given a statistical significance, being usually represented by numbers, whereas qualitative evidence could be characterized as an abstract concept which usually addresses more theoretical questions, often using a case study approach.[3] However, evidence and the way in which it is collected must always be questioned. There must be an in-depth reflection on the technique (quantitative and qualitative) that is relevant to a particular context or discipline to ensure that information is not lost in the process.

This section presents approaches to evidence in different academic disciplines and their research methodologies.

Archaeology: the study of the past through physical evidence edit

Archaeology is the study of the past through physical evidence and this discipline largely relies on four types of evidence that form the archaeological record[4]. Like today’s material world reflects our ways of living, the objects of the past also disclose precious information about past societies[5]. To piece together the past, archaeologists firstly take support on portable objects, called artefacts. Artefacts are objects that have been manufactured or altered by humans[6]. A sub-category of artefacts, called ‘features’, comprises less apparent relics such as imprints in-ground or carves in stones [7]. They are also ‘tools’, objects like polished stones, and ‘manuports’, un-altered objects that have been displaced from their natural location to a new one by human intervention. Both tools and manuports inform on human activities[8]. Architectural structures, often made of durable material, are also traces of past human civilization on which archaeologists base their study on. Lastly, there are ‘ecofacts’ which comprehends organic or inorganic residues and are evidence from the past wildlife and environmental conditions [9]. Usually, archaeologists must combine multiple elements from the archaeological record to establish evidence in the discipline[10]. To successfully identify a ‘manuport’ for instance, a good knowledge of the site itself, given through ecofacts, is required.

Social Anthropology: How Evidence is Collected and Used edit

Social anthropology focuses on the comparison of similarities and differences between societies. The type of evidence used has evolved alongside the rise and fall of anthropological theories.[11][12]

In the 19th century, “armchair anthropology” was prevalent as anthropology focused on other, “primitive” cultures. Secondary evidence such as reports and accounts from explorers[13] or informants in colonies[14][15] was often used, especially by British anthropologists.

In contemporary social anthropology, the evidence is produced through ethnography.[16][17] Typically, it involves fieldwork and utilises methods such as participant observation, interviews or collaboration with participants from the society studied. Apart from immersing an anthropologist in the society they study and allowing them to collect evidence from a native’s point of view, it also gives participants an active voice in a field rooted in colonialism and power imbalance,[18] collecting evidence from multiple equal perspectives. Evidence produced can only be made sense of once placed into the context of its culture or society,[19] or when compared with other similar societies.

Due to the rise of theories like cultural relativism, there is an understanding that social anthropology is a subjective discipline[20] and is affected by the relationships an anthropologist has with participants during their study,[21] leading to further reflection on how evidence is produced and used in social anthropology. Reflexivity arose as a result — awareness of power dynamics inherent in collected evidence can help to minimise the effect of a social anthropologist’s positionality on the data they collect, and how they interpret evidence. How evidence is collected and utilised is just as important as the evidence itself in social anthropology[22] — reflexivity and comparatibility in modern social anthropology minimises the impact of the anthropologist’s own biases during their collection and usage of evidence.

Evidences in Sociology: How to collect, use and interpret them edit

In Sociology, quantitative evidence (data based on surveys, censuses and statistics) provide a great knowledge for studying large-scale social processes. Quantitative evidence is essential, as a single person’s study might not be representative of a whole. For example, if a sociologist wants to study the impact of structural changes in an economy on individuals, one person's account might not be representative of the society and social structures as a whole. That is why he needs quantitative evidence. On the other hand is qualitative evidence. Qualitative evidences are the information that can not be measured, it is what gives an insight of the context, the social phenomena and social scene of the study, and a meaning of their world. Qualitative evidence comes from fieldwork, participant observation, interviews, explicit or not, ethnography [23], but also from the writer’s point of view. [24] [25]

Qualitative and quantitative evidences are often complementary and essential, and one tend to be more important than the other depending on the situation. Evidence must be documented and collected with as much rigour as possible. This is Sociology as an Empirical discipline. Threw observed patterns, information from collected cases and experiences, you can draw evidence, but you can not through anecdotal, isolated reports. Evidence must always be conceptualized and well interpreted, it does not speak for itself. It is only a part of the circuit of knowledge. It is a support to advanced arguments, and the reader must always be aware that qualitative and quantitative evidences in sociology can always be badly interpreted: qualitative evidence seen by a sociologist may deviate from the reality as what he sees though his participant observation, or fieldwork is always interpreted in a way that may not fit reality. As to the quantitative evidence, sociologists can use surveys, censuses and statistics to support their argument in an environment for which those evidences are not intended.

Pharmacology: the evidence required for a drug to be approved edit

Pharmacology as a discipline is based on empirical, quantitive evidence that is collected throughout the preclinical and clinical stages of a drug trial. In a contemporary study, drugs go through successive phases before they are allowed onto the market, beginning with the pre-clinical trials that aim to discover aspects of the drug, such as toxicity, efficacy and other safety information, and if these are passed, the drugs move to clinical trials[26] These experiments normally either occur “using in vitro (test tube or cell culture)” or “in vivo (animal)” methods, with new developments in technology also allowing some tests to be performed “in silico profiling using computer models of the drug-target interactions”[27]. If a drug passes the pre-clinical testing, it then moves into clinical trials, which, in modern medicine, consists of five phases that must be fulfilled for a drug to be judged safe and effective for human use[28]. In Phase 0, small quantities of the drug are given to very small focus groups of around 10 to 15 people, the purpose of which is to test how the drug is processed within the body. Phase 1 is done in slightly larger groups of 15 to 30 people, and attempts to find the optimum quantity of the drug; balancing side effects with the effectiveness of completing the drug's purpose. The phases progress up to Phase 4, where new FDA approved drugs are trialled on several hundreds of thousands of patients, the purpose of which is to attempt to discover any uncommon side effects that were not revealed in previous testing stages and learn more about both short and long term side effects of the drug[29].

This evidence-based research is an important development in modern medicine, as doctors would previously use value judgements and their personal experience with different treatment methods to decide how best to treat a patient, while the scientists working on drug testing see hundreds of thousands of patients and are able to assess the most effective drug based on extensive research and quantitative evidence[30]. There have been major developments in the evidence required for pharmacology since the discipline arguably began in 1747, with scientist James Lind being the first person to conduct a clinical trial: he aimed to discover the optimum way of reducing scurvy onboard ships[31]. In the 1800s there was the arrival of the concept of a placebo, which led to the developments in blind and double-blind trials, the first double-blind trial being in 1943, looking at the effectiveness of Patulin treatment for the common cold[32] which are now requirements for evidence to be considered valid in modern pharmacology[33]. Evidence is an essential aspect of the discipline, as without it drugs would not be allowed onto the market, and there is more weight placed on quantitative, verifiable evidence than qualitative statements.

Experimentation in scientific research : sustainability science edit

Sustainability science is now one of the most urgent research areas. [34] There are interdisciplinary research approaches leading to the development of evidence and information in this field, ranging from science to more social aspects. [35] Experimentation is the most used method for sustainability research because it leads researchers to evidence that could explain the causes and provide solutions to those issues. [36]

However, it is a controversial methodology. This field aims to produce empirical evidence that would lead society towards sustainable development. Still, the blurred distinction between conventional projects and scientific experiments and how those compare to one another triggered criticism: the conceptual foundations of these experiments have been pointed out. Also, it has been highlighted that context and variables can be neglected during the study of those experiments. [37] [38] Sustainability research takes place in specific, complicit contexts, unlike any other scientific field [39] and needs to be relevant to all, especially large corporations, to participate in a more active, process-oriented discipline. [40] This goes against traditional science interpretations, where evidence is universal. [41] The journal of cleaner production defined scientific experiments "as a scientific practice that relies primarily on an intervention, and that aims to produce empirical evidence." [42]

That definition led to the development of a typology which helps compare, select, define and refine the different types of experiments, thereby generating evidence based-knowledge. Nowadays, scientists and practitioners acknowledge the importance of experimentation when searching for evidence in scientific research, especially in sustainability science.

Methodologies of Legal Studies: primary and secondary sources of legal research. edit

Legal studies as an academic field are concerned with looking into and commenting on national and international law, on rules and regulations and on case law. It seeks to find answers to such questions as: what would be the best way to draft a legislation? Which laws and regulations should be applied in a particular situation? Thus an investigation needs to be conducted. Legal research encompasses every step of the process that starts with a factual analysis of issues researched and concluding with the practical application and presentation of the findings.[43]

Firstly, legal research involves developing a deep understanding of the law itself and how different aspects of it interact with each other. Hence, like in every other research, legal research methodologies are based upon using primary and secondary evidence, or data.

Primary Evidence edit

Primary sources, also called legal, comprise two aspects: Primary authority and Primary field sources. Primary authority is represented by the three governmental organs: the Judiciary, the Legislature and the Executive bodies. These actors are the ones who declare the primary field sources, which usually include: legislative enactments (statutory law), case law (opinions of the judiciary, common law or court decisions), as well as regulatory materials (administrative agency regulations and decisions) and constitutions. However, primary sources also fall into two categories. Some primary evidence is referred to as «mandatory», while others can have «persuasive» authority. The former is obligatory for the court to follow, as for the latter, the court has a choice whether to follow them or not.[44]

Secondary Evidence edit

Secondary sources, also referred to as non-legal, are mainly analysis, summaries or commentaries, on law and used for citing the persuasive value. The secondary authority could be represented by NGOs, individuals and autonomous bodies. In contrast, secondary sources constitute materials such as textbooks, cases, digests, periodicals, journals, reports, encyclopedias, dictionaries, etc. [45].

Approaches to research edit

Legal scholars doing the research usually follow two main types of methodologies: documentary research and field research. Documentary research includes doctrinal legal research and review of documentary materials. Whereas empirical, statistical, quantitative and non-doctrinal research, which are also used fall under the second category.[46]

Forensic Science: Evidence in False Convictions edit

False convictions are most likely to occur due to (faulty) forensic evidence, second only to eyewitness testimony.[47] The reason for this occurrence is due to forensic evidence being predominantly subjective in nature; fallacious forensic scientific tests and methods such as microscopic hair analysis, ballistics, handwriting and bite-mark comparisons, involve purely observational methods in which one compares the likeness of two objects, patterns or images.[48] This method of determining ‘uniqueness’ of an object, person or circumstance is known as the forensic individualization theory[48] which in itself has little to no scientific validity as it implies a certainty of knowledge and evidence which does not exist: “absolute specificity and absolute identification.”[49]

Even DNA evidence - something which has proven useful in overturning wrongful convictions – can be unreliable as it lies in the realm of probability and interpretation.[48] This concept of probability is becoming increasingly common as statisticians have become a fundamental part of trial procedures.[50] Statistics, and more broadly, math, is used in courts as evidence of guilt or innocence and is often misused and misrepresented to sway a jury. An example of this is the case of Sally Clark who was falsely convicted of murder under the misconstrued statistic that there was a “1 in 73 million [chance] that she [was] innocent.”[51]

Another facet to evidence in court cases is understanding who is generating this forensic evidence and how it is being represented and understood. This evidence, lacking in objective scientific methodology, relies on human interference and analysis; forensic experts are tasked with providing an educated analysis and opinion on whether a pattern or match exists, meaning that evidence is no longer neutral or separate of objectivity. Evidence is interpreted through filters, one of which is often the pressure put on crime analysts to provide scientific evidence to corroborate already presumed innocence or guilt.[47] The seemingly malleable and fallacious nature of forensic science provides an explanation for the prevalence of false convictions.


Psychology: Reliability of Eyewitness testimony edit

Eyewitness testimony is highly important in criminal trials as it is often used as evidence to build a criminal case and can be the main evidence in a conviction. However, psychologists have questioned the reliability of such testimonies.

To begin with, the psychological state of the witness affects his or her ability to perceive and remember an incident. A study on the impact of anxiety and life stress on an eyewitness's testimony revealed that if the witness was stressed or anxious, he may be less attentive to important clues related to the task and therefore miss information crucial to the witness's task [52].

Furthermore, psychologists have questioned the reliability of the memory of a witness. In a study on the psychology of eyewitness testimony, Jack P. Lipton showed that when there is a delay between the eyewitness's observation and his testimony, the accuracy and quantity of the testimony is significantly impacted. The experiment involved 40 men and 40 women who had to watch a film in which a man is killed and robbed. The subjects all believed that the film was a real event. Then they had to testify in 'trial' either immediately or one week after the event. It was found that after a delay of one week, "the accuracy was 4.3% less than when immediately tested and the quantity was 18.0% less after the delay"[53].

Finally, the type of questions asked by the prosecutor or lawyer to the witness can shape his or her testimony. If the witness is asked leading questions, which means a question where the desired answer is suggested or the witness is led to the answer, his or her testimony can be distorted and shaped [54].


Psychology: Validity of Evidence in Psychological Research edit

There is a fine line in psychological research between following the ethical guidelines of the British Psychological Society (BPS) and maintaining the highest level of validity possible, as often these two necessities can counteract each other.[55] For example, guidelines express the need for fully informed consent from participants in a psychological investigation[56], however, this can often cause participants to show demand characteristics and behave differently towards the situation to how they normally would[57], calling into question the validity of any evidence collected, as it may not be an accurate representation of human behaviour.

There are two types of evidence within psychology, in the forms of primary and secondary data. The validity of these can be called into question in different ways; for example, primary data, collected by the psychologist for their specific investigation, can have a lower level of validity due to the methodological constraints of getting informed consent. This can be avoided through the use of deception[58], and whilst this is also technically not advised in the BPS guidelines, psychologists can deem it necessary on the grounds that it may be the only way to carry out their research[59]. Using deception can call validity into question again, as it can be argued that experimenters are not necessarily measuring what they intend to measure if they have to act through the guise of measuring something else[60]- however through peer review processes and appropriate experimental design, often the benefits of the research outweigh the costs, and so the evidence can be viewed as having high validity.

The validity of evidence from secondary data is often questionable as more often than not, the data being used has not been collected for the sole purpose of the investigation, and is being reinterpreted from its original study that had a different aim. Whilst this can be a positive as it highlights the interdisciplinary nature of psychology, allowing collaboration which a range of other disciplines such as economics and geography[61], and also has often already been through statistical analysis meaning its significance is already known [62], it also introduces a subjectivity towards the data and once again raises the question whether the experimenters are measuring what they intend to measure, especially considering they are not doing the actual data collection themselves.


Historical Evidence: the paradigmatic shift from archival to quantitative data edit

History is a dynamic discipline which has changed (in terms of paradigm and evidence) according to time and context. The idea of evidence in history was well discussed by Leopold Ranke in the 19th century.[63] For Ranke archival data was the main evidence of historical research. With Thomas Khun’s introduction of a discipline’s paradigm in the 20th century, archival data has been paired by many other sources of information.[64] The most important paradigm shift in history has probably been the increasing introduction of quantitative data. This numeric information, based on statistics, demographic sources or more sophisticated mathematical models, form the evidence of the modern discipline.[65] Historians are supposed to use interdisciplinary thinking to catalogue, compare and contrast this evidence in such a way that data can hold significance and lead to a meaningful mapping of the information. In my previous sandbox, I have reported statistics from a National Geographic article which discussed how American cities flattened the curve in 1918 Spanish Flu pandemic.[66] The numbers regarding Philadelphia, New York or San Francisco are the quantitative evidence that we can use to study contemporary data in the time of Covid19 pandemic. Quantitative data can also be used according to a contrast/comparison analysis between past and present.

References edit

  1. evidence | meaning in the Cambridge Essential American Dictionary [Internet]. Dictionary.cambridge.org. 2020. Available from: https://dictionary.cambridge.org/dictionary/essential-american-english/evidence.
  2. Definition of EVIDENCE [Internet]. Merriam-webster.com. 2020. Available from: https://www.merriam-webster.com/dictionary/evidence.
  3. Qualitative and Quantitative Approaches to Evidence-Based Management | CQ Net - Management skills for everyone [Internet]. CQ Net - Management skills for everyone!. 2020 [cited 10 November 2020]. Available from: https://www.ckju.net/en/dossier/qualitative-and-quantitative-approaches-evidence-based-management/1223
  4. Renfrew C, Bahn P. Archaeology Essentials: Theories, Methods and Practice. London: Thames & Hudson; 2007.
  5. Hurcombe L. Archaeological artefacts as material culture. Routledge; 2014.
  6. Renfrew C, Bahn P. Archaeology Essentials: Theories, Methods and Practice. London: Thames & Hudson; 2007.
  7. Renfrew C, Bahn P. Archaeology Essentials: Theories, Methods and Practice. London: Thames & Hudson; 2007.
  8. Hurcombe L. Archaeologicalartefacts as material culture. Routledge; 2014.
  9. Renfrew C, Bahn P. Archaeology Essentials: Theories, Methods and Practice. London: Thames & Hudson; 2007.
  10. Hurcombe L. Archaeological artefacts as material culture. Routledge; 2014.
  11. Bowen, John Richard, John Bowen, Roger Petersen, and Roger Dale Petersen, eds. Critical comparisons in politics and culture. Cambridge University Press, 1999.
  12. Beattie, John. Other cultures: Aims, methods and achievements in social anthropology. Routledge, 2013.
  13. Kuklick, Henrika. The savage within: the social history of British anthropology, 1885-1945. Cambridge University Press, 1991.
  14. Urry, James. Before social anthropology: essays on the history of British anthropology. Vol. 6. Psychology Press, 1993.
  15. Sera-Shriar, Efram. “What Is Armchair Anthropology? Observational Practices in 19th-Century British Human Sciences.” History of the Human Sciences 27, no. 2 (April 2014): 26–40. https://doi.org/10.1177/0952695113512490.
  16. Gingrich, Andre. "Evidence in Socio-cultural Anthropology: Limits and Options for Epistemological Orientations." Social Analysis, 53, no. 2 (2009): 177-190.
  17. Firth, Raymond. "Contemporary British Social Anthropology." American Anthropologist, New Series, 53, no. 4 (1951): 474-89. Accessed October 26, 2020. http://www.jstor.org/stable/664249.
  18. Lewis, Diane. "Anthropology and colonialism." Current Anthropology 14, no. 5 (1973): 581-602.
  19. Scott, Joan W. "The Evidence of Experience. S. 363–87 in: J. Chandler/AI Davidson/HD Harootunian (Hrsg.), Questions of Evidence: Proof, Practice, and Persuasion across the Disciplines." (1994).
  20. Jenkins, Timothy. "Fieldwork and the Perception of Everyday Life." Man, New Series, 29, no. 2 (1994): 433-55. Accessed October 26, 2020. doi:10.2307/2804481.
  21. HASTRUP, KIRSTEN. 2005. “Social Anthropology. Towards a Pragmatic Enlightenment?” Social Anthropology 13 (2). Cambridge University Press: 133–49. doi:10.1017/S0964028205001199.
  22. Hastrup, Kirsten. “Getting It Right: Knowledge and Evidence in Anthropology.” Anthropological Theory 4, no. 4 (December 2004): 455–72. https://doi.org/10.1177/1463499604047921.
  23. [[1]]
  24. [Writing Center, University of North Carolina at Chapel Hill]
  25. [Learn, Reading Evidence]
  26. [Marquard J. et al., 2015. Characterization of pancreatic NMDA receptors as possible drug targets for diabetes treatment. https://www.profil.com/knowledge-center/trial-stages.]
  27. [Marquard J. et al., 2015. Characterization of pancreatic NMDA receptors as possible drug targets for diabetes treatment. https://www.profil.com/knowledge-center/trial-stages.]
  28. [[author unknown] https://www.nccn.org/patients/resources/clinical_trials/phases.aspx]
  29. [[author unknown] https://www.nccn.org/patients/resources/clinical_trials/phases.aspx]
  30. [Sackett DL, Rosenberg WM, Gray JA. Evidence-based medicine: what it is and what it isn’t. BMJ. 1996; 312: 71-72. https://www.bmj.com/content/312/7023/71]
  31. [Dodgson S J. The evolution of clinical trials. The Journal of the European Medical Writers Association. 2006;15:20–21. https://www.researchgate.net/profile/Susanna_Dodgson2/publication/242561119_The_evolution_of_clinical_trials/links/56a25f7c08ae232fb2019e62/The-evolution-of-clinical-trials.pdf]
  32. [Hart PD. A change in scientific approach: from alternation to randomised allocation in clinical trials in the 1940s. BMJ. 1999 Aug 28;319(7209):572–573. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1116443/]
  33. [European Medicines Agency. Guideline on the requirements to the chemical and pharmaceutical quality documentation concerning investigation medicinal products in clinical trials. London: Committee for Medicinal Products for Human Use (CHMP), 2006. https://www.ema.europa.eu/en/documents/scientific-guideline/guideline-requirements-chemical-pharmaceutical-quality-documentation-concerning-investigational_en.pdf]
  34. Kates RW. ENVIRONMENT AND DEVELOPMENT: Sustainability Science. Science [Internet]. 2001 Apr 27;292(5517):641–2. Available from: https://science.sciencemag.org/content/292/5517/641
  35. Komiyama H, Takeuchi K. Sustainability science: building a new discipline. Sustainability Science [Internet]. 2006 Aug 24 [cited 2020 Jun 4];1(1):1–6. Available from: https://link.springer.com/article/10.1007/s11625-006-0007-4‌
  36. Caniglia G, Schäpke N, Lang DJ, Abson DJ, Luederitz C, Wiek A, et al. Experiments and evidence in sustainability science: A typology. Journal of Cleaner Production [Internet]. 2017 Dec [cited 2019 Oct 26];169:39–47. Available from: https://www.sciencedirect.com/science/article/pii/S0959652617311162
  37. Sengers F, Berkhout F, Wieczorek AJ, Raven R. Experimenting in the city. In: The Experimental City [Internet]. London: routledge; 2016. p. 15–31. Available from: https://www.taylorfrancis.com/books/e/9781315719825
  38. Luederitz C, Schäpke N, Wiek A, Lang DJ, Bergmann M, Bos JJ, et al. Learning through evaluation – A tentative evaluative scheme for sustainability transition experiments. Journal of Cleaner Production [Internet]. 2017 Dec 15 [cited 2020 Oct 26];169:61–76. Available from: https://www.sciencedirect.com/science/article/pii/S0959652616313464
  39. Karvonen A, van Heur B. Urban Laboratories: Experiments in Reworking Cities. International Journal of Urban and Regional Research [Internet]. 2013 Dec 26 [cited 2020 Oct 26];38(2):379–92. Available from: https://onlinelibrary.wiley.com/doi/full/10.1111/1468-2427.12075
  40. Wittmayer JM, Schäpke N. Action, research and participation: roles of researchers in sustainability transitions. Sustainability Science [Internet]. 2014 Aug 21 [cited 2019 Aug 6];9(4):483–96. Available from: https://link.springer.com/article/10.1007%2Fs11625-014-0258-4
  41. Mitchell SD. Unsimple Truths: Science, Complexity, and Policy [Internet]. Google Books. University of Chicago Press; 2009 [cited 2020 Oct 26]. Available from: https://books.google.co.uk/books?hl=fr&lr&id=obbUPu0HbHEC&oi=fnd&pg=PR7&ots=8jLr4GMOlL&sig=lI2nKZ1dFMKexYeuEMq38uj1Wvs&redir_esc=y&pli=1#v=onepage&q&f=false
  42. Caniglia G, Schäpke N, Lang DJ, Abson DJ, Luederitz C, Wiek A, et al. Experiments and evidence in sustainability science: A typology. Journal of Cleaner Production [Internet]. 2017 Dec [cited 2019 Oct 26];169:39–47. Available from: https://www.sciencedirect.com/science/article/pii/S0959652617311162
  43. [2]Hood HA. J. Myron Jacobstein and Roy M. Mersky. Fundamentals of Legal Research. Mineola, N. Y.: Foundation Press, 1977. Pp. 660. International Journal of Law Libraries. Cambridge University Press; 1977;5(2):250–1
  44. [3]Law 627: Legal Research: Home [Internet]. LibGuides. [cited 2020Oct26]
  45. [4]Law 627: Legal Research: Home [Internet]. LibGuides. [cited 2020Oct26]
  46. [5]Chynoweth P. Law in the Built Environment Law in the Built Environment. Bradford: Emerald Group Publishing Limited; 2007.
  47. a b Ungvarsky E. Remarks on the Use and Misuse of Forensic Science to Lead to False Convictions. New England Law Review [Internet]. 2007;41(3):609-619. Available from: https://heinonline.org/HOL/P?h=hein.journals/newlr41&i=622.)
  48. a b c Saks M, Koehler J. The Coming Paradigm Shift in Forensic Identification Science. Science [Internet]. 2005 ;309(5736):892-893. Available from: http://www.jstor.org/stable/3842593
  49. Saks M, Koehler J. The Individualization Fallacy in Forensic Evidence. Vanderbilt Law Review [Internet]. 2008 ;61(1):199-207. Available from: https://heinonline.org/HOL/P?h=hein.journals/vanlr61&i=219.
  50. Fienberg S. The Evolving Role of Statistical Assessments as Evidence in the Courts. Springer Science & Business Media; 2012.
  51. Schneps L, Colmez C. Math on trial. New York: Basic Books; 2013.
  52. [B S. Dohrenwend BPD, Easterbrook JA, France A, T H. Holmes RHR, Sarason IG, I G. Sarason RS, et al. Impact of anxiety and life stress upon eyewitness testimony [Internet]. Bulletin of the Psychonomic Society. Springer-Verlag; 1974 [cited 2020Oct27]. Available from: https://link.springer.com/article/10.3758/BF03329743]
  53. [Lipton JP. On the psychology of Eyewitness Testimony [Internet]. Apa PsycNet. [cited 2020Oct27]. Available from: https://psycnet.apa.org/record/1977-21165-001]
  54. [Loftus EF, Palmer JC. Eyewitness Testimony [Internet]. SpringerLink. Palgrave, London; 1996 [cited 2020Oct27]. Available from: https://link.springer.com/chapter/10.1007/978-1-349-24483-6_46]
  55. Cardwell M, Flanagan C. Psychology A Level Year 1 and AS. 4th ed. Oxford: Oxford University Press; 2015.
  56. BPS Practice Guidelines. 3rd ed. Leicester: The British Psychological Society; 2017.
  57. Sieber J, Iannuzzo R, Rodriguez B. Deception Methods in Psychology: Have They Changed in 23 Years?. Ethics & Behaviour [Internet]. 1995 [cited 27 October 2020];5(1):67-85. Available from: https://doi.org/10.1207/s15327019eb0501_5
  58. BPS Practice Guidelines. 3rd ed. Leicester: The British Psychological Society; 2017.
  59. Ortmann A, Hertwig R. The Costs of Deception: Evidence from Psychology. SSRN Electronic Journal [Internet]. 2002 [cited 27 October 2020];5:117-131. Available from: https://link.springer.com/article/10.1023/A:1020365204768#citeas
  60. Rosenthal R, Rosnow R. Artifacts in behavioural research. New York: Oxford University Press; 2009.
  61. 9. Duncan G. Made in heaven: Secondary data analysis and interdisciplinary collaborators. Developmental Psychology. 1991;27(6):949-951.
  62. Cardwell M, Flanagan C. Psychology A Level Year 1 and AS. 4th ed. Oxford: Oxford University Press; 2015.
  63. Kasper Risbjerg Eskildsen, Leopold Ranke’s Archival Turn: Location and Evidence in Modern Historiography, [internet] Modern Intellectual History, 5, 3 (2008), pp. 425–453 [Accessed 21 October, 2020] Available from: Modern Intellectual History, 5, 3 (2008), pp. 425–453
  64. Iggers, Georg G., The crisis of the Rankean Paradigm in the Nineteenth Century, [internet] Syracuse Scholar (1979-1991): Vol. 9, 1988, pp. 1-9 [Accessed 21 October, 2020] Available from: https://surface.syr.edu/cgi/viewcontent.cgi?article=1007&context=susch
  65. Myron P. Gutmann, Quantifying Interdisciplinary History: The Record of (Nearly) Fifty Years, [internet] Journal of Interdisciplinary History, Volume 50, Spring 2020, pp. 517-545 [Accessed 21 October, 2020] Available from: https://www.mitpressjournals.org/doi/full/10.1162/jinh_a_01484
  66. Nina Strochlic and Riley D. Champine How some cities ‘flattened the curve’ during the 1918 flu pandemic, [internet]National Geographic, March 27, 2020. [accessed 18 October, 2020] Available from: https://www.nationalgeographic.com/history/2020/03/how-cities-flattened-curve-1918-spanish-flu-pandemic-coronavirus/