{"id":7933,"date":"2019-12-30T15:38:54","date_gmt":"2019-12-30T19:38:54","guid":{"rendered":"http:\/\/www.ericjorden.com\/blog\/?p=7933"},"modified":"2022-09-26T14:40:53","modified_gmt":"2022-09-26T17:40:53","slug":"ridding-peer-review-of-potential-bias","status":"publish","type":"post","link":"http:\/\/www.ericjorden.com\/blog\/2019\/12\/30\/ridding-peer-review-of-potential-bias\/","title":{"rendered":"Ridding peer review of potential bias"},"content":{"rendered":"<p>Forensic investigation must be as thorough and objective as scientific research.\u00a0 Peer review in science ensures that the research is well done.<\/p>\n<p>Unfortunately, peer review in forensic work is not carried out very often.\u00a0 And when it is there is a risk of bias in how it&#8217;s done.\u00a0 This in spite of strict civil procedure rules governing experts and their reports.<\/p>\n<p>***<\/p>\n<p>Peer review in science is a process of evaluating scientific work, by an expert or a group of experts in the related field.\u00a0 The scientific worker may or may not know the reviewer(s) &#8211; a <em>blind<\/em> peer review.\u00a0 Similarly, the reviewer may or may not know the worker. (after Ref. 1 and Dr. Google)<\/p>\n<p>Bias, or unreasoned judgement, can be blatant, or it can be unintended, sneaking up on us out of the ether. (Refs 2, 3 and 4)<strong><br \/><\/strong><\/p>\n<p>Getting rid of bias in peer review is essential to forensic investigation.<\/p>\n<p>***<\/p>\n<p>The penny dropped for me on a better way compared to current practice when I got an e-mail from a reader, Ruth Corbin, after she read a blog I posted on peer review.\u00a0 (Refs 5, 6)\u00a0 A quick reply to Dr. Corbin included my initial thoughts on how I think we can get rid of bias.\u00a0 These are bulleted below including some additional thoughts.<\/p>\n<p>At present, experts investigate the cause of a problem.\u00a0 They write a report on their investigation and findings.\u00a0 The expert&#8217;s report goes to their client, the insurance claims adjuster or the civil litigation lawyer, and from there to the court or dispute resolution tribunal.\u00a0 The investigation and report are seldom peer reviewed.\u00a0 Except in a sense when they are rebutted by the expert for an opposing party.<\/p>\n<p>Just how unbiased is the rebuttal report?\u00a0 If phraseology in some reports is any indication, not much.<\/p>\n<p>(You&#8217;ve all seen this phraseology, I&#8217;m sure.\u00a0 Just to be really sure though, I&#8217;ll update this blog in future with some examples)<\/p>\n<p>A peer review doesn&#8217;t have to be a crude denunciation or vetting of an expert&#8217;s work.\u00a0 We can get rid of blatant bias.\u00a0 We&#8217;re all here to serve the judicial and dispute resolution processes.\u00a0 Finding errors and omissions and fixing them serves that purpose.<\/p>\n<p>A peer or rebuttal review a little closer to that in science would help, one that involves the expert as little as possible in the organizing of a peer review of his work.\u00a0 I think peer review procedures like the following will help, in decreasing order of preference:<\/p>\n<ul>\n<li><strong>The court or tribunal retains<\/strong> the peer reviewer independent of the expert or his client.\u00a0 This in the spirit of peer review in the scientific community.<\/li>\n<li><strong>All the experts<\/strong>\u00a0<strong>engage<\/strong> <strong>in &#8220;hot-tubbing&#8221; session<\/strong>, give their evidence concurrently and agree a joint report. (Refs 2, 7)<\/li>\n<li><strong>The lawyer or adjuster\u00a0<\/strong><strong>retains a peer\u00a0<\/strong>expert to review his work.\u00a0 Because s\/he wants a thorough and objective explanation of issues unfamiliar to the court or tribunal.\u00a0 But third in preference because the lawyer or claims manager do have their interests.<\/li>\n<li><strong>The expert retains<\/strong> <strong>a peer reviewer<\/strong>.\u00a0 Because she would like to think they have done thorough work and reasoned well, particularly in the more empirical applied sciences like some medical and engineering specialties.\u00a0 But fourth in preference because perception is everything in some fields of study.\u00a0 An expert hiring someone to check his work might not look good.<\/li>\n<li><strong>The rebuttal expert peer reviews<\/strong> the expert&#8217;s work.\u00a0 I include this procedure because it&#8217;s a procedure that is sometimes followed.\u00a0 It can work if the rebuttal expert pushes back against bias.<\/li>\n<li><strong>No peer review<\/strong> at all of any kind.\u00a0 The procedure assumes the expert&#8217;s work is thorough and objective and unbiased.<\/li>\n<\/ul>\n<p>I believe the risk of bias is low when the court or dispute resolution tribunal arranges the peer review and high when the rebuttal expert does this.<\/p>\n<p><strong>Summary<\/strong><\/p>\n<p>We can get rid of almost all bias in peer review of forensic investigation and expert services.\u00a0 There are several methods for doing this.\u00a0 The one we chose will reflect our commitment to change and what we&#8217;re prepared to accept.\u00a0 We&#8217;re accepting a lot of potential bias now.<\/p>\n<p><strong>References<\/strong><\/p>\n<ol>\n<li>Merriam-Webster dictionary<\/li>\n<li><em>Biased experts cured with a soak in the &#8220;hot tub&#8221;.<\/em>\u00a0 A blog posted January 31, 2017 at www.ericjorden.com\/blog<\/li>\n<li><em>Expert witness forum looks at bias and other touchy subjects in forensic work. <\/em>Posted March 8, 2018<\/li>\n<li><em>Are experts being broadsided by bias unbeknownst to them?\u00a0<\/em> Posted April 12, 2018<\/li>\n<li><em>A Bundle of Blogs: On the need for peer review in forensic engineering and expert services.<\/em>\u00a0 Posted November 29, 2019<\/li>\n<li>Corbin, M.Sc., Ph.D., LL.D., Ruth M., Chair, Corbin Partners Inc, and Mediator, Corbin Estates Law, Toronto<\/li>\n<li><em>&#8220;Hot-tubbing&#8221; experts reduce the cost of civil litigation and ensure objectively.\u00a0<\/em>\u00a0Posted March 31, 2018<\/li>\n<\/ol>\n\n\n<p><em>(Posted by Eric E. Jorden, M.Sc., P.Eng. Consulting Professional Engineer, Forensic Engineer, Geotechnology Ltd., Halifax, Nova Scotia, Canada. <strong><span class=\"has-inline-color has-vivid-red-color\">ejorden@eastlink.ca<\/span><\/strong>)&nbsp; &nbsp;<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Forensic investigation must be as thorough and objective as scientific research.\u00a0 Peer review in science ensures that the research is well done. Unfortunately, peer review in forensic work is not carried out very often.\u00a0 And when it is there is &hellip; <a href=\"http:\/\/www.ericjorden.com\/blog\/2019\/12\/30\/ridding-peer-review-of-potential-bias\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[16,17],"tags":[],"_links":{"self":[{"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/posts\/7933"}],"collection":[{"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/comments?post=7933"}],"version-history":[{"count":30,"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/posts\/7933\/revisions"}],"predecessor-version":[{"id":10325,"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/posts\/7933\/revisions\/10325"}],"wp:attachment":[{"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/media?parent=7933"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/categories?post=7933"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.ericjorden.com\/blog\/wp-json\/wp\/v2\/tags?post=7933"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}