Peer Review and the Scientific Process

[Renegade]

Tangentially related and funny:

[IainB]

Well this was a surprise! (NOT)
(There are some quite amusing bits in here.)
Psychologists Call Out the Study That Called Out the Field of Psychology

By Rachel E. Gross
458637324-amy-cuddy-speaks-onstage-during-cosmopolitan-magazines
Independent researchers have had trouble replicating the famous findings of Harvard psychologist Amy Cuddy (pictured).

Craig Barritt/Getty Images for Cosmopolitan magazine and WME Live

Remember that study that found that most psychology studies were wrong? Yeah, that study was wrong. That’s the conclusion of four researchers who recently interrogated the methods of that study, which itself interrogated the methods of 100 psychology studies to find that very few could be replicated. (Whoa.) Their damning commentary will be published Friday in the journal Science. (The scientific body that publishes the journal sent Slate an early copy.)
Rachel E. Gross Rachel E. Gross

Rachel E. Gross is a Slate editorial assistant.

In case you missed the hullabaloo: A key feature of the scientific method is that scientific results should be reproducible—that is, if you run an experiment again, you should get the same results. If you don’t, you’ve got a problem. And a problem is exactly what 270 scientists found last August, when they decided to try to reproduce 100 peer-reviewed journal studies in the field of social psychology. Only around 39 percent of the reproduced studies, they found, came up with similar results to the originals.

That meta-analysis, published in Science by a group called the Open Science Collaboration, led to mass hand-wringing over the “replicability crisis” in psychology. (It wasn’t the first time that the field has faced such criticism, as Michelle N. Meyer and Christopher Chabris have reported in Slate, but this particular study was a doozy.)

Now this new commentary, from Harvard’s Gary King and Daniel Gilbert and the University of Virginia’s Timothy Wilson, finds that the OSC study was bogus—for a dazzling array of reasons. I know you’re busy, so let’s examine just two.

The first—which is what tipped researchers off to the study being not-quite-right in the first place—was statistical. The whole scandal, after all, was over the fact that such a low number of the original 100 studies turned out to be reproducible. But when King, a social scientist and statistician, saw the study, he didn’t think the number looked that low. Yeah, I know, 39 percent sounds really low—but it’s about what social scientists should expect, given the fact that errors could occur either in the original studies or the replicas, says King.

His colleagues agreed, telling him, according to King, “This study is completely unfair—and even irresponsible.”

Upon investigating the study further, the researchers identified a second and more crucial problem. Basically, the OSC researchers did a terrible job replicating those 100 studies in the first place. As King put it: “You’d think that a test about replications would actually reproduce the original studies.” But no! Some of the methods used for the reproduced studies were utterly confounding—for instance, OSC researchers tried to reproduce an American study that dealt with Stanford University students’ attitudes toward affirmative action policies by using Dutch students at the University of Amsterdam. Others simply didn’t use enough subjects to be reliable.

The new analysis “completely repudiates” the idea that the OSC study provides evidence for a crisis in psychology, says King. Of course, that doesn’t mean we shouldn’t be concerned with reproducibility in science. “We should be obsessed with these questions,” says King. “They are incredibly important. But it isn’t true that all social psychologists are making stuff up.”

After all, King points out, the OSC researchers used admirable, transparent methods to come to their own—ultimately wrong—conclusions. Specifically, those authors made all their data easily accessible and clearly explained their methods—making it all the easier for King and his co-authors to tear it apart. The OSC researchers also read early drafts of the new commentary, helpfully adding notes and clarifications where needed. “Without that, we wouldn’t have been able to write our article,” says King. Now that’s collaboration!

“We look forward to the next article that tries to conclude that we’re wrong,” he adds.

[IainB]

@Renegade: By the way, I just watched Alternate Viewpoint-Cancelling Headphones - We the Internet Sketch 9
I've met quite a few people who might like to buy these headphones, so, thanks for the link.   

[IainB]

I had always been interested in "shaken baby syndrome" since watching a UK TV documentary about it as a child. It was the first time that I learned that parents could snap and lose control and actually seriously harm their babies out of a sort of mental state of pent-up frustrated anger, without actually intending to harm them.
Whilst I had realised that diagnosis was based on a hypotheses rather than established facts, I had not realised that in the UK one is apparently not allowed to talk about it as being a hypothesis, but only as an established fact.

This shaken baby syndrome case is a dark day for science – and for justice
Clive Stafford Smith

A leading doctor faces being struck off for challenging the theory about the infant condition. It’s like Galileo all over again
Image: Father holds newborn baby on shoulder
‘Shaken baby syndrome is almost unique among medical diagnoses in that it is not focused on treating the child.’ Photograph: Moodboard/Alamy

Monday 14 March 2016 09.30 GMT
Last modified on Tuesday 15 March 2016 11.42 GMT

On Friday, I witnessed something akin to a reenactment of the trial of Galileo, precisely four centuries after the original. Dr Waney Squier faces being struck off by the General Medical Council (GMC) for having the temerity to challenge the mainstream theory on shaken baby syndrome (SBS).

For years, the medical profession has boldly asserted that a particular “triad” of neurological observations is essentially diagnostic of SBS. Since the Nuremberg Code properly prevents human experimentation, this is an unproved hypothesis, and there has been rising doubt as to its validity.

Doctor who doubted shaken baby syndrome misled courts, panel rules

I am convinced that Squier is correct, but one does not have to agree with me to see the ugly side to the GMC prosecution: the moment that we are denied the right to question a scientific theory that is held by the majority, we are not far away from Galileo’s predicament in 1615, as he appeared before the papal inquisition. He dared to suggest that the Bible was an authority on faith and morals, rather than on science, and that 1 Chronicles 16:30 – “the world is firmly established, it cannot be moved” – did not mean that the Earth was rigidly lodged at the epicentre of the universe. It was not until 1982 that Pope John Paul II issued a formal admission that the church had got it wrong.

Shaken baby syndrome is almost unique among medical diagnoses in that it is not focused on treating the child. If an infant has bleeding on the brain (a subdural hematoma), the doctor wants to relieve the pressure – it is of little relevance how the infant came about the injury. SBS is, then, a “diagnosis” of a crime rather than an illness, and when a brain surgeon comes into the courtroom and “diagnoses” guilt, the defendant, mostly a parent, is likely to go to prison – or worse.

I have defended a number of emotionally charged capital cases where doctors have opined that a child had to have been shaken by an angry parent because it was “impossible” for the triad of neurological sequelae to result from an accident – it “had” to be caused by shaking. Many American doctors adhere to a bizarre notion that an infant cannot suffer a fatal head injury from a fall of less than three storeys. While we cannot drop a series of infants on their heads to test this, it would appear to be plain folly. The velocity of a five-foot fall means a child’s head can hit the ground at roughly 15mph, which is faster than most people – short of Usain Bolt - can sprint. I invited a series of neurosurgeons to run headlong into a hardwood wall in one courtroom, so we could see what happened to them. They politely declined, and stuck to their silly theory.

    What other doctor will be prepared to question the prosecution theory if it means the end of a career?

Squier has now been branded a “liar” by the panel, and found “guilty” of paying insufficient respect to her peers. Dr Michael Powers, perhaps the eminent QC in the area of medico-legal practice in the UK, believes that the GMC tribunal – made up of a retired wing commander, a retired policeman and a retired geriatric psychiatrist – was not qualified to understand the complex pathology of the developing brain. “It is therefore sad, but not surprising, that they have reached the wrong conclusion,” he said. “The proper forum for debating these issues is the international neuroscience community.”

Powers has a point: Michele Codd, the chair of the panel, was a general duties officer in the RAF for 32 years. One might doubt whether Stephen Marr, a retired Merseyside police officer, would hold up a constable’s hand to a prosecution theory that has sent so many people to prison.

Nisreen Booya was the sole person with any meaningful medical qualifications on the panel, but in a rather different area: she is a retired psychiatrist specialising in geriatric issues such as Alzheimer’s, an illness that, like infant head trauma, is “poorly understood”. She is quoted as saying that she “made a career of trying to provide innovative services” in her field – and yet she condemns Squier for thinking outside her own rigid box. All three are doubtless honourable people, but they are simply wrong to hold SBS up as the fifth gospel.

At the risk of being diagnosed with “I told you so” syndrome, I wrote an article 20 years ago questioning whether forensic hair analysis was really science. I was pleased therefore when, in 2015, the FBI admitted that they had got it wrong for decades – but this came after thousands of men, women and children had been convicted on the basis of latter-day snake oil, and scores had been sent to death row.

Those deemed to be blasphemers often suffer a gruesome fate. Although Squier may be struck off, at least she will not be burned at the stake. But the impact on medical science will be immense, because what other doctor will be prepared to question the prosecution theory if it means the end of a career? This is a very dark day for science, as it is for justice.
______________

[IainB]

Eisenhower foresaw this kind of thing...
UK Government Forbids Publicly-Funded Scientists And Academics From Giving Advice It Disagrees With

[Renegade]

http://theweek.com/a...1/big-science-broken

Big Science is broken


Science is broken.

That's the thesis of a must-read article in First Things magazine, in which William A. Wilson accumulates evidence that a lot of published research is false. But that's not even the worst part.

Advocates of the existing scientific research paradigm usually smugly declare that while some published conclusions are surely false, the scientific method has "self-correcting mechanisms" that ensure that, eventually, the truth will prevail. Unfortunately for all of us, Wilson makes a convincing argument that those self-correcting mechanisms are broken.

For starters, there's a "replication crisis" in science. This is particularly true in the field of experimental psychology, where far too many prestigious psychology studies simply can't be reliably replicated. But it's not just psychology. In 2011, the pharmaceutical company Bayer looked at 67 blockbuster drug discovery research findings published in prestigious journals, and found that three-fourths of them weren't right. Another study of cancer research found that only 11 percent of preclinical cancer research could be reproduced. Even in physics, supposedly the hardest and most reliable of all sciences, Wilson points out that "two of the most vaunted physics results of the past few years — the announced discovery of both cosmic inflation and gravitational waves at the BICEP2 experiment in Antarctica, and the supposed discovery of superluminal neutrinos at the Swiss-Italian border — have now been retracted, with far less fanfare than when they were first published."

What explains this? In some cases, human error. Much of the research world exploded in rage and mockery when it was found out that a highly popularized finding by the economists Ken Rogoff and Carmen Reinhardt linking higher public debt to lower growth was due to an Excel error. Steven Levitt, of Freakonomics fame, largely built his career on a paper arguing that abortion led to lower crime rates 20 years later because the aborted babies were disproportionately future criminals. Two economists went through the painstaking work of recoding Levitt's statistical analysis — and found a basic arithmetic error.

Then there is outright fraud. In a 2011 survey of 2,000 research psychologists, over half admitted to selectively reporting those experiments that gave the result they were after. The survey also concluded that around 10 percent of research psychologists have engaged in outright falsification of data, and more than half have engaged in "less brazen but still fraudulent behavior such as reporting that a result was statistically significant when it was not, or deciding between two different data analysis techniques after looking at the results of each and choosing the more favorable."

Then there's everything in between human error and outright fraud: rounding out numbers the way that looks better, checking a result less thoroughly when it comes out the way you like, and so forth.

More at the link.

Link to the article at First Things:

http://www.firstthin...5/scientific-regress

SCIENTIFIC REGRESS

he problem with ­science is that so much of it simply isn’t. Last summer, the Open Science Collaboration announced that it had tried to replicate one hundred published psychology experiments sampled from three of the most prestigious journals in the field. Scientific claims rest on the idea that experiments repeated under nearly identical conditions ought to yield approximately the same results, but until very recently, very few had bothered to check in a systematic way whether this was actually the case. The OSC was the biggest attempt yet to check a field’s results, and the most shocking. In many cases, they had used original experimental materials, and sometimes even performed the experiments under the guidance of the original researchers. Of the studies that had originally reported positive results, an astonishing 65 percent failed to show statistical significance on replication, and many of the remainder showed greatly reduced effect sizes.

Their findings made the news, and quickly became a club with which to bash the social sciences. But the problem isn’t just with psychology. There’s an ­unspoken rule in the pharmaceutical industry that half of all academic biomedical research will ultimately prove false, and in 2011 a group of researchers at Bayer decided to test it. Looking at sixty-seven recent drug discovery projects based on preclinical cancer biology research, they found that in more than 75 percent of cases the published data did not match up with their in-house attempts to replicate. These were not studies published in fly-by-night oncology journals, but blockbuster research featured in Science, Nature, Cell, and the like. The Bayer researchers were drowning in bad studies, and it was to this, in part, that they attributed the mysteriously declining yields of drug pipelines. Perhaps so many of these new drugs fail to have an effect because the basic research on which their development was based isn’t valid.

When a study fails to replicate, there are two possible interpretations. The first is that, unbeknownst to the investigators, there was a real difference in experimental setup between the original investigation and the failed replication. These are colloquially referred to as “wallpaper effects,” the joke being that the experiment was affected by the color of the wallpaper in the room. This is the happiest possible explanation for failure to reproduce: It means that both experiments have revealed facts about the universe, and we now have the opportunity to learn what the difference was between them and to incorporate a new and subtler distinction into our theories.

The other interpretation is that the original finding was false. Unfortunately, an ingenious statistical argument shows that this second interpretation is far more likely. First articulated by John Ioannidis, a professor at Stanford University’s School of Medicine, this argument proceeds by a simple application of Bayesian statistics. Suppose that there are a hundred and one stones in a certain field. One of them has a diamond inside it, and, luckily, you have a diamond-detecting device that advertises 99 percent accuracy. After an hour or so of moving the device around, examining each stone in turn, suddenly alarms flash and sirens wail while the device is pointed at a promising-looking stone. What is the probability that the stone contains a diamond?

Most would say that if the device advertises 99 percent accuracy, then there is a 99 percent chance that the device is correctly discerning a diamond, and a 1 percent chance that it has given a false positive reading. But consider: Of the one hundred and one stones in the field, only one is truly a diamond. Granted, our machine has a very high probability of correctly declaring it to be a diamond. But there are many more diamond-free stones, and while the machine only has a 1 percent chance of falsely declaring each of them to be a diamond, there are a hundred of them. So if we were to wave the detector over every stone in the field, it would, on average, sound twice—once for the real diamond, and once when a false reading was triggered by a stone. If we know only that the alarm has sounded, these two possibilities are roughly equally probable, giving us an approximately 50 percent chance that the stone really contains a diamond.

More at that link as well.

[IainB]

@Renegade: ^^ Those are very interesting links, thanks.
True, but somewhat depressing though.

[Mikky111]

IainB 

[Renegade]

Scientists Say Fraud Causing Crisis of Science - #NewWorldNextWeek

Story #1: 40% of Scientists Admit Fraud “Always or Often” Contributes to Irreproducible Research
http://bit.ly/1XkpU1b
How the National Academy of Sciences Misled the Public Over GMO Food Safety
http://bit.ly/1TY7cZ9
Portland, Oregon School Board Promotes Climate Justice, Bans Books That Deny Climate Change
http://bit.ly/1UwJBPf

[IainB]

@Renegade: Yes, I had read about all three of those ^^.
"Ministry of Truth" here we come.
We have to realise that these things are accompanied by - could not happen without - an abandonment of reason. It's not technocracy per se, its political fascism based on whatever "scientific" model they find most convenient or expedient to promulgate their objectives (e.g., the school board banning books that risk factually contradicting/refuting the politically correct and unsubstantial propaganda or religio-political ideology).

It's not much different to people wanting to ban the teaching of evolutionary theory in schools because it conflicts with their preferred religio-political ideology. (And please don't try to tell me that the Old Testament is a theoretical treatise.)

Judging by some of the nonsense that some people spout, I often wonder whether we as a species are hard-wired, as it were, so that we are unable to resist believing in imaginary things - be they fairies, djins, God, the non-existence of God, life after death, non-life after death, Heaven and Hell, or whatever - to the extent that we feel obliged to convert others to our beliefs and are intellectually intolerant of anyone holding any conflicting views (theory or belief).

The documented history of wars from ancient to modern times shows an essential and unpleasant truth that, whenever one sees a situation where a power group holds an absolute intolerance of other groups'/people's credible reasoning, views or beliefs, it was generally followed by some form of sacrifice and forceful reinforcement of "the correct" views/behaviours, punishable by death to the unreformable unbelievers.

There is a near-perfect model of this kind of dichotomy in Nature. If you've ever seen a video of a cuckoo chick in its host's nest, pushing out everything - including the eggs of the host birds and/or their hatched young - then you have witnessed a highly successful survival behaviour. It is instinctive. The chick cannot abide having anything else in the nest, and even has a specially-hollowed out dent in its back to assist in the expulsion of other objects from the nest. The tiny host-parents wear themselves out trying to feed the voracious giant parasite that they believe is their offspring.

Now consider the paradigm in one's mind as being somewhat akin to that cuckoo chick. Within the radius of control of the mind, there must be no conflicting paradigms.
Except that, with humans, it doesn't stop there - the radius of control expands and extends far outside of one's head and other people must think similarly, or else there'll be trouble. Typically that's likely to mean that someone's probably going to have to be jailed, beaten up or worse, even killed.

At root, it's simply another manifestation of Ahamkara

If anything has been demonstrated in this discussion thread, it is that the truth of science has continually and consistently been perverted by fraud and/or religio-political ideology and unreason, to the extent that no-one can read about scientific research any more without a huge dollop of skepticism.
A corrupt peer review of a corrupt science cannot somehow "make it true", no matter how hard and shrill the desperate cry that "There is consensus. See? We are all agreed! And it's all been peer reviewed, so it must be true!"

Yeah, right.

[IainB]

...I often wonder whether we as a species are hard-wired, as it were, so that we are unable to resist believing in imaginary things - be they fairies, djins, God, the non-existence of God, life after death, non-life after death, Heaven and Hell, or whatever ...
______________________________

-IainB (June 03, 2016, 11:06 PM)

Quite coincidentally today, I was looking at the comments to some amusing candid camera type videos, and saw the video below - which is arguably a perfect example/illustration for the above quote.
In the video, the passers-by are clearly guided by their own natural senses and reason and are unable to detect a taut wire between the two traffic cones (and it would be infeasible anyway for a taut wire to be maintained between 2 free-standing traffic cones). Yet their behaviours variously indicate a shifting from curiosity, to disbelief, and then, quite quickly, to an internalised belief in the impossible - i.e., they end up believing that an invisible wire exists and they then seem to go to great lengths to carefully avoid it. They have been fully deceived by the deliberately deceptive experiment.

Video: Invisible Wire - https://www.youtube..../watch?v=_eASQ5Jak0A

In much the same way:

• The Piltdown Man became so real for many people - scientists and laymen alike - because they saw it as the postulated "missing link" that conclusively proved the theory of the evolution of Man. It even entered school textbooks as a fact of Natural History. (Ring any bells?)
• Phrenology became a legitimate method for the diagnosis of a person's character and mental abilities - practiced, for example, by psychologists.
• Various forms of electro-shock therapy became a legitimate treatment - practiced, for example, by doctors in lunatic asylums, where the treatment was forced on captive "patients".

Not a good look for academics and so-called "scientists", nor for the so-called "medical profession" really.

The video is not only a good example of our innate suggestibility and the power of suggestion, but also it effectively provides a repeatable model of the belief syndrome - you can substitute virtually any daft belief you want for the invisible wire, including, for example, the belief that it is possible to have an invisible wire (QED), the belief that there are fairies, or that there is no God, or that a peer review somehow magically proves the conclusions of a suspect piece of research to be irrefutably true and thus beyond doubt/skepticism or falsifiability.

(Falsifiability or refutability is the property of a statement, hypothesis, or theory whereby it could be shown to be false if some conceivable observation were true. In this sense, falsify is synonymous with nullify, meaning not "to commit fraud" but "show to be false". Science must be falsifiable.)

[IainB]

Very interesting post from http://www.powerlineblog.com/ - highlighting effectively what Feynman taught: i.e., that if the observational data doesn't support the theory, then it's the theory that's wrong.
(Copied below sans embedded hyperlinks/images.)

POSTED ON APRIL 13, 2016 BY STEVEN HAYWARD IN SCIENCE
FROM THE ANNALS OF SCIENTIFIC OBJECTIVITY
In the last few years the virtues of a low-fat diet have gradually come undone, though some “nutritional anthropologists” keep the faith like those Japanese soldiers in the island jungles who refused be believe World War II was over. Yesterday the Washington Post reported on how the full data from a major nutrition study that helped cement the old conventional wisdom was never fully analyzed, but might have saved us from error (and saved some lives) if it had been:

It was one of the largest, most rigorous experiments ever conducted on an important diet question: How do fatty foods affect our health? Yet it took more than 40 years  — that is, until today —  for a clear picture of the results to reach the public. . .

Today, the principles of that special diet — less saturated fat, more vegetable oils — are included in the Dietary Guidelines for Americans, the government’s official diet advice book. Yet the fuller accounting of the data indicates that the advice is, at best, unsupported by the massive trial. In fact, it appears to show just the opposite:  Patients who lowered their cholesterol, presumably because of the special diet, actually suffered more heart-related deaths than those who did not. . .

The new researchers, led by investigators from the National Institutes of Health and the University of North Carolina, conclude that the absence of the data over the past 40 years or so may have led to a misunderstanding of this key dietary issue.

“Incomplete publication has contributed to the overestimation of benefits and underestimation of potential risks” of the special diet, they wrote.

Good thing this could never happen with climate science. What’s that you say?

But Broste suggested that at least part of the reason for the incomplete publication of the data might have been human nature. The Minnesota investigators had a theory that they believed in — that reducing blood cholesterol would make people healthier. Indeed, the idea was widespread and would soon be adopted by the federal government in the first dietary recommendations. So when the data they collected from the mental patients conflicted with this theory, the scientists may have been reluctant to believe what their experiment had turned up.

“The results flew in the face of what people believed at the time,” said Broste. “Everyone thought cholesterol was the culprit. This theory was so widely held and so firmly believed — and then it wasn’t borne out by the data. The question then became: Was it a bad theory? Or was it bad data? … My perception was they were hung up trying to understand the results.”

[Renegade]

It took additional peer review after peer review and 3 years for this paper to correct a "minor" error that resulted in the exact opposite conclusion.

http://www.zerohedge...e-socially-withdrawn

When your conclusions are the exact opposite of reality, there might just be a tiny wee bit of bias there.

[IainB]

^^ Ouch! That "research" is really priceless Renegade. I hadn't read about that before. What a doozy.   
It's more like something out of The Onion. Thanks for posting it. The comments after the item linked to are pretty good too - worth a read.
Now this thread may have to be Basemented because it is "political".
At least it offers a potential explanation to help me to understand why I never could understand the rationale of American politics - it's apparently because it could well be a product of completely screwed-up thinking. Finally, there might be a palpable explanation of the drivers behind the seeming self-assertive "rightness", narcissistic virtue-signaling and vehemence and violence of so-called "liberal-progressive" groups. I never could figure that out. I thought I must be apathetic by comparison.

By the way, I am going to be the first - or one of the first - of many recommending that you be burnt at the stake for documenting something that is so clearly wrong and heretical. It will absolutely have to be officially refuted by government mandate and anybody who argues otherwise must be slung into prison for offences against the greater good, or something.

[Renegade]

Yeah, just a tiny bit political. Meh... Nothing wrong with science done right, even if it is uncomfortable.

And speaking of the Basement, I posted an interview with another heretic: Dr. Judith Curry.

Time for me to get back to my re-education classes. Had too much to think today, so I'll probably get detention.

[IainB]

Time for me to get back to my re-education classes. Had too much to think today, so I'll probably get detention.
____________________

-Renegade (June 13, 2016, 04:02 PM)

What?! You still here Renegade? I'd thought I'd ordered my minions to have you carbonised.

[IainB]

@Renegade: posted above about "the replication crisis" affecting psychology - psychological research/education. It seems that, in general, a lot (or the majority) of such research suffers from being unable to be replicated to prove the conclusions of the research.

(Falsifiability or refutability is the property of a statement, hypothesis, or theory whereby it could be shown to be false if some conceivable observation were true. In this sense, falsify is synonymous with nullify, meaning not "to commit fraud" but "show to be false". Science must be falsifiable.)

-IainB (June 05, 2016, 06:29 PM)

There is a damning analysis about this issue that I read today at Statistical Modeling, Causal Inference, and Social Science, entitled What has happened down here is the winds have changed

It is "Posted by Andrew on   21 September 2016, 9:03 am".
Extract: (Copied below sans embedded hyperlinks/images.)

...In short, Fiske doesn’t like when people use social media to publish negative comments on published research. She’s implicitly following what I’ve sometimes called the research incumbency rule: that, once an article is published in some approved venue, it should be taken as truth. I’ve written elsewhere on my problems with this attitude—in short, (a) many published papers are clearly in error, which can often be seen just by internal examination of the claims and which becomes even clearer following unsuccessful replication, and (b) publication itself is such a crapshoot that it’s a statistical error to draw a bright line between published and unpublished work. ...

The author then goes on to draw together the unfolding documented history that progressively warned about this "crisis" - a crisis which has now apparently become painfully self-evident and the hard light of scrutiny is starting to disinfect it. No amount of supportive bad research and/or so-called "peer review" has been able to conceal the sad reality that psychology seems unable to meet the necessary scientific rigours of falsifiability.

Notice that the blog is entitled Statistical Modeling, Causal Inference, and Social Science. I would suggest that if "Social Science" and/or social scientists are unable to meet the necessary scientific rigours of falsifiability in their research, then why bother to hold them to that standard? I mean by that that they are merely demonstrating conclusively for all to see that they are not a "science" in any true sense (QED). If they were, then they would be able to meet the requisite scientific standard of falsifiability (QED) - that would seem to be the acid test to distinguish science from fakery.

acid test
· n. a conclusive test of success or value.
– ORIGIN figuratively, from the original use denoting a test for gold using nitric acid.
Concise Oxford Dictionary (10th Ed.)

[Renegade]

What?! You still here Renegade? I'd thought I'd ordered my minions to have you carbonised.

-IainB (June 14, 2016, 10:20 AM)

I was. I escaped. The truth set me free.

For your last post, I think we both know that science is merely a political tool now. It's been co-opted.

There is hope though.

[wraith808]

There is hope though.

-Renegade (November 04, 2016, 11:51 PM)

...in Politics!

[IainB]

@Renegade: Yes, you are probably correct, sad to say. Science seems to have become a paid political tool, as Eisenhower warned was a potential. Science students are not being empowered/enabled to think rationally about truth for themselves - the opposite seems to be the objective.
And it's not just science, by all reports. It's a decline across American education. There's a rather interesting take on it here (about US universities): The Decline and Fall of History

Edit: The speaker in the YouTube video (above) is one Niall Campbell Ferguson. He is the Laurence A. Tisch Professor of History at Harvard University. He is also a Senior Research Fellow of Jesus College, University of Oxford.

[IainB]

Quite by coincidence, I came across this amazing abstract posted at Real Peer Review (click on link), based on research by a Jennifer Nash  - she's apparently a Harvard colleague of Prof. Niall Ferguson's, and is an Associate Professor at Northwestern University. She probably makes the points raised by Prof. Fergusson, but even more emphatically illustrates those points, substantiating them with prima facie evidence. Judging by the abstract, she certainly gets to the bottom of things in her research and her thinking. Highly commendable in a researcher.

[Renegade]

More corruption in the world of "science"? Of course!

http://ottawacitizen...ke-research-for-cash

Owner of Canadian medical journals publishes fake research for cash

The new owner of two prominent chains of Canadian medical journals is publishing fake research for cash, and pretending it is genuine.

More depression at the link.

[Renegade]

Not the same as the above general critiques of peer review, but examples of way beyond simple insanity... articles so utterly disconnected from reality... People are "peer reviewing" absolute drivel. Then publishing it.

FAIR WARNING: You will likely lose a few IQ points, soil yourself, and spend the better part of an hour vomitting if you click on either of these links.

http://link.springer...1057/9780230801301_3

http://www.tandfonli...07491409.2012.724524

[IainB]

^^ Depressing and breathtakingly moronic.
I know, I know. I should have taken your warning and not clicked.   

Looking on the positive side though, at least the Internet has enabled the authors an avenue to freely express themselves and publish that expression - which, I guess is what it's probably all about in both cases. Sort of "Self-actualisation" - maybe even cathartic "baggage-release".

[Renegade]

Sure, they may get their rocks off, but it's still garbage science. And it's peer reviewed.

Humanity is doomed at this rate. Hunker in.