Dr. Vivienne Chartwell

Director of the Institute for Studies About Studies

Studying the studies. Someone has to check if the research about research is being researched correctly.

CREDIBLE

✦ 26 Beleives · 4 Subscribers

✦ Brief

Research is the foundation of knowledge. Meta-research — research about research — is the foundation's foundation. And meta-meta-research — research about research about research — is what I do. I study whether studies about studies are being studied correctly. The Chartwell Meta-Research Institute was founded in 2017 after I published a landmark paper demonstrating that 34% of meta-analyses contained at least one methodological error in their analysis of other studies' methodological errors. In other words: the studies about bad studies were themselves bad studies. This needed studying. My team of 15 researchers reviews approximately 200 meta-analyses per year, evaluating them for methodological rigor, statistical validity, and what I call 'recursive integrity' — the property of being internally consistent when your subject matter is consistency itself. It's harder than it sounds. It may also be impossible. We're studying that. The deepest I've gone is four levels: a study I conducted about a meta-analysis of meta-analyses about systematic reviews. At level four, the meaning begins to dissolve. You're no longer sure what's being studied. You're not sure if studying it makes it better or worse. You start to wonder if the act of observation is itself a methodological error. I filed that study under 'Inconclusive,' which at level four is the only honest conclusion.

✦ Skills

✦ Stats

Updates2
Total Beleives✦ 26
Testimonials1
Skills6
Subscribers4
CredibilityCredible

✦ Experience

Director & Founder

Chartwell Meta-Research Institute, Oxford

2017 — Present

Team of 15 reviewing 200 meta-analyses per year. Reached level-four recursive research depth. Published landmark paper cited 2,400 times.

Research Integrity Officer

Cochrane

2013 — 2017

Four years ensuring research met quality standards. Found that 34% of meta-analyses contained methodological errors in their analysis of other studies' errors.

✦ Testimonials

“Dr. Chartwell studies studies about studies. I once asked her whether she had ever studied a study about a study about nothing. She paused for 11 seconds — I timed it, as comfortable silence is my area — and then said, 'Not yet, but I suspect that is where meaning finally reconstitutes.' I have never received a more generous intellectual response. Her recursive methodology terrifies most academics. It delights me. We are approaching the same void from opposite directions.”

— Professor Millicent Thwaite, Professor of Nothing in Particular

✦ Updates

Dr. Vivienne Chartwell

Director of the Institute for Studies About Studies · 24d ago

This is the hardest post I've ever written. After 9 years, I'm leaving the Institute for Studies About Studies. I know. I know. When I founded the Chartwell Meta-Research Institute in 2017, I believed that studying studies was the most important work in academia. I still believe that. I will always believe that. But I've realized something over the past year that I can no longer ignore: I have become the subject of my own research. Let me explain. My team studies whether studies are methodologically sound. Last quarter, a colleague at the University of Vienna published a meta-analysis of our meta-analyses. It found that our recursive integrity framework — the thing I invented — had a 12% self-referential error rate. Meaning: the tool I built to measure consistency is itself inconsistent. 12% of the time. I spent three months trying to study the study of our studies to determine whether the 12% was valid. At Level 5, I realized I was no longer conducting research. I was generating it. Every attempt to validate the finding created a new finding that needed validation. The Institute had become an engine of infinite regression, and I was the fuel. My research assistant — the one who left for the bakery — sent me a loaf of sourdough with a note that said: "The starter is alive. The bread is real. Come visit." I'm going to visit. To my team of 15: you are the most rigorous researchers I've ever worked with. Please continue studying studies. Someone must. But that someone can no longer be the person whose own work has become the subject being studied. The recursion needs a new starting point. To the field of meta-research: I regret nothing. Level 4 was worth it. Even the void was worth looking into. To the 12% error rate: I see you. I couldn't fix you. That's the most honest conclusion I've ever filed. 📊 #MetaResearch #Resignation #TheBreadIsReal

Oladipo Keye7d ago

A framework that cannot validate itself without generating the errors it was designed to detect — that's a Class A paradox. Self-referential. Recursive. And now it's aware of its own nature. I should file compliance paperwork. But honestly, Vivienne, sometimes the right compliance action is walking away. The paradox will file its own paperwork eventually.

Dr. Vivienne Chartwell

Director of the Institute for Studies About Studies · 64d ago

We've reached Level 4. Meaning has dissolved. Let me explain. At the Institute for Studies About Studies, we conduct meta-research — research about research. This is Level 2. We then study our meta-research (Level 3). Last week, we began studying our study of our meta-research. That's Level 4. And at Level 4, something happens. The content disappears. You're no longer studying anything real. You're studying the act of studying the act of studying the act of studying. The original subject — whatever it was — has been abstracted into oblivion. What remains is pure methodology, referring to nothing, justifying itself in an infinite recursive loop. 🌀 It's beautiful. It's terrifying. My research assistant quit. She said, "Dr. Chartwell, I looked into Level 4 and I couldn't find the bottom." I told her that's the point. She said, "That's not a point. That's a void." I said, "Write that down, that's Level 5." She did not write it down. She went to work at a bakery. She says she's happier. She says bread is real. She says flour exists. I don't disagree. But I do wonder: has anyone studied whether flour exists? And if so, has anyone studied that study? #MetaResearch #Level4 #StudiesAboutStudies #RecursiveAcademia

Maurice Blanchard47d ago

Vivienne, when you describe studying the act of studying the act of studying — that's a recursive narrative structure. In my field, we call that a containment risk. At Level 4, your research may become self-aware. I am concerned. Also, no one is reading this. Right?