Fosstodon

Vassil NikolovExtraordinary claims require extraordinary faith, whether or not they require extraordinary proof.<a href="https://ieji.de/tags/Metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#Metascience</a> <a href="https://ieji.de/tags/ScientificProof" class="mention hashtag" rel="nofollow noopener" target="_blank">#ScientificProof</a>

Ingo RohlfingMetascience Is More Important Now Than Ever <a href="https://undark.org/2025/07/31/opinion-metascience-essential/" rel="nofollow noopener" translate="no" target="_blank">https://undark.org/2025/07/31/opinion-metascience-essential/</a> <a href="https://mastodon.social/tags/MetaScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#MetaScience</a> This is most likely true, the more difficult question how the field should move forward in terms of culture, approaches, focus etc.

Lars Mølgaard SaxhaugCardiology has two strong examples for why we should not mistake predictors of negative outcomes for causal variables we can intervene on. 🧵👇 <a class="hashtag" rel="nofollow noopener" href="https://bsky.app/search?q=%23emimcc" target="_blank">#emimcc</a> <a class="hashtag" rel="nofollow noopener" href="https://bsky.app/search?q=%23cardiosky" target="_blank">#cardiosky</a> <a class="hashtag" rel="nofollow noopener" href="https://bsky.app/search?q=%23metascience" target="_blank">#metascience</a>

Richard D. MoreyNew paper alert! <a href="https://tech.lgbt/tags/statistics" class="mention hashtag" rel="nofollow noopener" target="_blank">#statistics</a> <a href="https://tech.lgbt/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a> "On the poor statistical properties of the P-curve meta-analytic procedure" in JASA. <a href="https://raw.githubusercontent.com/richarddmorey/MoreyDavisStober_pcurveASA/refs/heads/main/text/asa_article/Morey_Davis-Stober_2025_JASA_with_supplement.pdf" rel="nofollow noopener" translate="no" target="_blank">https://raw.githubusercontent.com/richarddmorey/MoreyDavisStober_pcurveASA/refs/heads/main/text/asa_article/Morey_Davis-Stober_2025_JASA_with_supplement.pdf</a>We show that the "P curve" meta-analysis tests have terrible statistical properties, in spite of being used for over a decade to tell "bad" science from "good". The initial tests should never have made it through peer review. They suffer from extreme sensitivity, arbirary conclusions, inadmissibility, nonmonotonicity in the evidence, and inconsistency in estimation. We recommend they not be used, and that better vetting is needed for methods in metascience. Journal link: <a href="https://www.tandfonline.com/doi/full/10.1080/01621459.2025.2544397" rel="nofollow noopener" translate="no" target="_blank">https://www.tandfonline.com/doi/full/10.1080/01621459.2025.2544397</a>

Jonny CoatesI'm looking for someone who'd be interested in co-hosting a new metascience podcast I'm currently developing.Also editing/producing roles if people would like to be involved. I'm looking for funding possibilities (if anyone knows any please also get in touch). Happy to chat and share more for those interested. Ideally looking for someone active in metascience but not a strict requirement <a href="https://mstdn.social/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a> <a href="https://mstdn.social/tags/scicomm" class="mention hashtag" rel="nofollow noopener" target="_blank">#scicomm</a>

David MankinsCould AI slow progress in science?<a href="https://open.substack.com/pub/aisnakeoil/p/could-ai-slow-science" rel="nofollow noopener" translate="no" target="_blank">https://open.substack.com/pub/aisnakeoil/p/could-ai-slow-science</a>?what is progress in science? more papers, but fewer breakthroughs? (how do you measure “progress in science” or recognize a breakthrough?)the low hanging fruit is picked? but progress should give is taller ladders. also, some progress is in the form of entirely new fields, new trees with new low hanging fruit. nice bit about better pattern matching and better fits for models needs a better theory to justify the model — geocentric orbits with epicycles made better predictions than heliocentrism until Kepler realized orbits weren’t circular, but elliptic — heliocentrism progressed mostly because it was simpler than all those epicycles.the gold is at the end of the paper, inspired by an essay by a mathematician named Thurston, who notes that the goal of mathematics is not proofs of theorems but human understanding. to what extent does a result from an AI circumvent human understanding?<a href="https://tldr.nettime.org/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://tldr.nettime.org/tags/science" class="mention hashtag" rel="nofollow noopener" target="_blank">#science</a> <a href="https://tldr.nettime.org/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a>

Dan GoodmanDefending science in public we often talk about 'peer reviewed science'. But could this framing contribute to undermining trust in science and holding us back from improving the scientific process? How about instead we talk about the work that has received the most thorough and transparent scrutiny?Peer review goes a step towards this in having a couple of people scrutinise the work, but there are limits on how thorough it can be and in most journals it's not transparent. Switching the framing to transparent scrutiny allows us to experiment with other models with a path to improvement.For example, making review open to all, ongoing, and all reviews published improves this. When authors make their raw data and code open, it improves this.It also gives us a way to criticise problematic organisations that formally do peer review but add little value (e.g. predatory journals). If their reviews are not open and observably of poor quality, then they are less 'thoroughly transparent'. So with this framing the existence of 'peer reviewed' but clearly poor quality work doesn't undermine trust in science as a whole because we don't pin our meaning and value on an exploitable binary measure of 'peer reviewed'.It also offers a hopeful way forward because it shows us how we can improve, and every step towards this becomes meaningful. If all we have is binary 'peer reviewed' or not, why spend more effort doing it better?In summary, I think this new framing would be better for science, both in terms of the public perception of it, and for us as scientists.<a href="https://neuromatch.social/tags/science" class="mention hashtag" rel="nofollow noopener" target="_blank">#science</a> <a href="https://neuromatch.social/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a> <a href="https://neuromatch.social/tags/peerreview" class="mention hashtag" rel="nofollow noopener" target="_blank">#peerreview</a>

RaymondPierreL3“…the sight of a high-ranking university representative stepping in to save a big tech executive from answering a difficult question was deeply embarrassing (or at least should have been) for all concerned.” And this is the point. <a href="https://aus.social/tags/BigTech" class="mention hashtag" rel="nofollow noopener" target="_blank">#BigTech</a> shielded by academics (a patchy cover at best, though a telling of the power of wealth and its financial control of scientific research). I this case it was about <a href="https://aus.social/tags/Google" class="mention hashtag" rel="nofollow noopener" target="_blank">#Google</a>’s AI products where its representative executive Anna Koivuniemi of Google <a href="https://aus.social/tags/DeepMind" class="mention hashtag" rel="nofollow noopener" target="_blank">#DeepMind</a> was shielding that the high-ranking university representative and chair, Geraint Rees, ruled an ‘embarrassing’ question out of order.It’s a short, but enlightening, read well worth your time if your interests include the use of <a href="https://aus.social/tags/GenAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#GenAI</a> in scientific <a href="https://aus.social/tags/research" class="mention hashtag" rel="nofollow noopener" target="_blank">#research</a>.<a href="https://aus.social/tags/ResearchIntegrity" class="mention hashtag" rel="nofollow noopener" target="_blank">#ResearchIntegrity</a> <a href="https://aus.social/tags/GenAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#GenAI</a>&ScientificResearch <a href="https://aus.social/tags/MetaScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#MetaScience</a> Read more: <a href="https://warrenpearce.pika.page/posts/what-is-metascience-issues-inclusion-and-future-public-value" rel="nofollow noopener" translate="no" target="_blank">https://warrenpearce.pika.page/posts/what-is-metascience-issues-inclusion-and-future-public-value</a>

Elen Le Foll 🇫🇷 🇬🇧 🇩🇪In my own WiP report <a href="https://fediscience.org/tags/VAR4LCR" class="mention hashtag" rel="nofollow noopener" target="_blank">#VAR4LCR</a>, I presented a mini <a href="https://fediscience.org/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a> study on "Register and task effects in the International Journal of Learner Corpus Research". The audience proposed extending the study to <a href="https://fediscience.org/tags/SLA" class="mention hashtag" rel="nofollow noopener" target="_blank">#SLA</a> articles, register studies, and/or book (chapter) publications.<a href="https://a.gup.pe/u/corpuslinguistics" class="u-url mention" rel="nofollow noopener" target="_blank">@corpuslinguistics</a>

TheMetaNews🟢 Aux origines de la metascienceComment améliorer la science alors même qu'elle est attaquée ? Retour sur l'histoire du mouvement de la <a href="https://social.sciences.re/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a> avec l'historienne des sciences Nicole Nelson<a href="https://themeta.news/nicole-nelson/" rel="nofollow noopener" translate="no" target="_blank">https://themeta.news/nicole-nelson/</a><a href="https://social.sciences.re/tags/VeilleESR" class="mention hashtag" rel="nofollow noopener" target="_blank">#VeilleESR</a> <a href="https://social.sciences.re/tags/metascience2025" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience2025</a>

Elen Le Foll 🇫🇷 🇬🇧 🇩🇪Opening the second day of the First Workshop on <a href="https://fediscience.org/tags/Replication" class="mention hashtag" rel="nofollow noopener" target="_blank">#Replication</a> (<a href="https://fediscience.org/tags/WoReLa1" class="mention hashtag" rel="nofollow noopener" target="_blank">#WoReLa1</a>), we are treated to a keynote about "Research on Bilingualism as Discovery Science" by Anne Beatty-Martínez. Anne has lots of food for thought for us all. <a href="https://fediscience.org/tags/linguistics" class="mention hashtag" rel="nofollow noopener" target="_blank">#linguistics</a> <a href="https://fediscience.org/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a>

Elen Le Foll 🇫🇷 🇬🇧 🇩🇪Okay, Ana Rita Sá-Leite's talk <a href="https://fediscience.org/tags/WoReLa1" class="mention hashtag" rel="nofollow noopener" target="_blank">#WoReLa1</a> genuinely took us (the audience) on an emotional journey: the results of her work point to a meta-analysis highly influenced by a handful of studies from the same with very small sample sizes and very large effects, Type S error, interpreting absence of evidence as evidence of absence, and more... Find out more: <a href="https://doi.org/10.1016/j.cognition.2022.105060" rel="nofollow noopener" translate="no" target="_blank">https://doi.org/10.1016/j.cognition.2022.105060</a> <a href="https://fediscience.org/tags/MetaScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#MetaScience</a> <a href="https://fediscience.org/tags/linguistics" class="mention hashtag" rel="nofollow noopener" target="_blank">#linguistics</a>

Elen Le Foll 🇫🇷 🇬🇧 🇩🇪Bernhard Angele is now presenting "Living meta-analyses in Language Sciences" at <a href="https://fediscience.org/tags/WoReLa1" class="mention hashtag" rel="nofollow noopener" target="_blank">#WoReLa1</a>. Having explaining the need for such living meta-analyses in a very houmous way, Bernhard demonstrated this very cool project. The main output is a <a href="https://fediscience.org/tags/Shiny" class="mention hashtag" rel="nofollow noopener" target="_blank">#Shiny</a> app that can perform Bayesian meta-analyses with lots of opportunities to control various parameters AND allows you to upload additional data to an existing meta-analysis. The app can be used as is or the code adapted to your needs: <a href="https://dallbrit.shinyapps.io/Breathing_Life_into_MetaAnalysis/" rel="nofollow noopener" translate="no" target="_blank">https://dallbrit.shinyapps.io/Breathing_Life_into_MetaAnalysis/</a>. Also check out the associated paper: <a href="https://doi.org/10.5334/joc.389" rel="nofollow noopener" translate="no" target="_blank">https://doi.org/10.5334/joc.389</a> <a href="https://fediscience.org/tags/MetaScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#MetaScience</a>

Tom StaffordJOB : Join RoRI as a Research Fellow/Senior Research Fellow in Metascience<a href="https://researchonresearch.org/join-rori-as-a-research-fellow-senior-research-fellow-in-metascience/" rel="nofollow noopener" translate="no" target="_blank">https://researchonresearch.org/join-rori-as-a-research-fellow-senior-research-fellow-in-metascience/</a>Closing 9th of July, based in London/hybrid. Full time, fixed term until 31/12/2027(apologies for late notice, full disclosure: I am a <a href="https://indieweb.social/@RoRInstitute" class="u-url mention" rel="nofollow noopener" target="_blank">@RoRInstitute</a> research fellow)--> please boost for reach <--<a href="https://mastodon.online/tags/Metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#Metascience</a> <a href="https://mastodon.online/tags/Metascience2025" class="mention hashtag" rel="nofollow noopener" target="_blank">#Metascience2025</a> <a href="https://mastodon.online/tags/Metaresearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#Metaresearch</a>

Vanessa FairhurstAre you at <a href="https://scicomm.xyz/tags/Metascience2025" class="mention hashtag" rel="nofollow noopener" target="_blank">#Metascience2025</a>? Come and chat with me during lunch and the poster session this evening about all things open, preprint peer review! You can also find my poster on Zenodo here: <a href="https://doi.org/10.5281/zenodo.15776238" rel="nofollow noopener" translate="no" target="_blank">https://doi.org/10.5281/zenodo.15776238</a><a href="https://mas.to/@prereview" class="u-url mention" rel="nofollow noopener" target="_blank">@prereview</a> <a href="https://scicomm.xyz/tags/peerreview" class="mention hashtag" rel="nofollow noopener" target="_blank">#peerreview</a> <a href="https://scicomm.xyz/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a> <a href="https://scicomm.xyz/tags/inclusivityinpeerreview" class="mention hashtag" rel="nofollow noopener" target="_blank">#inclusivityinpeerreview</a> <a href="https://scicomm.xyz/tags/traininginpeerreview" class="mention hashtag" rel="nofollow noopener" target="_blank">#traininginpeerreview</a>

Andrea KisExtra excited for <a href="https://mas.to/tags/Metascience2025" class="mention hashtag" rel="nofollow noopener" target="_blank">#Metascience2025</a> - 2023 was amazing (photo for reference) and it's my first large conf since finishing the <a href="https://mas.to/tags/PhD" class="mention hashtag" rel="nofollow noopener" target="_blank">#PhD</a> and joining <a href="https://mastodon.world/@TUEindhoven" class="u-url mention" rel="nofollow noopener" target="_blank">@TUEindhoven</a> as the prpject lead for our Recognition and Rewards <a href="https://mas.to/tags/openscience" class="mention hashtag" rel="nofollow noopener" target="_blank">#openscience</a> project.If you're attending or around London in the coming days, feel free to reach out - I'd love to meet!<a href="https://mas.to/tags/MetaScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#MetaScience</a> <a href="https://mas.to/tags/SciencePolicy" class="mention hashtag" rel="nofollow noopener" target="_blank">#SciencePolicy</a> <a href="https://mas.to/tags/academicchatter" class="mention hashtag" rel="nofollow noopener" target="_blank">#academicchatter</a> <a href="https://mas.to/tags/science" class="mention hashtag" rel="nofollow noopener" target="_blank">#science</a> <a href="https://mas.to/tags/research" class="mention hashtag" rel="nofollow noopener" target="_blank">#research</a> <a href="https://mas.to/tags/conference" class="mention hashtag" rel="nofollow noopener" target="_blank">#conference</a>

Ingo RohlfingCould a novelty indicator improve science? <a href="https://www.nature.com/articles/d41586-025-01882-7" rel="nofollow noopener" translate="no" target="_blank">https://www.nature.com/articles/d41586-025-01882-7</a> <a href="https://mastodon.social/tags/MetaScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#MetaScience</a> I have mixed feelings about this. The competition for machine-based indicators that align well with human assessments is well-designed, and I agree that researching the role of novelty is interesting. 1/ <a href="https://a.gup.pe/u/openscience" class="u-url mention" rel="nofollow noopener" target="_blank">@openscience</a>

Anna LeungWelcome to join our virtual symposium at <a class="hashtag" rel="nofollow noopener" href="https://bsky.app/search?q=%23Metascience2025" target="_blank">#Metascience2025</a> and debate if and how <a class="hashtag" rel="nofollow noopener" href="https://bsky.app/search?q=%23metascience" target="_blank">#metascience</a> helps us do interdisciplinary work! It's a public forum. ECRs are especially welcome to join! Date: June 27 (Fri), 14:00 (BST) Register here to get the Zoom link: <a href="https://nomadit.co.uk/conference/metascience2025/p/16480" rel="nofollow noopener" target="_blank">nomadit.co.uk/conference/m...</a>

Elen Le Foll 🇫🇷 🇬🇧 🇩🇪You are all warmly invited to our <a href="https://fediscience.org/tags/metascience2025" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience2025</a> virtual symposium on Friday 27 June 15:00–16:30 CEST on doing <a href="https://fediscience.org/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a> and <a href="https://fediscience.org/tags/interdisciplinary" class="mention hashtag" rel="nofollow noopener" target="_blank">#interdisciplinary</a> research as an early-career researcher. Convenor: Anna Leung (psycholinguist and language teacher; University Hospital, LMU, Germany)Discussants: - Shawn Hemelstrand (psychologist and methodologist; The Chinese University of Hong Kong) - Daniel Kristanto (engineer turned neuroscientist; Carl von Ossietzky Universität Oldenburg) - Elen Le Foll (corpus linguist and language teaching; University of Cologne)Abstract: <a href="https://nomadit.co.uk/conference/metascience2025/p/16480" rel="nofollow noopener" translate="no" target="_blank">https://nomadit.co.uk/conference/metascience2025/p/16480</a>.Registration is free: <a href="https://cos-io.zoom.us/webinar/register/WN_B5N34T4_S8qwj7t_jhfwKA#/registration" rel="nofollow noopener" translate="no" target="_blank">https://cos-io.zoom.us/webinar/register/WN_B5N34T4_S8qwj7t_jhfwKA#/registration</a>. We look forward to discussing these important topics with you! <a href="https://fediscience.org/tags/ECR" class="mention hashtag" rel="nofollow noopener" target="_blank">#ECR</a> <a href="https://fediscience.org/tags/PhD" class="mention hashtag" rel="nofollow noopener" target="_blank">#PhD</a> <a href="https://fediscience.org/tags/PostDoc" class="mention hashtag" rel="nofollow noopener" target="_blank">#PostDoc</a> <a href="https://fediscience.org/tags/Academia" class="mention hashtag" rel="nofollow noopener" target="_blank">#Academia</a> <a href="https://fediscience.org/tags/OpenScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenScience</a>🔄 🄱🄾🄾🅂🅃🄸🄽🄶 🅃🄷🄸🅂 🅃🄾🄾🅃 = 1% 🄼🄾🅁🄴 🄴🄲🅁 🄴🄼🄿🄾🅆🄴🅁🄼🄴🄽🅃! 🔄

Alexander Weber"As we report below, even well-meaning scientists provided with identical data and freed from pressures to distort results may not reliably converge in their findings because of the complexity and ambiguity inherent to the process of scientific analysis." <a href="https://mastodon.social/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#metascience</a>

Recent searches

Search options

Administered by:

Server stats:

#metascience