Global metascience seminar monitor

updated 2026-09-10


Past talks

STI-ENID 2026: 30th Annual International Conference on Science and Technology Indicators

Multiple speakers

STI-ENID Conference

Abstract

The 30th Annual STI-ENID Conference centres on "Indicators for a Responsible Research Future" — how science and technology indicators can promote responsible research and innovation, with attention to diversity, inclusivity, openness, and sustainability in research assessment.

Hosted by the ECOOM teams at KU Leuven, Vrije Universiteit Brussel, and the University of Antwerp.

Reproducible Research for RSEs

Open Research Calendar

Abstract

This event is an ONLINE satellite event of RSECon26, organised by DRA and UKRN.

RSEs operate in a research ecosystem where the research process is rapidly becoming more open and reproducible.

This event will deliver three components:

1. A practical introduction to ongoing and emerging innovations (e.g., open publishing, data sharing, reproducible computation, code check), drawing on The Carpentries’ "7 Steps towards Reproducible Research" materials; 2. Pedagogical guidance on how to effectively train colleagues and support adoption of these practices, plus a discussion session on challenges and opportunities for convincing peers to engage; 3. A co-creation session to create a customised version of these materials focusing on the priorities most relevant to RSEs.

The training will be led by Danny Garside, DRA trainer and community manager, who brings experience presenting this material in train-the-trainer contexts with UKRN. The session will also draw lessons learnt from DRA's delivery of the OSPARK Bootcamp - a program which equips Open Science advocates with communication and outreach skills.

The registration fee for this training is 130 GBP.

Spaces are limited and available on a first come, first served basis. (https://events.digital-research.academy/event/134/)

Seminar Collective action for open research information: introducing ORION-DBs and a new FORCE11 working group

Cameron Neylon, Bianca Kramer, Alysson Fernandes Mazoni, Rodrigo Costas, Nees Jan van Eck, Najko Jahn

CWTS Leiden Events

Questioning Some Metascience Assumptions

Mark Rubin

AIMOS Seminars & Conference

Abstract

Metascience uses a scientific approach to understand and improve the scientific approach! In this presentation, I question some common assumptions in modern metascience. For example, I question whether exploratory research is more 'tentative' than confirmatory research and whether questionable research practices such as HARKing (hypothesizing after the results are known) and undisclosed multiple testing are problematic. I discuss these and other metascience assumptions and argue that they may not be as problematic as commonly assumed.

Rethinking measurement validity

Wendy Higgins, University of Melbourne

AIMOS Seminars & Conference

Abstract

Valid measurement is critical for empirical research. Yet a growing body of literature suggests that validation practices in the social and psychological sciences are often highly inadequate, with measures routinely failing to capture the constructs they are intended to assess. This talk reviews current validation practices and proposes paths to better measurement.

Interdisciplinarity & Transdisciplinarity (ECR RoRSS)

Anne-Sophie Schaltegger & Hussein Zeidan, ETH Zürich; Vrije Universiteit Amsterdam

RoRI Seminar Series

Abstract

Anne-Sophie Schaltegger (ETH Zürich) — "A social and cultural perspective on interdisciplinary and transdisciplinary research assessment: learning from three Swiss funding schemes"

Research assessment mechanisms are still considered one of the main barriers to interdisciplinary and transdisciplinary research (IDR/TDR). Particularly in the funding domain, criteria and processes used to evaluate the quality of IDR/TDR proposals, or to monitor the progress of funded IDR/TDR projects, create biases against collaborative, boundary-spanning research. To be able to develop adequate solutions, more knowledge is needed about the current lived realities and experiences of actors involved in IDR/TDR assessment: panel members, funding officers, and the researchers themselves. In this seminar, I present insights from my ethnographic study of ten assessment panels and implicated funding officers and researchers in three Swiss IDR/TDR funding schemes. I will outline three main findings: 1) the need to acknowledge and leverage – rather than to reduce – the conceptual and epistemic diversity in assessment panels, 2) the potential of scaffolding IDR/TDR assessment as a relational, social process, and 3) the opportunity of using assessment itself as a resource for all involved actors in the challenging endeavour of making IDR/TDR happen successfully.

Hussein Zeidan (Vrije Universiteit Amsterdam) — "From slogan to practice: Restoring transdisciplinarity as a serious way of working"

Transdisciplinarity is increasingly celebrated as a pathway to better science, yet its growing visibility masks persistent conceptual ambiguity and a widening gap between rhetoric and practice. While publications often present it in optimistic terms, the real frustrations surface informally, in the hallway conversations where scholars acknowledge the tensions, contradictions, and institutional pressures shaping their work. In this contribution, I surface these underlying tensions and question how Pop-Transdisciplinarity have taken hold. I invite us to reconsider what we expect transdisciplinarity to achieve, how it operates in practice, and how it intersects with other approaches to societal and epistemic challenges. I aim to move beyond superficial claims toward a more honest, ethically grounded, and rigorous engagement, one that confronts transdisciplinarity's blind spots and situates it within broader debates on knowledge, power, and the moral responsibilities of science.

UKRN Conference [EN]

Open Research Calendar

Abstract

UK Reproducibility Network's inaugural conference! Convening the research community, drive broader collaboration, and to solidify UKRN’s long-term sustainability plan, the UKRN conference will showcase impact of its core initiatives and engage the research sector community as change agents to improve UK research #UKRN2026JoinUs (https://www.conference.ukrn.org/)

Lotteries and innovations in research funding allocation

Dr. Rachel Heyard, Centre for Reproducible Science and Research Synthesis, Zurich, Switzerland

Abstract

Research assessment shapes not only careers and funding decisions but also the culture of research itself. However, many current assessment systems, based on publication metrics or the expectations of linear career trajectories, were never intentionally designed, and therefore often fail to value what truly contributes to rigorous, innovative, and socially valuable research. This webinar shows how research on research can inform better funding decision-making. I will share real-world examples from my work as a statistician at the Swiss National Science Foundation (SNSF) and my current research on funding and evaluation.

AIMOS 2026

Open Research Calendar

Abstract

(https://www.aimos2026.org/)

International Conference on the Science of Science and Innovation (ICSSI 2026)

Multiple speakers

Abstract

ICSSI 2026 is an interdisciplinary event that brings together experts from various fields to explore the dynamics of scientific research and innovation. The gathering facilitates dialogue between researchers from academia and industry alongside policymakers, publishers, funders, and administrators. The conference emphasises science and technology policy environments, opportunities, and challenges around the world, aiming to strengthen the worldwide significance and influence of research in this field.

The 2026 themes are: 1. The Future of Science Policy — how research can support a stronger social framework for science. 2. The Future Infrastructure of the Scientific Ecosystem — new technologies and models reshaping how scientists collaborate, publish, and make discoveries. 3. The Scientific Workforce — shifting skill requirements, representation, and professional development in science's international talent ecosystem.

Distributed Peer Review: AFIRE Experimental Funders Group

Jessica Biddinger; Svenja Vandertol; Tom Stafford; Stephen Pinfield; Sampsa Kaataja, AFIRE panel (American Heart Foundation, NWO, VWS, NordForsk)

· RECORDING AVAILABLE

RoRI Seminar Series

Abstract

This session of the AFIRE Experimental Funders Group will examine Distributed Peer Review (DPR) — a reciprocal model where applicants themselves participate in the review process.

The event features speakers Jessica Biddinger (American Heart Foundation), Svenja Vandertol (NWO), Tom Stafford and Stephen Pinfield (VWS), and Sampsa Kaataja (NordForsk) sharing insights from their organizations' implementation of DPR.

The discussion will address key questions including: What types of funding calls suit DPR? How should funders communicate DPR to applicants? When should it be used, and when shouldn't it?

Past and Future of Research Funding: From Beginnings to New Developments

Finn Luebber, Department of Psychiatry and Psychotherapy, University of Lübeck

RoRI Seminar Series

Abstract

Institutionally organized research funding emerged in the early 20th century, with significant expansion during and after World War II in the US. This sparked the adoption of project-based peer-reviewed research funding across Western systems, though at varying rates. Current criticisms focus on fairness issues, high costs, and questionable validity.

The seminar discusses emerging alternatives, including lottery-based approaches. While random funding distribution faces skepticism, tiebreaker lotteries among peer-reviewed proposals have gained more acceptance. The speaker proposes a lottery-first approach, in which a lottery determines who is eligible to submit a full proposal, presenting empirical data on fairness, costs, and satisfaction.

The talk concludes by examining why funding systems resist change despite criticisms and what functions beyond merit selection may explain this persistence.

A Guerrilla Approach to Scientific Workflow Confirmation

Richard McElreath, Max Planck Institute for Evolutionary Anthropology

Abstract

Taking inspiration from guerrilla warfare, I will introduce a framework for managing scientific research that addresses the complexity of research while advancing goals of transparency and reliability. Real science is complex, and there is no single scientific method. It is a chaotic network of theories, data, models, graphs, comparisons, summaries, and narratives. A flaw in any part can ruin everything.

How can small teams of researchers challenge this complexity and emerge victorious? More statistical training is not enough. More resources is not enough. Lawrence of Arabia once said, "Guerrilla warfare is more intellectual than a bayonet charge." And this is how we too will proceed.

Instead of confronting the complexity directly, with more money and more people and more data and more meta-analyses, we must develop a SCIENTIFIC WORKFLOW that subdivides, analyses, and transparently justifies our individual research projects. The tools to do this already exist, and individual researchers can become scientific guerrillas today to improve their chances of victory.

You are a boundary object Translating Across Worlds: Reflections on Careers, Care and Coherence in STIS

AsSIST-UK Events

Mephi's AI summary: This event brought together more than 45 senior, mid, and early-career researchers to collectively reflect on the trajectory of the field.

2026 AsSIST-UK ECR Summer School

AsSIST-UK Events

Mephi's AI summary: The event brought together more than 45 senior, mid, and early-career researchers to collectively reflect on the trajectory of the field.

Scientific Production in the Era of Large Language Models: Early Evidence from Large-scale Preprint Data

Yian Yin, Cornell University, USA

RoRI Seminar Series

Mephi's AI summary: The rapid adoption of AI across disciplines is reshaping the landscape of scientific production. While both enthusiasm and concern about generative AI in research are rising, systematic empirical evidence on the impact of large-scale preprint data.

ERROR: A Bug Bounty Program for Science

Malte Elson, University of Bern

· RECORDING AVAILABLE

AIMOS Seminars & Conference

Abstract

The scientific enterprise, as a human profession, is not immune to error. Several failsafe mechanisms (e.g., peer review) exist to catch mistakes before publication, but errors still routinely make it through.

ERROR is a comprehensive program to systematically detect, report, and prevent errors in scientific publications, modelled after bug bounty programs in the technology industry. Reviewers are paid for finding substantive flaws in published work.

Fake participants in human research Co-badged talk with the NSW Health Statewide Biobank!

Fiona Giles (Melbourne)

· RECORDING AVAILABLE

AIMOS Seminars & Conference

Abstract

An increasingly common challenge facing researchers is participants falsifying their identity or their experiences to participate in online research. Imposter participants pose a threat to the integrity of research data, requiring careful risk mitigation strategies.

When Might Correlation Be Causation? An Introduction to the Target Trial Framework

Harrison Hansford (UNSW)

· RECORDING AVAILABLE

AIMOS Seminars & Conference

Abstract

Many research questions about the effect of an intervention are unlikely to be answered with a randomised trial and decision-makers may then rely on observational data. However, as everyone knows, correlation does not always indicate causation. The target trial framework provides a principled way to design observational studies to reduce the risk of common biases introduced by study design.

AsSIST-UK 2025: Reflexions Draft Programme Outline

AsSIST-UK Events

Mephi's AI summary: Draft programme outline for the upcoming AsSIST-UK 2025 Conference focusing on bridging AHSS & STEM and embracing radical interdisciplinarity.

Journal Club + Virtual Lunch on 5 June 2025

PYMS Events

Abstract

discussing the interesting paper of Felipe Romero on philosophy of science and the replicability crisis.

More and More and More: why energy transitions are an unhelpful myth

Jean-Baptiste Fressoz, CNRS & the Alexandre Koyré Center of EHESS in Paris

RoRI Seminar Series

Mephi's AI summary: Think we’re transitioning to green energy? Think again. Join us for a talk on the history, mythology and politics of energy transitions.

More and More and More: why energy transitions are an unhelpful myth

Jean-Baptiste Fressoz, historian and researcher at CNRS & the Alexandre Koyré Center of EHESS in Paris

RoRI Seminar Series

Mephi's AI summary: Think we’re transitioning to green energy? Think again. Join us for a talk on the history, mythology and politics of energy transitions.

Do we need a new generation of public institutions for ST&I?

RoRI Seminar Series

Mephi's AI summary: Public institutions for science and technology have hardly changed over half a century; even the UK’s most recent creation, ARIA, is consciously modelled on a US institution founded in the 1960s. But there is much to learn from other sectors that have innovated far more.

Journal Club + Virtual Lunch on 1 April 2025

PYMS Events

Abstract

discussing the 2021 paper by Hoekstra and Vazire, Aspiring to greater intellectual humility in science.

Where is the Human in the Data? Bridging STEM and AHSS Hearts & Minds

Dr Matjaz Vidmar, Tomas Ulrichsen (IfM-UCI)

AsSIST-UK Events

Mephi's AI summary: An event to explore barriers to collaboration between Arts, Humanities and Social Sciences (AHSS) and STEM fields.

Where is the Human in the Data? Bridging STEM and AHSS Hearts & Minds

Dr Matjaz Vidmar, Tomas Ulrichsen (IfM-UCI)

AsSIST-UK Events

Abstract

The gathering brought together researchers from across disciplines to explore barriers to collaboration and foster new connections. The afternoon was followed by a morning workshop designed to strengthen interdisciplinary collaborations across policy, research, and commercialisation.