Coordinating Projects using AI-Aided Systematic Screening with ASReview

  • LocationUtrecht
  • Duration84 hours (of which 56 hours of self study)
  • Starting momentStart date will be determined through mutual agreement
  • LanguageEnglish
  • Teaching methodOnline, At location
  • CertificationMicrocredentials, Certificate, Accreditation points
  • Price€4,500
  • ECTS3. EC

This expert-led course will provide you with the necessary knowledge and skills to supervise AI-aided screening projects within your organization. The course includes a globally recognized EduBadge upon completion. Invest in your career and stay ahead in your field.

Course contents

The scientific output of the world doubles every nine years. In this tsunami of new knowledge, imagine the enormous challenge of updating a medical guideline, developing evidence-based treatments, creating unbiased policy recommendations, or scouting for new technologies. There’s not enough time to read everything! Attempts to synthesize state-of-the-art research findings in a particular scientific field therefore are under severe strain; the exponential growth in papers means screening an increasingly larger body of work – resulting in costly, or error-prone work that is often abandoned prematurely. Nevertheless, systematic reviews are pivotal for scholars, clinicians, policymakers, journalists, and, ultimately, the general public.

The rapidly evolving field of Artificial Intelligence (AI) has allowed the development of AI-aided pipelines that assist in finding relevant texts for such search tasks. A well-established approach to increase the efficiency of text screening is screening prioritization via active learning: an interaction between a human screener and a machine learning model which constantly learns from the human and proposes the most likely relevant paper to the human. This method can reduce the number of papers to screen by up to 95%(!) and is easily integrated in popular, active learning text screening software.

Our course prepares the participants for coördinatingprojects which are carried out in the open-source software ASReview.

Target audience

This course is designed for project coordinators, data scientists, information specialists, PhD supervisors and PIs of bigger projects, and others who wish to coördinate AI-aided systematic reviews.

Prior experience with traditional systematic reviews is expected and we assume basic knowlegde of ASReview obtained via, for example, the summer school course or self-study.

Course goal and learning goals

The primary goal of this course is to equip participants with the knowledge and skills required to coordinate AI-aided screening projects using ASReview within their organizations. The course accommodates individual learning objectives and projects, ensuring that upon completion, participants will be able to:

  1. Comprehend the basics of the active learning cycle and the human’s role within the loop;
  2. Understand the components of the active learning model, and learn how to select appropriate training data;
  3. Illustrate how AI-aided screening integrates into the existing pipeline within a particular organization;
  4. Apply the FAIR data principles to the outcomes of an AI-aided systematic review;
  5. Collaborate with the community by participating in related research projects, contribute to the software ecosystem, write about new applications, or generate knowledge in other ways;
  6. Effectively communicate benefits (and pitfalls) of AI-aided systematic reviews to stakeholders.

Costs

€4500 (standard tariff)
€3500 for scientists or (semi) government

Active participation and attendance

We expect active participation and attendance in at least 80% of the sessions. A repair option is available for any incomplete or missed assignments, to ensure participants can meet the certificate requirements.

View the detailed programme below.

PART 1: Theory (22 hours)

Meeting 1 (8 hours)

Meet & greet the other participants + explain the set-up of the course + lecture on the steps of systematic reviewing and where AI-aided screening fits in + differences between software packages + intro on active learning

Optional: Meet the core developers and information experts and join the discussions during the weekly stand-up

Self-study (6 hours)

Read literature + watch instruction videos + exercise in using ASReview LAB

Optional: Try out ASReview LAB with your own dataset

Meeting 2 (2 hours)

Q&A about exercises+ technical lecture on the active learning model

Optional: Join the discussions during the weekly stand-up

Self-study (6 hours)

Exercises in using ASReview-datatools, the simulation mode with the WebApp and Makita Option to work on location

Optional: Join the discussions during the weekly stand-up

Assessment 1

Hand in the answers to the questions in the exercises

PART 2: FAIR data (6 hours)

Meeting 3 (2 hours)

Lecture on responsible use of AI in systematic reviewing, reproducibility and FAIR data principles

Optional: Join the discussions during the weekly stand-up

Self-study (4 hours)

Exercise about reproducing results via the asreview project file (using the ASReview Python API in Jupyter Notebook). Option to work on location

Optional: Join the discussions during the weekly stand-up

Assessment 2

Hand in answers to the exercise

PART 3: From User to Contributor (28 hours)

Meeting 4 (2 hours)

Lecture on open-source workflows + how to create a reproducible workflow via Github + contributing roles

Optional: Join the discussions during the weekly stand-up

Self-study (20 hours)

Contribute to open-source software (ASReview)

Option to work on location, work on your PRs together and receive instant feedback from the engineers.

Assessment 3 (6 hours)

Create at least two Pull Requests

Optional: Join the discussions during the weekly stand-up

PART 4: Implementation (28 hours)

Meeting 5 (2 hours)

Meeting to discuss how to implement AI-aided screening in organizations + lecture on how to create a journey map

Optional: Join the discussions during the weekly stand-up

Self-study (20 hours)

Create a screening protocol to be used in your own organization + work on a journey map

Option to work on the exercises on location

Assessment 4

Hand in the journey map and screening protocol

PART 5: Presentation

Meeting 6 - Users Meeting (2 hours)

Join a Users Meeting and present findings from part 4

We expect active participation and attendance in at least 80% of the sessions. A repair option is available for any incomplete or missed assignments, to ensure participants can meet the certificate requirements.

We will determine the start date through mutual agreement. The start date for the course will be determined once 10 candidates have registered via asreview@uu.nl .

  • Prof. dr. Rens van de Schoot
  • Dr. Matthieu Brinkhuis
  • Laura Hofstee (coordinator)
  • Jonathan de Bruin
  • Felix Weijdema

To register for the course, please send an email to asreview@uu.nl expressing your interest in participating. Due to the interactive nature of the course, we have a maximum limit of 10 participants per cycle.

Please note that obtaining the EU credits for this course requires some administrative work. Upon registration, you will be provided with detailed information on the necessary steps and documentation to ensure a smooth process for obtaining your credits.

Do you have any questions? Please contact Laura Hofstee (l.hofstee@uu.nl).