About AI-SCoRe
Developers: Jon Bokrantz, Gijs van Biezen, Jan Dul
Version 0.0.1 · Date: May 30, 2026
What is AI-SCoRe?
AI-SCoRe is an extension of the SCoRe checklist for Strengthening (theoretical rigor), Conducting (data and analysis quality), and Reporting (transparency) an empirical NCA study. AI-SCoRe evaluates an empirical NCA study against published guidelines for good practice using generative AI. It consists of a set of instructions for an AI platform such as Claude or ChatGPT to evaluate an uploaded NCA document (manuscript, paper, publication, etc.). The tool identifies potential points of improvement to inspire critical reflection.
What is the goal of AI-SCoRe?
This tool is intended to help authors improve the quality of their NCA work.
What are the limitations of AI-SCoRe?
The tool is not perfect and will make errors. Users should not treat its output as a final, authoritative verdict; instead they should always critically evaluate the results. The final judgment remains with the author. Since NCA is a relatively new method and is often applied/described incorrectly, an AI platform may have limited or incorrect background knowledge about NCA and may provide incorrect answers to in-depth follow-up questions. Furthermore, note that due to the stochastic and subjective nature of this tool the output may vary even across assessments of the same document, and that a user's own settings in an AI platform may also affect the output. Less advanced models may produce less reliable output.
What can AI-SCoRe evaluate?
Authors may want to upload their document (e.g., manuscript) to an AI platform for getting feedback. Following good practice of GenAI use, uploading others' work without explicit permission of the owner may not be appropriate. Users of AI-SCoRe tool upload documents at their own risk. The AI-SCoRe tool itself can be freely used under MIT licence.
How to use AI-SCoRe for peer review?
The tool can only be used for peer review when consent has been granted by the owner of the document (author, publisher). If you are requested to peer-review a document (e.g., manuscript) and consent was not provided, consider directing the authors towards the interactive checklist or this tool as a means of improving the quality of their work.
What AI platform accepts AI-SCoRe?
AI-SCoRe comes in two versions: regular AI-SCoRe which is a regular prompt for single use in a conversation, and system AI-SCoRe which is a reusable stored system prompt for multiple use. AI-SCoRe consists of a set of instructions that are read before acting. The regular prompt AI-SCoRe is fully portable to any LLM with a prompt field including ChatGPT, Claude, Google Gemini, Microsoft Copilot, Perplexity, etc. The system prompt AI-SCoRe is platform-specific. It is currently available as a Skill for Claude. Although it is formatted to be readily imported as a Claude Skill, we have found that the skill files can also be read and used by other AI platforms. (e.g., Codex of OpenAI). Both versions require that the user uploads the document to be evaluated.
How did we develop AI-SCoRe?
AI-SCoRe was first developed as a system prompt tool using Claude and the "Skills" feature of Anthropic. The SCoRe checklist (https://jandul.github.io/NCA/score-checklist/) and the NCA book by Jan Dul (https://jandul.github.io/nca-book/) were used as primary input and to train the tool. We improved the tool by comparing AI-generated evaluations with evaluations by human NCA experts. The final system prompt version was stripped from Claude-specific instructions to make the regular prompt version.