Rm Plc · LSE:RM.
Rm — AI in Action Summit 2025
6 slides from Rm's conference presentation, Oct 8, 2025
Slide 1: RM Focus: Marking Engine in Action
Summit 2025 RM Focus Marking Engine in Action Dr. Gráinne Watson, RM Chief Operations Officer
Slide 2: Marking Engine background
Marking Engine background RM built a Marking Engine using Generative AI and proved: We could match 1 and complement human Logic: Consensus Experience: Rubrics & marking Framework Real and Created 2 We could provide Marking appropriate feedback to Engine explain mark provided Data: Feedback: 3 We cou
Slide 3: What next? More subjects
What next? More subjects We are currently working on several complex PoCs where we are marking a variety of subjects and we are seeing some commonalities from our other PoCs First look commonalities For some answers, the AI marking engine can mark as well as humans from the outset But overall, A
Slide 4: How do we work on consistency?
How do we work on consistency? What do we assess? AI Marker Confidence Analysis Confidence vs Marker Disagreement Top-Tail Analysis AI in Action | 8th October 2025
Slide 5: What are the takeaways?
What are the takeaways? There is consistently a gap between what a human marker knows and a rubric, making three points vital: Feedback Marking Engine Ability to choose methods of marking AI in Action | 8th October 2025
Slide 6: Integrating a Marking Engine
Integrating a Marking Engine AI Marking Questions Questions Marking Marking Configure AI markers and instructions instructions feedback AI marking only Questions, Marking instructions 100% double marking Relevant content (AI +human) Responses Responses Create marking instructions for AI 100% AI mark