In this case study on using algorithms to improve the fairness, efficiency, and quality of crew planning for the national railways, we have used the Flows of Knowledge (Flows) approach to evaluate impact, as introduced by Meagher, Lyall and Nutley (2008) and described in Edwards and Meagher (2020). Read more about this impact evaluation method in our Impact Toolbox.
Flows moves beyond a narrow interpretation of impact in the instrumental sense (direct, tangible effects of research on practice or policy). Rather, this method pays attention to ‘more subtle’ impacts like capacities, culture, and connectivity. In this way, the method stimulates users to pay attention not only to outputs and outcomes, but also to processes of relationship-building which are often the conditions for future impact. The case study, impact assessment and results are briefly summarised below.
The case study: Improving fairness and quality of crew planning
The case study focuses on the collaboration between a PhD candidate from the Erasmus School of Economy (ESE) and innovation experts from national Dutch railways (NS) to improve crew planning in terms of quality and ‘fairness’ for train drivers and conductors. From theoretical principles, the PhD researcher developed an algorithm that produces various ‘good’ and ‘fair’ schedules. Subsequently, the algorithm has been further developed into a prototype at the NS, and tested during a pilot-phase in the practice of actual scheduling committees.
The Project Impact Assessment (PIA) using Flows
The PIA took place between June 2021 and March 2022, after the completion of the PhD project in 2020. It relied on a thorough review of project documents and five in-depth interviews. The interviews were coded on the basis of the Flows conceptual framework to distinguish different types of impact, involved stakeholders and causal factors that made changes possible. The ESI team also paid attention to the different dimensions of proximity that enabled collaboration and exchange to occur.
The results of impact evaluation
The results of using Flows as a method for impact assessment was a report containing a narrative on the way knowledge ‘flowed’ between different actors and how this led to changes in the practice of making work schedules. Ultimately, the research collaboration intensified social networks within and outside the railway organisation, resulting in further knowledge dissemination and changed attitudes regarding the use of algorithms for staff planning and capacities within the organisation. However, this did not come about without implementation barriers on a national scale.
Downloads
Take a look at the entire report 'Eerlijke Personeelplanning op het spoor 2022' (Dutch)
- More information
The first version was written by Margriet Kim Nguyen and Jorrit Smit and published on May 30, 2022. Recent revisions have been made by the Evaluating Societal Impact team on June 2025.
- Related content
- Related links
- More about 'Flows of Knowledge' (Flows)
