ads analytical framework: a strategic tool for evaluating digital skills programmes
As part of its mission to strengthen Europe’s digital talent ecosystem, we have developed a new strategic tool: the ADS Analytical Framework, presented in the deliverable D2.1. This comprehensive methodology will support the longitudinal analysis of activities within the SO4 Advanced Digital Skills (ADS) Cluster, helping identify improvement areas and guide evidence-based recommendations.
A structured approach to evaluating impact
The main goal of the framework is to conduct a gap analysis and produce actionable insights to enhance programme offerings, delivery quality, and long-term impact. It draws from a rich combination of quantitative and qualitative data sources, including:
- The LEADSx2030 Digital Projects Brochure
- Interviews with Coordinator Institutions
- Performance data from the European Commission’s DG CNECT Digital Europe Programme
Four core analytical components
The ADS Analytical Framework is structured around four key components, to be implemented in two phases based on the maturity of the projects:
- Course and Programme Portfolio
A comprehensive review of what is being offered: types of courses, delivery formats, accreditation, duration, delivery language, skill levels, and targeted sectors. - Completion, Passing, and Employment Rates
Analysis of KPIs such as enrolment numbers, course completion, pass rates, and post-training employment outcomes, including gender and nationality breakdowns, with six-month follow-up metrics - Quality Assurance
Evaluation of internal and external quality assurance mechanisms, including programme design, student evaluations, industry input, and national/international accreditation processes. - Institutional Feedback and Collaboration
Through workshops and focus groups, the framework explores programme financing, sustainability, staffing, cooperation with industry, and innovations in course design and delivery.
This framework enables analysis at multiple levels and across stakeholder types: education and training providers, industry, public bodies, and research institutions.
Phased implementation in practice
The rollout is structured in two stages:
- Phase 1 (Year 1): The first three components will be applied to 32 selected projects across the SPECIALISED 2021 (8 projects), SPECIALISED 2022 (12 projects), and Short-Term Training Courses (12 projects).
- Phase 2 (Years 2–4): The full framework will be implemented to enable a more comprehensive analysis.
The framework is currently being piloted with a specialised master’s and a short course, ensuring it is practical and scalable across different institutional contexts.
Optional components for deeper insights
Do you want to learn more about the optional elements that allow for more targeted evaluations?”
Explore Annex A to assess student satisfaction, industry involvement, institutional development, and the wider impact of ADS programmes.
Annex B, on the other hand, supports other LEADSx2030 Work Packages by identifying portfolio gaps, underserved sectors, and emerging digital skill areas.
Measuring what matters
The framework incorporates a dedicated impact assessment approach focusing on how EU-funded ADS programmes contribute to broader societal goals. A key long-term ambition is to train part of the 20 million ICT specialists needed in the EU by 2030, including progress on gender convergence.
By integrating performance data with qualitative insights, this framework will not only track outcomes but also actively inform future digital education strategies across Europe.