In this episode of The Learning and Performance Podcast, I speak with Dr. Alaina Szlachta, an education entrepreneur and data and measurement "nerd," about leveraging data to improve workplace learning and performance. Alaina is the founder and Chief Measurement Architect at By Design Development Solutions, a consultancy that works with leaders and teams to create simple data collection systems that enable their programs to facilitate real, evidence-based impact and change. Together, Alaina and I discuss why measurement, assessment, evaluation, and data are so critical to learning and performance improvement, and she shares some great insights and tools for measuring and understanding the true impact of your learning and performance efforts.
Key Topics
In our conversation, we hit on a number of interesting topics relevant to learning and performance, including:
- The importance of collecting and utilizing data (and why data is power)
- Evaluation, measurement - what they are and why they matter
- The criticality of having feedback loops in teaching and learning
- The similarities and differences between measurement, evaluation, and assessment
- Why analysis and evaluation are so often overlooked
- The difference between analyzing and addressing performance gaps vs. designing learning solutions
- Some challenges with measuring the impact of training and other interventions, and how to overcome them
- How to artfully navigate questionable training requests
- How to evaluate intangible skills in highly tangible ways
- And a whole lot more!
Connect with Alaina
Mentions and Resources:
- Learning 2024 Conference
- Dr. Megan Torrance - Why data is power
- The data pyramid and how wisdom requires data
- Performance - a combo of attitudes and actions, beliefs and behaviors that show up in how we work
- Learning - a means to an end at work, NOT the end result
- The importance of evaluating performance changes, not just assessing learning!
- Importance of constant feedback loops in teaching and learning and the lack of feedback loop in much workplace learning and performance improvement
- Telling Ain't Training
- Definition of measurement - strategic planning to collect data and collecting it
- Definition of evaluation - analyzing the data and determining effectiveness
- Importance of measurement and evaluation to decision-making
- The ADDIE Framework - so easy to neglect/overlook A and E
- Analyzing and addressing performance gaps vs. designing and delivering learning solutions
- The Pareto Principle - 20 percent of content providing 80 percent of value
- Why evaluation is overlooked - (1) lack of time, money, and people to do a comprehensive evaluation, (2) focusing on superficial aspects of learning experiences, (3) not clearly identifying the important things to value
- Kirkpatrick's Four Levels of Evaluation
- Assessment vs. Evaluation - assessments collect data on learning, and evaluations determine changes in performance
- Challenges with measuring impact - (1) building a training or learning solution without validating the problem is a lack of knowledge, (2) not digging into the data closely
- Measurement and Evaluation on a Shoestring (ATD Press 2025)
- Getting out of the shoestring by being strategic
- Aligning L&D resources with core business/organizational metrics
- Heidi Kirby - Useful Stuff
- Importance of listening to your gut when sensing red flags with requests
- How to sidestep training requests with strategic questions about the problem
- Evaluating the "intangibles" - (1) Translate intangible skills into tangible behaviors and indicators. (2) Tie it back to the problem. What would be different if the person was better at this? If they did it, would it solve the problem?
- Importance of using tech to automate other things and free up time for better analysis and evaluation
- Being clear on key indicators/criteria before making professional decision (e.g., finding a job, taking on a client)
