In 2016, Dr. Sarah Heinemeier of Compass Evaluation and Research presented beginner- and intermediate-level topics on evaluation planning, data knowledge, instrument development and selection, data management and analysis, and data uses for program improvement and development. These sessions delved deeper into many of the topics that were introduced during in-person data workshops hosted by the Partnership in the summer of 2015. The webinar series was made possible by funding support from the Race to the Top – Early Learning Challenge (RTT-ELC) Smart Start Data Project via the North Carolina Partnership for Children.
Descriptions and presentation slides from all the webinars are available below. If you have questions or would like additional information about the webinar series,
January 27, 2016: What are Data and when are they High Quality?
This webinar explores what we mean when we talk about “data,” or pieces of information that are used to answer questions, make decisions, and communicate about programs. In addition, this webinar provides tips and strategies for recognizing, collecting, and managing data that are high quality and useful for program reporting.
Materials: Presentation slides, Handout: Checklist for Collecting High Quality Data, Handout: Checklist of Data Quality Concerns
February 23, 2016: Understanding Logic Models and a Theory of Change—What’s the Big Deal?
Logic models are tools for quickly visualizing and describing a comprehensive program or investment. Often, logic models incorporate or explicate a theory of change about how a program may result in a desired outcome or result. This webinar will provide examples of logic models and discuss their value for grant-writing, program management and implementation, and evaluation.
Materials: Presentation slides
March 30, 2016: Negotiating Bias: Top-down and Bottom-up Approaches to Designing Outcomes
Outcomes are measures of changes that may occur as a result of a program. But who gets to decide which outcomes to measure? This webinar will present guidance and strategies for creating outcomes that capture a variety of stakeholder perspectives.
Materials: Presentation slides, Handout: Designing outcomes cheat sheet
April 26, 2016: Integrating Quantitative and Qualitative Data into your Evaluation
One of the strengths of a mixed-methods approach is the use of multiple types of data, which typically fall into two categories: quantitative and qualitative. This webinar will explore the differences between quantitative and qualitative data and will present strategies and examples for incorporating both types of data into a robust program evaluation.
Materials: Presentation slides
May 25, 2016: Designing or Choosing Instruments: Surveys
What is a survey and how is it different from other forms of data collection? When is a survey a good fit for data collection for your evaluation? This webinar will explore introductory principles of survey design and practical steps for collecting high quality survey data.
Materials: Presentation slides, Handout: Checklist for Designing Evaluation Surveys
June 28, 2016: Designing or Choosing Instruments: Observations
This webinar will review the concepts and principles of using observations to collect evaluation data. The webinar will present examples of observations commonly used in early childhood and will provide recommendations for ensuring high quality observation data can be collected.
Materials: Presentation slides
July 12, 2016: Designing or Choosing Instruments: Standardized Assessments
This webinar will explore using standardized assessments, including the features that make a tool or instrument “standardized.” The webinar will focus on the steps to take to ensure your evaluation team is using a standardized assessment correctly.
Materials: Presentation Slides
July 27, 2016: Choosing and Using Sampling in Your Evaluation
Sampling is a technique for managing a large-scale evaluation or data collection, especially if there is limited time or resources for data collection. This webinar will provide the considerations and implications that are present when deciding to use sampling as well as some of the technical aspects of sampling that need to be addressed.
Materials: Presentation Slides
August 30, 2016: Best Practices in Data Collection and Management
This webinar will summarize many of the concepts presented in the May-July webinars. Looking across data collection instruments and techniques, this webinar will present tips, strategies, and best practices for managing your evaluation.
Materials: Presentation Slides
September 28, 2016: Finding the Value in Evaluation: Cultural Relativity and Bias
How do you know if there is bias in your study? How do you “control” for and negotiate bias? This webinar will discuss general concepts and commonly used techniques or strategies for responding to bias.
Materials: Presentation Slides
October 25, 2016: Using Data: Effective Reporting and Grant Writing
The data you collect often will be used to satisfy reporting requirements. However, there are other ways to use your project data—this webinar will explore different uses of project data (e.g., needs assessments, grant writing, publications), and present cautions and strategies for data use.
Materials: Presentation Slides
November 30, 2016: Thinking Beyond Your Program: Evaluating Systems and Collaborations
This webinar will explore ideas related to systems building, including concepts and strategies for evaluating collaborations. In particular, this webinar will focus on the use of data to improve a collective understanding of community needs, services, and growth.
Materials: Presentation Slides
