Leave a Reply

Your email address will not be published. Required fields are marked *

Learning Evaluation through Apprenticeships

Updated on: Jan 30th, 2013
Data Visualization
,
Collage of clipboard, clock, people, calendar and calculator.

Headshot of Cindy Tananis.

Cindy Tananis, Director, Collaborative for Evaluation and Assessment Capacity at the University of Pittsburgh

Greetings! I’m Cindy Tananis. The folks at the University of Pittsburgh’s Collaborative for Evaluation and Assessment Capacity (CEAC) have been thinking about blogging for some time now — and we’ve decided that if EVERYONE starts their OWN blog, then its hard to talk ACROSS blogs, so — we’ve decided to add some of our thinking here with Ann’s blog!

First. Let me do something that we think is really important in evaluation: CONTEXTUALIZE!  Before you can really understand findings from evaluation, you have to understand context.  Here’s ours!

We are a university based (University of Pittsburgh), evaluation group (of faculty and doctoral students in the School of Education) that works with folks who are trying to make a difference in the world of learning for children and adults.  Our work spans lots of ranges — small to large scale, quant to qual focus, formal to informal settings, school based to community based — and more.

I am the founder and Director of CEAC and also am an Associate Professor in Administrative and Policy Studies at Pitt, specializing in evaluation and educational leadership studies.  All of our evaluators are doc students studying some aspect of education, though that too represents a broad range of interests.

Now — on to the more typical bloglike entry!

It probably makes sense, as an introduction to think a bit about LEARNING EVALUATION.  We do that essentially through APPRENTICESHIP.  Doc students come to CEAC to fund their doctoral studies — and those studies may be in K-12 or Higher Ed leadership or in Social and Comparative Analysis of Ed — or Research Methods — or other specialized areas.  We do offer some evaluation and methods courses, but we don’t currently offer an evaluation area of study or degree option.  So, our folks come to us with very little evaluation expertise or experience — a perfect place for a ground up apprenticeship model.

Here are a few things we’ve learned along the way over the last six years that CEAC has been in operation:

  1. Learning by doing, works.  Folks can learn the basic skills as well as more nuanced practice of evaluation through practical work.  Reading and studying some of the seminal texts and theorists in the field adds to that, especially for a more conceptual and theoretical grounding for the work.
  2. People learn better by working together.  We do ALL of work as teams — this allows someone who even has a week more experience with an aspect of a project to become the “teacher” as others are students — with a fluid movement across roles that may flip flop even numerous times through a day!  We really do connect with the ideas of a community of practice from the literature.
  3. Learning is job one for everyone.  The fact that we are situated in a university, and better yet, a school of education, helps to make this point, but I think it resonates across all evaluation.  Evaluation helps people learn what they need to know to make sense of phenomena — typically to make decisions related to worth and value (though not always).  So, focusing on learning keeps us all good evaluation learners — that makes us good evaluators, and we hope, for some of us, better evaluation thinkers/theorists.
  4. Essentially, we are all apprentices in a field that is diverse and fluid.   One of the characteristics that first had me fall in love with the field is the diversity of experience, focus, theory, and practical application represented in evaluation.  As Scriven instructs us, evaluation is a trans-discipline — it informs and influences many other disciplines.  That provides us with a great opportunity to learn across fields, apply our work in new settings, work with partners from other disciplines —- its an invitation to  constantly challenge our knowledge and reform it anew.

Logo of the University of Pittsburgh's Collaborative for Evaluation and Assessment Capacity (CEAC).Want to learn more? Stop by and visit our website to learn more about CEAC:  www.ceac.pitt.edu

More about Cindy Tananis
Cynthia A. Tananis, Ed.D., Director, the founder of CEAC is an associate professor at the University of Pittsburgh’s School of Education and teaches in the School Leadership Program. She has 31 years of experience in evaluation. Her expertise focuses on using participative evaluation designs with involved stakeholders, helping people make sense of and benefit from the evaluation process through collaboration, and linking evaluation studies and school reform policy. Her research interests relate to theories, forms, and practices of evaluation, as well as school reform, professional development, and educational policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

You Might Like

Our complimentary mini course for beginners to dataviz. Takes 45 minutes to complete.

Enroll

Unlocking Creativity: Simple Steps for Non-Designers to Build Powerful Visual Frameworks

Want to make sure your presentation sticks with people? Visual frameworks are diagrams that help your audience see how everything fits together. In this post, you’ll go behind the scenes with Kate Hall to see how she developed a framework for a customer service training at her library.

More »

Inside our flagship dataviz course, you’ll learn software-agnostic skills that can (and should!) be applied to every software program. You’ll customize graphs for your audience, go beyond bar charts, and use accessible colors and text.

Enroll

Subscribe

Not another fluffy newsletter. Get actionable tips, videos and strategies from Ann in your inbox.