• Skip to main content
  • Skip to footer
  • Home

The May 13 Group

the next day for evaluation

  • Get Involved
  • Our Work
  • About Us
You are here: Home / Archives for allblogs

allblogs

Apr 29 2020

¿Podría el Covid-19 contribuir a unas Naciones (más) Unidas?

En el artículo ¿Es posible reformar Naciones Unidas?, aparecido en El País el 28 de abril, CRISTINA MANZANO nos habla de la necesidad de reformar un sistema de gobernanza global (Naciones Unidas), nacido en 1945, dado que no basta para hacer frente a los desafíos del siglo XXI.

El gran avance que supuso el nacimiento de la ONU solo fue posible después del mayor ejercicio de destrucción de la historia humana. ¿Podría ser el coronavirus —el mayor disruptor desde la II Guerra Mundial— el motor para adaptar la gobernanza global a las necesidades del siglo XXI?

La pregunta del millón es cómo lograr los incentivos para movilizar una transformación tan compleja en un momento tan difícil.

Un reciente ejercicio aspira a reactivar a estos últimos. La gobernanza global y el surgimiento de instituciones globales para el siglo XXI (Cambridge University Press) es un exhaustivo y ambicioso trabajo que parte de un profundo conocimiento del entramado institucional en sus diferentes niveles: económico, social, medioambiental y de seguridad. Sus autores, Augusto López-Claros, Arthur L. Dahl y Maja Groff  bucean en la historia del sistema y de las críticas recibidas desde su nacimiento.

La publicación revisa minuciosamente el papel de organismos, agencias e instituciones y plantean propuestas concretas de discusión, reforma y mejora, algunas rescatadas del propio diseño inicial de Naciones Unidas.

El libro da pistas para ganar legitimidad democrática. Legitimidad democrática significa también existencia de mayores espacios para la rendición de cuentas, transparencia…y mayor aprendizaje para la adaptación y la mejora continua.

He aquí algunas de esas pistas o apuestas -entre otr@s – por:

(1) acercar la organización a la ciudadanía mediante una Asamblea Parlamentaria Mundial que funcionaría de modo similar al Parlamento Europeo.

(2) la creación de una Cámara de la Sociedad Civil, de carácter consultivo, que reconozca la participación de los actores no gubernamentales. Los referentes son el Foro de ONG previo a la Cumbre del Milenio de 2000 y su papel en otros avances multilaterales como el Acuerdo de París, el Tratado sobre la Prohibición de Armas Nucleares o la puesta en marcha de la Corte Penal Internacional.

(3) la sustitución del Consejo de Seguridad por un Consejo de carácter ejecutivo,

(4) la creación de una Fuerza Internacional de Paz y de un Tribunal Internacional de Derechos Humanos, otro anticorrupción,

(5) la revisión de la arquitectura financiera global para luchar mejor contra la pobreza y la desigualdad,

(6) un enfoque integrado para mejorar y ampliar la capacidad de la gobernanza medioambiental

 

…pero me pregunto si ¿pensar que del Covid-19 sacaremos algo positivo (un aprendizaje, un acuerdo común, un cambio, una mejora…) no es más que otra rareza espacial?

Written by cplysy · Categorized: TripleAD

Apr 29 2020

Social and Emotional Learning is Imperative and in Museum Educators’ Wheelhouse

Just months ago (but what feels like an eternity ago), I was in an art museum observing museum educators lead a group of fifth-grade students on a museum visit.  One work of art they viewed highlighted inequities in the world by zooming in on areas where there is an abundance or absence of light across the globe at night.  Students’ emotions were clearly triggered.  Some called out “wow”; “what?”; and “that is so unfair.”  After experiencing several minutes of the media piece, the museum educators then guided a discussion about the work of art using simple questions from Harvard Project Zero’s Artful Thinking Routines: “what do you see?”; “what do you think?”; “what do you wonder”; etc.  These questions are tools museum educators, and not exclusively art museum educators, use regularly in their teaching.

Evaluators know the power of questions.  A good question can unlock so much knowledge.  And that is what happened for me when I was helping my daughter completing a Social and Emotional Learning (SEL) assignment given to her grade by the school counselor.  The counselor posed a few simple questions about how students are thinking and feeling in a Google Form.  This simple question is the one that really resonated: “What is a challenge you are going through right now?”

Google Form question

My daughter and I looked at the question together, and I read it aloud.  To paraphrase, my daughter told me (and her school counselor) how she misses her friends.  She explained that she is an only child, and because my husband and I are working at home, we cannot play with her all the time.  She also explained that, while she has a dog, he isn’t such a good playmate sometimes.  (TRUTH: he recently chewed the foot off a new doll, and she was very upset!)  Of course, her feelings gave me the feels, and are still doing so right now as I write this.  It also gave me data I could work with.  I needed to prioritize setting up more FaceTime calls with her friends (one this weekend that lasted 2 hours!) and other social and emotional activities.

In addition to thinking about my daughter’s needs, this experience made me think about all the inquiry-based museum teaching I have seen.  It seems to me museum educators are well-suited to share their inquiry-based teaching expertise in support of social and emotional learning.  Even pre-pandemic, I was seeing this need.  For example, at the National Art Education Association convention in March of 2019, a school district administrator told me how mental health is becoming a hot topic for schools, and that museums would be wise to discuss their ability to support children in this way.  And now mid-pandemic and beyond, social and emotional learning will be critical.  As Tim Walker wrote on the National Education Association blog: Social-Emotional Learning Should Be Priority During COVID-19 Crisis  I am looking forward to seeing what museums can do for our students, and for all of us, in our social and emotional well-being during this time since this expertise is certainly in their wheelhouse.

The post Social and Emotional Learning is Imperative and in Museum Educators’ Wheelhouse appeared first on RK&A.

Written by cplysy · Categorized: rka

Apr 28 2020

Evaluabilidad en tiempos de pandemia

Dados los retos que supone la situación actual para la práctica tradicional de la evaluación, empezamos una serie de posts sobre “evaluabilidad”. Entre las agencias internacionales de desarrollo parece haber un acuerdo generalizado sobre el significado del término “evaluabilidad”. La siguiente definición de la Organización para la Cooperación Económica y el Comité de Ayuda al Desarrollo-Desarrollo (OCDE-CAD) es ampliamente citada y utilizada:

“La medida en que una actividad o proyecto puede evaluarse de manera confiable y creíble” (OCDE-CAD 2010; p.21)

El documento de trabajo del DFID (Davies 2013) sobre la valoración de la evaluabilidad identificó las siguientes dimensiones de evaluabilidad:

• La evaluabilidad “en principio” analizará (1) la claridad de los fundamentos conceptuales y (2) el diseño de la intervención, incluida (a) la teoría subyacente del cambio y (b) cómo se ha traducido en el marco de resultados de la intervención.

• Evaluabilidad “en la práctica”, valorará cómo la teoría de intervención ha sido operativizada, ejecutada o traducida en la práctica dada (1) la disponibilidad de datos relevantes y (2) la capacidad de los sistemas de gestión capaces de proporcionarlos.

• La utilidad y practicidad de una valoración de evaluabilidad examinará la posible utilidad de una evaluación futura en relación con las áreas de evaluación y posibles preguntas de evaluación. Es en la practicidad, o cómo se puede llevar la evaluación a la práctica, donde habrá que rependar las estrategias en la situación actual.

La valoración de la evaluabilidad definirá el diseño, alcance, enfoque y metodología de la evaluación del programa

Referencias

Davies R (2013). Planning Evaluability Assessments: A Synthesis of the Literature with Recommendations. DFID Working Paper 40. Disponible en: https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/248656/wp40-planning-eval-assessments.pdf

OECD-DAC (2010). Glossary of key terms in evaluation and results based management. Paris: OECD-DAC. Available at: http://www.oecd.org/development/peer-reviews/2754804.pdf

Written by cplysy · Categorized: TripleAD

Apr 28 2020

Post or Perish

So I received a little constructive feedback after last week’s post.

Just be mindful of the voices you aren’t hearing. For some with ill family members, homeschooling small children, navigating aging parents in place, on top of maintaining stable income — finding time to write is a bridge too far… and I speak from a privileged place.

Betsy Baum Block on Twitter

I’m in that group re: little ones at home (1 yr old). Trying to balance ongoing work demands with childcare is difficult. Working moms will likely be less heard.

Christina P. Gorga on Twitter

Being a working parent is tough enough under normal circumstances, and these are not normal circumstances.

So first things first.

It’s okay if you can’t post, publish, or present right now.

If it’s hard enough to get through the day, work through your must-do list, and get your family fed. Don’t worry about blogging.

Through an email conversation with Betsy, I think we came up with a lower burden alternative. Something that might not be as good as building your own digital empire, but could at least keep you visible.

Professional Visibility.

Chris told me to blog in 2011. I didn’t listen until 2012.
Since taking Chris’ advice:

50 to 50,000 views a month
Started my own company
Added team
Spoke in ~30 states & ~10 countries
Partnered w/ dream orgs
Got reports off Dusty Shelves

… & it started w/ a blog.

Ann K Emery on Twitter

Before Ann was leading workshops around the world, she was blogging.

Before Stephanie wrote her first book, she was blogging.

Before Shiela and Kim coauthored their book, they were collaborating through their blog posts.

I stand by the advice I have given to individual evaluators for years. If you can blog, you should blog. It’s one of the clearest paths towards professional visibility that I know.

And the world needs to see more evaluators.

A different kind of publish or perish?

But not everyone can blog. At least not right now, maybe later, and maybe not later.

So therein lies a problem.

In our digital world, if you stop posting and participating, you risk disappearing from view. The digital world craves content. So much so that it gives a boost to people like me who have the advantage of a couple steady contracts, lots of practice, and a spouse committed to homeschooling our daughter.

It’s publish or perish, but instead of academic administrators calling the shots, they’re being called by social media platform algorithms.

Today I wouldn’t get an academic job. It’s as simple as that. I don’t think I would be regarded as productive enough.

Peter W. Higgs

Announcing the FreshSpectrum Panel of Experts

Want to contribute to the web, but life experiences make you short on time?

Back in 2013 I wrote what I now call a panel post. And for a long time after, it was one of my top blog posts. I asked 22 bloggers a couple of questions, then compiled their answers into a single post.

It’s super simple, but it’s also incredibly effective.

Consider joining my panel of experts.

I’ll ask you a question a couple of times a month. You answer the question providing expertise from your unique point of view. If you can’t answer a particular question, for time reasons or just not feeling the question, that’s okay.

If you do answer, I’ll post your response in a cartoon illustrated panel post. I’ll reference your name and include a link back to your website (or wherever you want me to send traffic).

I’ll then share the post on social & email. It will also go out via Eval Central.

My hope, to spark increased digital participation from a wide group of evaluation experts. The experts who for all sorts of reasons, cannot spend enough time on social to reap the rewards.

So if you are interested, please join.

Join Ann K Emery on our next Eval Central UnWebinar

On Wednesday, April 29 at 1PM EDT/10AM PDT, we’ll be having our next Eval Central UnWebinar.

This week’s guest conversation facilitator: Ann K Emery

This week’s seed topic: Blogging as an Evaluator

Hope you can join!

Written by cplysy · Categorized: freshspectrum

Apr 28 2020

Reflexivity in Evaluation

 

Reflectivity vs Reflexivity

Reflective Practice is where a person reflects on what they have learned and how they can apply it or learn from it.

Reflexive Practice is where a person reflects on what they have learned and considers how the implications of their learnings can impact the broader context they work in. The scope to which the person applies their learnings is broader in reflexive practice.

Reflective practice is the first competency domain for the Canadian Evaluation Society (CES) Credentialed Evaluator (CE) Designation. It is a part of the foundation that makes up a sound evaluation practice. Reflective practice involves using a learning mindset to stay up to date on new and best practices, integrating evaluation standards and ethics into practice, providing transparency and a balanced perspective, contributing to the profession of evaluation and using self-awareness and reflective thinking to continually improve practice. This last point is reflexivity, or continually reflecting on how oneself and one’s learnings impact the broader context within which a person works.

While most of us generally understand the concept of reflectivity and how to be reflective (learn, stay up to date, apply professional standards and ethics), this last concept of reflexivity can be elusive. Reflexivity often falls into that category of things we know we should be doing, but aren’t really doing, or things we might be doing, but aren’t so sure we’re doing right.

To try and ease your stress about reflexivity and to help guide your practice, we’ve compiled our best tips below. To start, we define reflexivity and outline why you should develop a reflexive practice before jumping in to help you become more reflexive.

What is reflexivity

What really is reflexive practice and how do you do it in a practical manner? If we look to the CES Credentialed Evaluator domain, reflective practice is about having a deep understanding of evaluative theory and practice, applying evaluation standards and ethics, and having an awareness of self and reflection on one’s practice. In essence, it’s about the cycle of learning and growth, both about the field of evaluation and yourself as an evaluator, and using critical insights to improve your practice. Reflexivity can take on many forms, but it is essentially the practice of examining ones’ self as an evaluator, how you have been shaped by the evaluative process and how your values and viewpoints have shaped your evaluations.

Why develop a reflexive practice

You might be wondering why you should be concerned with developing a reflexive practice. In evaluation, we are often tasked with defining or providing information for decision-making about the value or merit of an evaluand (e.g. a program or project). We must pay attention to the needs of different stakeholders, outside political influences, and our own biases. Reflexivity gives us the space to process these elements and critically examine these influences on our evaluations.  How can you measure value if you are not aware of your own values? Through reflexivity, we learn and grow from our mistakes.

How to be reflexive

Reflexivity sounds like a daunting task. How does one regularly and thoroughly critically appraise ones’ self and evaluation practice? In today’s busy world where we are being pulled in many directions, here are some strategies to help you develop your own practical reflexive practice.

1.     Be reflexive often.

Reflexivity should be a continuous process. To ensure that it doesn’t fall to the wayside, carve out time in your calendar and stick to it. Figure out what works best for you — do you prefer to work in larger chunks of time, or to split up your reflexion over the space of a few days or weeks? Being reflexive is something that needs to fit within your current work practices. If you are always rushing out of the office on a Friday afternoon, don’t schedule your reflexive time then. 

In addition to scheduling reflexive time regularly, include it as part of your evaluation plans. Ensure you include time at the end of every major evaluation phase for some project-specific reflexion time. This practice can help you implement improvements in your current evaluation project and save you from future pitfalls in similar projects. A quick check-in about what you did well, what you could improve on, and what changes you will make with this information counts as reflexion.

Man Standing Infront of White Board

Practicing reflexivity in the space between data collection, analysis, and reporting can provide insights into the interpretation of results. If survey response was low, what might it indicate? Were your survey deployment tactics suited to the population? Did your questions resonate with the community? Did you make assumptions about how people would respond to or interpret the questions? How could these assumptions have impacted your results?

2.     Be reflexive in a structured manner.

Left to your own devices and without a plan, you can easily use up your whole reflexion time googling how to be reflexive (if that Google search led you to this article, Hello! And welcome to the end of your search.) Set out your questions or focus in advance and stick to them. There are some practical tools to help with this in the tools section at the end of this article.

Bring structure into your reflective practice in a way that makes sense for you. Perhaps it’s a weekly set of questions, free drawing time with a focus or intention in mind, or a daily project journal.

3.     Be reflexive alone.

Reflexion is about reflecting on your own processes, questioning your attitudes, thought processes, values, assumptions and habitual actions in order to understand our roles in complex situations. Nobody else can do this work for you. Ensure that some of your reflexion is done alone.

4.     Be reflexive together.

While you need to be able to think critically about yourself, bringing others into your reflexive practice from time-to-time can help you gain a deeper understanding. Getting feedback from others can challenge your assumptions about yourself. Your coworkers, clients, and colleagues are sources of information to promote learning and growth. Offer to take them out for a coffee, meet up for a walk, or schedule an informal phone call.

If you work as part of a team, consider bringing everyone together for a project debrief. Ask them what worked well in the project, what external facilitators and barriers contributed to your final product, and what internal processes could be improved for next time. You can also examine how you worked together as a team and if there are areas where the team can grow.

5.     Record it!

Part of reflexion is looking back at your growth. Recording your thoughts will help you to look back and see patterns over time. It also helps you to be accountable. Find a method of recording your reflexion that works for you. Keep it simple and don’t overthink it.

6.     Get meta about reflexion.

Don’t do this too often, but every once in a while it doesn’t hurt to be reflexive about your reflexion. How are your chosen processes and tools working?  Are you actually making the time to be reflexive on a regular basis? Are there questions you are avoiding? Have you implemented any of the steps you outlined to make improvements?

Tools and Ideas for Reflexion

  • At the end of an evaluation, once you have reported on the findings, go back to the data collection tools you use and consider what changes you would make in hindsight. If your evaluation included audio-recorded interviews or focus groups, go back and listen to them again, this time focusing on yourself. How did your involvement in the data collection impact the participants and your interpretations of the findings?

  • If you are looking for a structured process for reflexion, check out the DATA model:

    • Describe what is or has been happening in practice.

    • Analyze the current state of practice; why is this happening in this way?

    • Theorize why things are occurring.

    • Act; make a specific action plan to make changes.

  •  Feeling more creative? Carolyn Camman created an adult colouring book with reflexive questions to get your mind going.

  • Do something with your hands that you are good at but doesn’t required a lot of concentration. Doodle, bake, work on a puzzle, or play with playdough while you mull over your reflexive questions. Personally, I’ve baked dozens of cookies and a couple of pies as a way to carve out time and keep my hands busy while giving my brain space to think.


Sign up for our newsletter

We’ll let you know about our new content, and curate the best new evaluation resources from around the web!


We respect your privacy.

Thank you!


 

Written by cplysy · Categorized: evalacademy

  • « Go to Previous Page
  • Go to page 1
  • Interim pages omitted …
  • Go to page 270
  • Go to page 271
  • Go to page 272
  • Go to page 273
  • Go to page 274
  • Interim pages omitted …
  • Go to page 310
  • Go to Next Page »

Footer

Follow our Work

The easiest way to stay connected to our work is to join our newsletter. You’ll get updates on projects, learn about new events, and hear stories from those evaluators whom the field continues to actively exclude and erase.

Get Updates

Want to take further action or join a pod? Click here to learn more.

Copyright © 2026 · The May 13 Group · Log in

en English
af Afrikaanssq Shqipam አማርኛar العربيةhy Հայերենaz Azərbaycan dilieu Euskarabe Беларуская моваbn বাংলাbs Bosanskibg Българскиca Catalàceb Cebuanony Chichewazh-CN 简体中文zh-TW 繁體中文co Corsuhr Hrvatskics Čeština‎da Dansknl Nederlandsen Englisheo Esperantoet Eestitl Filipinofi Suomifr Françaisfy Fryskgl Galegoka ქართულიde Deutschel Ελληνικάgu ગુજરાતીht Kreyol ayisyenha Harshen Hausahaw Ōlelo Hawaiʻiiw עִבְרִיתhi हिन्दीhmn Hmonghu Magyaris Íslenskaig Igboid Bahasa Indonesiaga Gaeilgeit Italianoja 日本語jw Basa Jawakn ಕನ್ನಡkk Қазақ тіліkm ភាសាខ្មែរko 한국어ku كوردی‎ky Кыргызчаlo ພາສາລາວla Latinlv Latviešu valodalt Lietuvių kalbalb Lëtzebuergeschmk Македонски јазикmg Malagasyms Bahasa Melayuml മലയാളംmt Maltesemi Te Reo Māorimr मराठीmn Монголmy ဗမာစာne नेपालीno Norsk bokmålps پښتوfa فارسیpl Polskipt Portuguêspa ਪੰਜਾਬੀro Românăru Русскийsm Samoangd Gàidhligsr Српски језикst Sesothosn Shonasd سنڌيsi සිංහලsk Slovenčinasl Slovenščinaso Afsoomaalies Españolsu Basa Sundasw Kiswahilisv Svenskatg Тоҷикӣta தமிழ்te తెలుగుth ไทยtr Türkçeuk Українськаur اردوuz O‘zbekchavi Tiếng Việtcy Cymraegxh isiXhosayi יידישyo Yorùbázu Zulu