Reflections from the window - project evaluations

As one of the last steps of the summer program with AMIGOS (and any good project methodology), we took some time to evaluate how the program went. We had some interesting conversations among the staff team as to how to implement the evaluations, in addition to the topics discussed within the evaluations.

We used a participatory evaluation method, which succinctly, means to involve participants in the evaluation process. For AMIGOS, this meant to get the opinions of people from all aspects of involvement with the program: host families, youth group members who worked with our volunteers, partnering agency contacts, to even community members who weren't involved with the program much.

The evaluation process looked different based on the different levels at which we evaluated

• At the community level, supervisors might have coordinated a town meeting to evaluate the project in a group with community members. In some communities, a town meeting wasn't feasible; these supervisors might have conducted multiple interviews with various community members and key players, or even distributed surveys to community members.
• At the partnering agency level, directors and supervisors met with PLAN contacts that we had worked with. We evaluated how the summer went: successes, challenges, suggestions. Based on the AMIGOS mission statement, what did we do well? what difficulties did we encounter? what suggestions do we have for next year?

One of the interesting topics of discussion when we were planning out our evaluation methodologies was whether the presence of our youth volunteers (who had been living and working in the communities) would affect the responses in the evaluation. While communities might be more reticient to discuss the challenges of their volunteers when the vols are right there, there was also the consideration of how to teach or pass along knowledge about the evaluation process to volunteers. None of our project supervisors (responsible for directly overseeing volunteers in the communities) had ever done a participatory evaluation before, either because the eval process was different when they were a volunteer, or more likely, that the participatory evaluation had always been conducted post-volunteer departure from the communities.

Here's an interesting document on involving youth in the participatory evaluation process published by the Program for Youth and Community at the University of Michigan.

In the end, we came to a consensus on a two-part participatory evaluation. First, that there would be some sort of participatory evaluation in all communities while the volunteers were still there. In general, this was the meaty evaluation step, although in some communities supervisors encountered challenges that prevented them from doing a thorough evaluation at this point. Next, supervisors returned to each community after volunteers left the country in order to check that everything was indeed OK with the volunteers and to complete the participatory evaluation process as needed.

The final step of the evaluation process was to complete the documentation on these evaluations. We created a number of documents based on the multi-faceted evaluation process:

• Community-specific evaluation summaries - for next year's staff to review and learn from at the beginning of the summer
• Partnering Agency evaluation matrix - based on the notes from three different partnering agency evaluation meetings we held (with the three PLAN offices with which we worked)
• Final Evaluation documents - we created one in Spanish and a summary in English that narrated our evaluation of the project. I focused on the key issues we had encountered throughout the summer, as well as common threads from all of our participatory evaluation encounters. These documents also included a more quantitative component that enumerated all of the projects we worked on this summer (# of hours of children's camps, # of murals painted, etc.)

What have your experiences been on evaluations of projects? Self-evaluations?

Taino Art Workshop Update

An update on the Taino art workshop project that I have been working on this summer. (read previous posting here) The project is to build a workshop space in one of the rural Dominican communities for practicing and teaching the Taino-style sculpture that they do:

After some significant roadblocks, we purchased materials and started construction on the workshop!

Since I last wrote, we discovered some challenges to community mobilization and support for the project. When we went out to visit, expecting a ground-breaking ceremony, the preparatory work that we expected to be completed was not done yet. There had been some challenges with the maestro (the main expert on the project) in completing the work in a timely manner, as well as with the local youth to rally community support to keep this project going.

It didn't look good. With the short time frame that we have for the AMIGOS projects, we had to look at how we could best get the community on board with a youth-based project, and to understand that the project was not just for the few youth leading the project organization.

PLAN and the AMIGOS project director went out to this community the next evening for a meeting, and there were some amazing turnaround results!

• The community members committed to getting the preparatory work and materials completed within 5 days
• They appointed an adult leader/laison for the project

We delivered the materials a few days later, just before the end of the summer AMIGOS volunteer program. It was a lot of fun to get the materials from a ferreteria (hardware store) and deliver them in a huge truck out to this community. El Capa is a bit difficult to get to -- you have to cross a river -- so it was quite a different perspective travelling in a vehicle that I knew wouldn't get stuck or have any trouble in the river.


After the end of the AMIGOS project this summer, I went back to El Capa to check on the progress of the art workshop construction. The construction was moving along, and below you can see the posts and wire set up in preparation for pouring concrete walls. The group of adults monitoring the project has been active and working closely with the youth members on making sure the project progresses, and resolving issues that had come up. It was also good to see the community, and also say goodbye to some of the great people I met there. Here are some photos from the visit:

Overall, it has been a positive experience in seeing a community come together for a long-term sustainable project directed from within the same community. I look forward to seeing the progress in the coming months on this construction!

Sustainable Community Development

One of the areas of focus this summer with the AMIGOS program has been on the promotion of sustainable community development. While AMIGOS has a long history of working in Latin American countries on promoting community development, and has been working toward community development, this has been a major focus within the Dominican Republic project this year.

Most AMIGOS projects have some sort of Community Based Initiative (CBI), a small project initiated from within a community for volunteers and community members to focus on during the AMIGOS volunteer's time in the community.

How are we different? Here's how:

1. Emphasize the importance of the process of the CBI. While the actual painting of a mural, or the construction of a playground is important, we have worked on training the community youth on the process of the community, its values and strengths, and the visioning process of what possibilities we have for further strengthening these values. As the community and youth become more familiar with this process, they are able to carry out this process (and the subsequent proposal planning and implementation) on their own.
2. We changed the terminology based on cultural meanings. While Community Based Initiative typically translates to "proyecto comunitario" in Spanish, the term proyecto carries the connotation of a large construction-based project. Instead, we are using the term "Iniciativa pequena de la comunidad" to better convey the community-based focus as well as the small-ness of our initiatives (most of our initiatives are within the $350 USD range).
3. Encourage communities to participate in fundraising outside of the AMIGOS proposal process. Many of our communities are supporting significant portions of the "iniciativas pequenas" - some more than 50%, and one is completely supporting the financial aspects of the initiative!

Between these key points of focus in our project, as well as focused training to our volunteers as well as community youth on the Community Based Initiatives and process, we have been having a successful, and in my mind - sustainable, process for working within our communities this summer!

Collaboration - the meaning of partnership

Here in the Dominican Republic, AMIGOS is working with a partnering organization on all aspects of our project. We are collaborating with PLAN International, an international development organization focused on youth participation.


We have worked jointly with PLAN in all aspects of the program planning, implementation and evaluation process. The first project-related activities this summer was meeting with the national level contacts to establish focus for our volunteer program and a chronology for the summer.


Some of the joys of working with a partnering agency:

• Our partner contacts know and understand the communities and cultures we work in much better than we do. They have established relationships with our contacts in communities, and know best on how to approach challenging situations. There have been more than one occasion where sharing the challenges we are experiencing with our PLAN contacts have helped to ensure a swift resolution to the issues at hand.
• Our PLAN contacts also have worked with the AMIGOS programs in previous years and have the first-hand experience of lessons learned. As the AMIGOS project leadership changes yearly, we strive to benefit from the lessons learned, and the strength of our partnering agency relationship helps to ensure this.
• More fun! We have forged some great friendships with the people at the PLAN offices, and have enjoyed getting together on the weekends, or exploring some of the cultural opportunities (namely the craziness that was the Dias Patronales festival).

One of the challenges with our partnering agency relationships is that through AMIGOS we have a short timeframe to build our relationships and to leverage them for the success of the program. We are lucky to have such dynamic contacts within PLAN for this reason, and I imagine that there would be further strength by having continuity within the AMIGOS program over time as well.

Overall the partnering process between AMIGOS and PLAN has been a positive relationship building. Like any relationship (think about our personal and family relationships), it takes time to build and a lot of give and take. But this relationship is one that has a great effect upon the success of the AMIGOS program in the Dominican Republic.