How to Evaluate the Impact of a Theatre Residency

What a residency impact evaluation is for

A theatre residency can change an artist’s working conditions, creative practice, professional networks and finished work. It can also change a host organisation, local audiences, partner institutions and the wider field. Impact evaluation is therefore broader than monitoring outputs. It asks what changed, for whom, in what conditions, and how the residency contributed to that change.

The Alliance of Artists Communities notes that the nature of artist residencies, which provide time and space for artists to develop new work and transform their creative practice, eludes traditional metrics for assessing impact. It also argues that evaluation and assessment are essential for understanding and articulating impact. That is the right starting point: do not force a residency into a generic metric. Design the evaluation around the residency’s specific aims and the decisions it needs to inform.

Start with purpose, stakeholders and a theory of change

Before the residency begins, clarify its goals and design a programme that reflects them. The Alliance of Artists Communities recommends communicating those intentions to potential artists-in-residence, so that participants understand what the residency is trying to do and what evidence will be gathered. In practical terms, turn the residency’s aims into a simple theory of change: the resources and activities of the residency are expected to produce certain short-term outcomes, which may contribute to longer-term impact.

A residency may provide studio time, a fee, travel, mentoring, translation support, presentation opportunities or access to a partner theatre, depending on the programme. Those are inputs and activities. Outputs might include weeks in the studio, workshops, public sharings or completed drafts. Outcomes are the changes that follow, such as a new working method, a sustained collaboration, increased confidence or a work reaching a new language context. Impact is the longer-term difference these changes make to practice, organisations or the field. The distinction matters because counting activity is not the same as evaluating impact.

Different stakeholders need different questions. Artists may want to know whether the residency gave them useful time and resources. Hosts may ask whether relationships continued. Funders may ask what public value was created. Community or language partners may ask whether the exchange was reciprocal. A short evaluation cannot answer every question, so identify the three to five priority outcomes that matter most and explain what will not be evaluated.

Build an evaluation cycle, not a final questionnaire

Before: baseline, indicators and consent

Define the priority outcomes and choose indicators that can show whether they are occurring. Record a baseline: what was the situation before the residency? For an artist, that might include the state of a project, current working conditions, existing collaborators and access to resources. For a host organisation, it might include prior experience of international residencies, translation capacity or audience relationships. Plan consent, data storage and language access at the same stage. Participants should know why information is being collected, who will see it and how findings will be used.

During: monitor and adapt

The Alliance of Artists Communities recommends developing indicators during the residency to track and judge progress, and maintaining a willingness to change course. Monitoring is not only compliance. It is a chance to see whether the residency is producing the conditions it intended to produce. Keep a simple record of changes to the programme, unexpected outcomes, access needs and decisions. If an international residency is not providing adequate interpretation, that is evaluation evidence as well as a practical problem.

After: follow up, analyse and report

Collect immediate reflections at the end of the residency, but do not stop there. Where resources permit, follow up later to look for continuing effects: new work, applications, collaborations, presentations, translations, changes in working method or organisational capacity. Use contribution language rather than claiming sole causation. A residency may have helped an artist complete a draft, but other factors, including prior work and later support, also matter. Report negative and unexpected findings, because they are often the most useful evidence for adapting the next cycle.

Choose methods proportionate to the questions

There is no single method for residency impact evaluation. A useful design combines several kinds of evidence: semi-structured interviews, reflective journals, observation, documentation of work in progress, short surveys, partner records and follow-up conversations. For a small residency, a few well-planned interviews and a reflective log may be more credible than a large survey with a poor response rate.

The article Critical reflections on performing arts impact evaluations argues that it is more difficult to provide impact evaluations of the soft rather than hard outcomes of publicly funded performance arts. It also suggests that third-party evaluators may help overcome the challenge that many accepted approaches lie outside the skill or financial resources of smaller non-profit organisations, and that innovative methodologies may be more appropriate. The authors describe using drawing and colouring methods in their evaluation of a dance-theatre company’s staged productions and workshops. The lesson is not that every residency should use the same technique. It is that methods should fit the art form, the participants and the relationships being evaluated.

Illustrative evaluation questions by domain

The following questions and evidence types are illustrative, not a fixed template. Select only those that match the residency’s stated aims.

Handle soft outcomes and cross-cultural context

Soft outcomes, such as confidence, creative risk-taking, trust or a changed sense of possibility, are often central to a residency. They are also difficult to quantify. The critical reflections article cited above confirms this difficulty in performing arts evaluation. The response should not be to ignore soft outcomes or to dress them up as hard metrics. Use qualitative evidence, triangulate it with documents and observations, and be clear about what the evidence can and cannot show.

For international or cross-cultural residencies, language and context shape the evaluation itself. A survey written only in the host language may exclude the visiting artist or local collaborators. Interpretation, translated materials and interviews in participants’ preferred languages are part of good evidence gathering, not an optional extra. Avoid treating a country or culture as a single theatrical tradition. Identify the specific practitioners, languages, places and institutions involved, and ask who defines success. A residency that is valuable to a host theatre may be less valuable to an artist whose mobility, visa or caring responsibilities have shaped their experience.

Ethics, power and feedback

Evaluation can become extractive if participants are asked to supply stories, time and data without seeing any benefit. Explain the purpose of the evaluation, obtain consent, state how data will be stored and shared, and make clear how participants can withdraw. In cross-border residencies, provide interpretation and translated materials where needed. Do not evaluate artists only against the host institution’s norms. Consider unequal resources between partners and the practical constraints that shape what an artist can do during a short residency. Attribute cultural knowledge and labour accurately, and avoid quoting participants in ways that expose them to risk without agreement.

What documented residency evaluations show

National Playwright Residency Program

The National Playwright Residency Program was launched in 2012 by the Andrew W. Mellon Foundation in partnership with HowlRound Theatre Commons. Its stated vision was to give diverse playwrights the space, time and resources to create outside the gig model and to encourage deeper, more collaborative relationships between playwrights and theatres. The National Playwright Residency Program Assessment Report by Alexis Frasz and Holly Sidford, published in February 2021, organises its findings around impacts on playwrights, impacts on theatres, and impacts on the field and the canon. That structure illustrates a useful principle: separate the levels at which a residency is expected to have an effect.

National Theater Project

The National Theater Project Evaluation Report, produced by McNeil Creative Enterprises and dated 17 March 2023, acknowledges artists, presenters, producing theatres, advisors and funders who shared their expertise, reflection and experience. This is a reminder that residency impact is distributed across a network of stakeholders. Evaluation that only asks the resident artist for a satisfaction rating will miss the organisational, presentational and field-level effects that other partners can describe.

A practical evaluation checklist

1. Write the purpose: what decisions will the evaluation inform?
2. Map outcomes at artist, host, field and community levels; choose priority outcomes.
3. Define indicators and a baseline, including qualitative evidence.
4. Plan consent, data protection and language access before data collection begins.
5. Monitor during the residency and record changes to the programme.
6. Follow up after the residency for evidence of continuing change.
7. Analyse contribution rather than assuming sole causation; include negative findings.
8. Share findings with participants and use them to adapt the next cycle.

Common problems to avoid

• Counting outputs, such as residencies, workshops or performances, and calling them impact.
• Starting evaluation only at the end, when there is no baseline and no opportunity to adapt.
• Overclaiming that a residency caused a career change or a new work without considering other support.
• Using only satisfaction surveys and ignoring practice, relationships and longer-term effects.
• Designing evaluation in one language when the residency operates across several.
• Failing to report findings back to artists and partners.

Good evaluation is proportionate. A small residency does not need a large survey; it needs a clear question, credible evidence and honest reporting. The aim is not to prove that every residency transforms an artist’s practice, but to understand what changed, for whom, in what conditions, and what the programme should do next.