Gender in impact evaluation: norms as well as numbers

27th November 2015

The World’s Women 2015, recently released by the UN, tells us that in 2015 women held 22% of parliamentary seats – almost double the level recorded in 1997 (12%).

But take a look at the latest available data showing which of the world’s parliaments have the highest proportions of women (981 KB PDF). In first place, Rwanda; in fifth, South Africa; at 41, Afghanistan and at 45, South Sudan; way down at 64, the UK and, even lower, the USA which shares 84th place with San Marino. Would anyone argue that this tells us which countries are more ‘gender equitable’ than others?

In its statistical summary of how women are faring around the world, the UN notes the ‘growing availability’ of sex disaggregated data and, of course, this is good news. But collecting separate data on males and females should be an absolute minimum requirement for all interventions.

And, while it provides much-needed basic information about an intervention’s ‘reach’, sex-disaggregated data tells us almost nothing about the gender-related impact of an intervention – because gender is not about men versus women. Injustice and inequality are not written into our chromosomes.

Fifteen years ago, Andrea Cornwall wrote that one of the biggest challenges for international development in effectively promoting change is the ‘pervasive slippage between “involving women” and “addressing gender”’. The same remains true today. Showing an increase in the number of women participants in an intervention is not the same as demonstrating gender impact.

In Addressing Gender in Impact Evaluation: What Should be Considered? (ODI), I’ve tried to show that gender is a process of judgement and values linked to stereotypes and norms about masculinity or femininity, regardless of somone’s born sex category. It is, of course, intimately entwined with sexuality and with other social hierarchies such as race or ethnicity; class, caste and socio-economic status; age; and, obviously, religious beliefs.

So, for instance, the IPU league table of parliamentary women illustrates well how projects to increase the number of women in politics don’t necessarily address stereotypes and norms around gender and politics. What if numbers increase but people still believe that a woman in politics has to ‘act like a (particular type of) man’? What if women in politics always end up in charge of social services ‘because they are more caring’? Did Margaret Thatcher help to challenge gender norms, or to reinforce them?

Gender affects everyone, all of the time. It affects the way we see each other, the way we interact, the institutions we create, the ways in which those institutions operate, and who benefits or suffers as a result of this. This is as true in an international development context as it is in any other.

So how can we do gender impact assessment differently? First, we need to build general agreement that when we talk about ‘gender’, we are talking about a social process of judgement and inequality.

Next, any assessment should start with a description of the major gender stereotypes, norms and judgements that hold sway in the context we want to assess. This should include conscious consideration of the beliefs of intervention staff members as well as community members. We need to think about how these perceptions might affect both interpretation and implementation of the intervention, particularly where they inform power and decision-making.

Clear answers to a range of questions about commonly-held beliefs are the solid foundation of good gender impact assessment. For instance:

  • Should decision-making power in the community only be held by certain types of men? (for example, men who are middle-aged, middle or upper class, belonging to the dominant ethnic group, those seen as physically and mentally ‘strong’).
  • Should only certain types of women be allowed to express an opinion on community matters? (for example, women judged ‘good’ because they are married, middle-aged, middle or upper class, or belong to the dominant ethnic group).
  • Even when women are allowed to express an opinion, must they then leave the final decision to male power-holders?
  • Are women who are believed to have transgressed norms of sexual behaviour stigmatised and excluded from power and decision-making?
  • Should young women should be seen and not heard?
  • Are young men assumed to be ‘hot-headed’ and therefore are not to be taken seriously?

An intervention’s impact on gender is best measured by asking whether stereotypes and norms like these changed for the better (or, indeed, for the worse) during the life of the project. Put simply, the question to ask is not ‘how many’ of anything, but whether anything changed for the participants, male or female.


This material was first published in BetterEvaluation, 20 Nov 2015.

Image: A village meeting in Kenya (Neil Palmer / CIAT, Flickr)


Leave a comment

The views expressed in Opinions posts are those of the author(s) and do not necessarily represent those of DLP, the Australian Government or DLP's partner organisations.



Gillian Fletcher

Gillian Fletcher

Gillian is a DLP Research Fellow with more than 15 years’ experience of working in, researching, and evaluating international development. Her PhD examined the gaps between rhetoric and practice in HIV prevention in Myanmar. Methodologically, Gillian has a strong commitment to participatory action research and reflective learning. She is based at La Trobe University's Institute for Human Security and Social Change. 

Read more

Related items

Innovation: transactional or transformative?

Innovation has become a popular word in international development. In Australia today, Bjorn Lomborg helped to formally open DFAT’s development innovation hub innovationXchange, which is designed to ‘identify, trial and scale up successful approaches’. Other donors, including the US and the UK, are also promoting innovation through initiatives like the Development Innovation Ventures programme.

Opinion by Chris Roche23rd March 2015

Different development: walk the talk

Spent the day at a ‘Doing Development Differently’ event recently and, while it offered a great opportunity to meet and hear from fascinating, dedicated, thoughtful people, I came away somewhat disheartened. Why? Because:

Opinion by Gillian Fletcher14th April 2015

Creative expression and women's empowerment in the Pacific

Art and creative expression have become an activist tool and alternative form of advocacy for young women in Fiji.

Through photography, theatre, dance and song, young women are finding new avenues for public expression. These innovative avenues for making their voices heard have great power in a context where women’s mobility and visibility is often constrained by socio-cultural norms.

Opinion by Tait Brimacombe19th March 2015

'Sticky’ change: What international development can learn from adaptive management

Promoting and sustaining individual behavioural change is as important as building flexibility into development programming.

Opinion by Greg Power2nd December 2016

#Feminism: Digital technologies and feminist activism in Fiji

Guest post on Devpolicy on DLP work with research partners at University of the South Pacific.

Opinion by Tait Brimacombe14th March 2017

Pacific power: new femininities and women's leadership in the Pacific

The educated, internationally connected women who are changing the way 'development' is done

Opinion by Ceridwen Spark24th June 2014

Gender in impact evaluation: norms as well as numbers

The World’s Women 2015, recently released by the UN, tells us that in 2015 women held 22% of parliamentary seats – almost double the level recorded in 1997 (12%).

Opinion by Gillian Fletcher27th November 2015

Gender - the power relationship that Political Economy Analysis forgot?

While most development research is well on the way to embedding gender analysis, PEA - many donors' key analytical tool - largely ignores it.


Opinion by Evie Browne13th February 2014

Does talking about corruption make it seem worse?

Guest post for The Guardian's Global Development Professionals Network

Thinking about women and girls makes development work better for everyone

A look at what happens when gender analysis is placed more squarely at the heart of governance work. (Guest post in The Conversation)

Opinion by Orlanda Ward7th March 2017

Resources and reflections on gender and thinking and working politically

Next week's meeting of the Thinking and Working Politically Community of Practice will focus on gender at an opportune time. It follows a spate of interesting papers, blog posts and talks about the relationship between 'thinking and working politically' and gender issues. 

Opinion by Chris Roche12th June 2015

Taking the Results agenda to the next level?

On new book The Politics of Evidence and Results in International Development

Opinion by Chris Roche15th July 2015

Coalitions for inclusion in Indonesia: communities and government tackling discrimination together

Following up to Luke Arnold on coalitions for disability inclusion in Indonesia, Angie Bexley introduces broader work on the inclusion of six marginalised groups.

Opinion by Angie Bexley22nd August 2016

Transparency and Accountability: learning through collaboration

How can the impact of transparency and accountability work be deepened? 

Opinion by Brendan Halloran10th June 2014

Education against the odds: the work of a women's coalition in Papua New Guinea

In October 2015 I met Anna, a softly spoken young woman who lives in Port Moresby, Papua New Guinea (PNG). We talked during the recess break at school and Anna told me about some of the challenges she faces trying to complete year ten, the final year of compulsory education in PNG. These include that she is beaten by her aunt and grandmother, they refuse her the bus money to get to school and that her aunt recently set fire to her text books. 

Opinion by Ceridwen Spark14th January 2016

Climate change and adaptation in the Pacific Islands: watering down women's security?

Beyond 'adaptability'? In this guest post, Nicole George highlights the work of women leaders who are challenging a narrow adaptation agenda.

Opinion by Nicole George7th March 2014

Cancer and the links between medicine and development

Guest post for From Poverty to Power

Opinion by Chris Roche15th April 2015

Gender and power: six links and one big opportunity

Donors have recently made great efforts to understand power in partner countries. Yet they have largely ignored one of the most pervasive power relations – gender.

Opinion by Diana Koester21st May 2015

Gender analysis, and thinking and working politically – bridging the gap

Guest post on Devpolicy  introducing panels at this week's Australasian Aid Conference

Opinion by Chris Roche14th February 2017

Perceptions of women in politics in Fiji: how to accelerate change?

Women are widely seen as entirely capable of taking on political leadership in Fiji; however, when asked to think about 'leaders', the public imagination automatically sees a man in the role.

Opinion by Rachel Fairhurst20th January 2015

Fiji's Roshika Deo - outlier, positive deviant or simply feisty feminist?

Guest blogger Priya Chattier speaks at DLP's 2016 Annual Conference at La Trobe University in Melbourne on Monday 8 February. Her post here begins a short series on the conference theme: Power, politics and positive deviance.

Opinion by Priya Chattier 1st February 2016

Adding gender and power to the TWP agenda

Thinking and Working Politically presents development to us as an endeavour embedded within power structures. This is so important.

It helps us see clearly that we need to understand domestic politics to deliver development outcomes. Who are the players? Who makes decisions? Who will stand to lose from a proposal and how can they block progress?

Opinion by Sally Moyle6th August 2015

Uncounted: has the post-2015 data revolution failed already?

Counting matters. As the Stiglitz-Sen-Fitoussi report puts it: What we measure affects what we do; and if our measurements are flawed, decisions may be distorted…. [I]f metrics of performance are flawed, so too may be inferences we draw.

Opinion by Alex Cobham12th May 2015