Gender in impact evaluation: norms as well as numbers

27th November 2015

The World’s Women 2015, recently released by the UN, tells us that in 2015 women held 22% of parliamentary seats – almost double the level recorded in 1997 (12%).

But take a look at the latest available data showing which of the world’s parliaments have the highest proportions of women (981 KB PDF). In first place, Rwanda; in fifth, South Africa; at 41, Afghanistan and at 45, South Sudan; way down at 64, the UK and, even lower, the USA which shares 84th place with San Marino. Would anyone argue that this tells us which countries are more ‘gender equitable’ than others?

In its statistical summary of how women are faring around the world, the UN notes the ‘growing availability’ of sex disaggregated data and, of course, this is good news. But collecting separate data on males and females should be an absolute minimum requirement for all interventions.

And, while it provides much-needed basic information about an intervention’s ‘reach’, sex-disaggregated data tells us almost nothing about the gender-related impact of an intervention – because gender is not about men versus women. Injustice and inequality are not written into our chromosomes.

Fifteen years ago, Andrea Cornwall wrote that one of the biggest challenges for international development in effectively promoting change is the ‘pervasive slippage between “involving women” and “addressing gender”’. The same remains true today. Showing an increase in the number of women participants in an intervention is not the same as demonstrating gender impact.

In Addressing Gender in Impact Evaluation: What Should be Considered? (ODI), I’ve tried to show that gender is a process of judgement and values linked to stereotypes and norms about masculinity or femininity, regardless of somone’s born sex category. It is, of course, intimately entwined with sexuality and with other social hierarchies such as race or ethnicity; class, caste and socio-economic status; age; and, obviously, religious beliefs.

So, for instance, the IPU league table of parliamentary women illustrates well how projects to increase the number of women in politics don’t necessarily address stereotypes and norms around gender and politics. What if numbers increase but people still believe that a woman in politics has to ‘act like a (particular type of) man’? What if women in politics always end up in charge of social services ‘because they are more caring’? Did Margaret Thatcher help to challenge gender norms, or to reinforce them?

Gender affects everyone, all of the time. It affects the way we see each other, the way we interact, the institutions we create, the ways in which those institutions operate, and who benefits or suffers as a result of this. This is as true in an international development context as it is in any other.

So how can we do gender impact assessment differently? First, we need to build general agreement that when we talk about ‘gender’, we are talking about a social process of judgement and inequality.

Next, any assessment should start with a description of the major gender stereotypes, norms and judgements that hold sway in the context we want to assess. This should include conscious consideration of the beliefs of intervention staff members as well as community members. We need to think about how these perceptions might affect both interpretation and implementation of the intervention, particularly where they inform power and decision-making.

Clear answers to a range of questions about commonly-held beliefs are the solid foundation of good gender impact assessment. For instance:

  • Should decision-making power in the community only be held by certain types of men? (for example, men who are middle-aged, middle or upper class, belonging to the dominant ethnic group, those seen as physically and mentally ‘strong’).
  • Should only certain types of women be allowed to express an opinion on community matters? (for example, women judged ‘good’ because they are married, middle-aged, middle or upper class, or belong to the dominant ethnic group).
  • Even when women are allowed to express an opinion, must they then leave the final decision to male power-holders?
  • Are women who are believed to have transgressed norms of sexual behaviour stigmatised and excluded from power and decision-making?
  • Should young women should be seen and not heard?
  • Are young men assumed to be ‘hot-headed’ and therefore are not to be taken seriously?

An intervention’s impact on gender is best measured by asking whether stereotypes and norms like these changed for the better (or, indeed, for the worse) during the life of the project. Put simply, the question to ask is not ‘how many’ of anything, but whether anything changed for the participants, male or female.


This material was first published in BetterEvaluation, 20 Nov 2015.

Image: A village meeting in Kenya (Neil Palmer / CIAT, Flickr)


Leave a comment

The views expressed in Opinions posts are those of the author(s) and do not necessarily represent those of DLP, the Australian Government or DLP's partner organisations.



Gillian Fletcher

Gillian Fletcher

Gillian is a DLP Research Fellow with more than 15 years’ experience of working in, researching, and evaluating international development. Her PhD examined the gaps between rhetoric and practice in HIV prevention in Myanmar. Methodologically, Gillian has a strong commitment to participatory action research and reflective learning. She is based at La Trobe University's Institute for Human Security and Social Change. 

Read more

Related items

Uncounted: has the post-2015 data revolution failed already?

The Stiglitz-Sen-Fitoussi report tells us that how we measure affects what we do; and if our measurements are flawed, decisions may be distorted.

Opinion by Alex Cobham12th May 2015

Gender in impact evaluation: norms as well as numbers

Sex-disaggregated data tells us little about the gender-related impact of an intervention, argues DLP research fellow Gillian Fletcher, since gender is a process of judgement linked to norms about femininity or masculinity.

Opinion by Gillian Fletcher27th November 2015

Fiji's Roshika Deo - outlier, positive deviant or simply feisty feminist?

Priya Chattier will speak at DLP's 2016 Annual Conference. Her post here begins a short series on the conference theme of Power, politics and positive deviance.

Opinion by Priya Chattier 1st February 2016

Gender analysis, and thinking and working politically – bridging the gap

Guest post on Devpolicy  introducing panels at this week's Australasian Aid Conference

Opinion by Chris Roche14th February 2017

Innovation: transactional or transformative?

It's time to discuss how the word 'innovation' might mean different things to different audiences. 

Opinion by Chris Roche23rd March 2015

Thinking about women and girls makes development work better for everyone

A look at what happens when gender analysis is placed more squarely at the heart of governance work. (Guest post in The Conversation)

Opinion by Orlanda Siow7th March 2017

Climate change and adaptation in the Pacific Islands: watering down women's security?

Beyond 'adaptability'? In this guest post, Nicole George highlights the work of women leaders who are challenging a narrow adaptation agenda.

Opinion by Nicole George7th March 2014

Different development: walk the talk

The argument for asset-based approaches to development programming and practice that value communities' capacity, skills and knowledge.

Opinion by Gillian Fletcher14th April 2015

Taking the Results agenda to the next level?

In The Politics of Evidence and Results in International Development, Chris Roche and his fellow editors examine how practitioners have navigated, resisted and used the ‘results agenda’ for more transformational ends.

Opinion by Chris Roche15th July 2015

#Feminism: Digital technologies and feminist activism in Fiji

Guest post on Devpolicy on DLP work with research partners at University of the South Pacific.

Opinion by Tait Brimacombe14th March 2017

Coalitions for inclusion in Indonesia: communities and government tackling discrimination together

Following up to Luke Arnold on coalitions for disability inclusion in Indonesia, Angie Bexley introduces broader work on the inclusion of six marginalised groups.

Opinion by Angie Bexley22nd August 2016

Adding gender and power to the TWP agenda

Gender relations are full-blown power relationships. Yet in the development context, they are too often seen as value-neutral cultural arrangements. 

Opinion by Sally Moyle6th August 2015

Pacific power: new femininities and women's leadership in the Pacific

The educated, internationally connected women who are changing the way 'development' is done

Opinion by Ceridwen Spark24th June 2014

How can a gendered understanding of power and politics make development work more effective?

Guest post for From Poverty to Power on the launch of the 'Gender and Politics in Practice' findings

Opinion by Helen Derbyshire13th February 2018

Rules of thumb for women leaders in the Pacific, and beyond

Guest post for The Interpreter on 'Being the First'

Opinion by Ceridwen Spark22nd February 2018

Education against the odds: the work of a women's coalition in Papua New Guinea

PNG's BPW Port Moresby, a case study for a DLP research project, is an impressive example of local women networking without donor assistance to advance gender equity.

Opinion by Ceridwen Spark14th January 2016

Transparency and Accountability: learning through collaboration

How can the impact of transparency and accountability work be deepened? 

Opinion by Brendan Halloran10th June 2014

Cancer and the links between medicine and development

DLP Senior Research Partner discusses what cancer has taught him about the links between medicine and development. Guest post for From Poverty to Power.

Opinion by Chris Roche15th April 2015

Creative expression and women's empowerment in the Pacific

Through photography, theatre, dance and song, young Fijian women are finding new avenues for public expression and activism.

Opinion by Tait Brimacombe19th March 2015

'Sticky’ change: What international development can learn from adaptive management

Promoting and sustaining individual behavioural change is as important as building flexibility into development programming.

Opinion by Greg Power2nd December 2016

Perceptions of women in politics in Fiji: how to accelerate change?

Women are widely seen as entirely capable of taking on political leadership in Fiji. Yet when asked to think about 'leaders', many automatically see men in the role.

Opinion by Rachel Fairhurst20th January 2015

Does talking about corruption make it seem worse?

Examining the reluctance of those working in development to engage with the public on the complexity of corruption in poor countries. Guest post for The Guardian's Global Development Professionals Network.

Gender - the power relationship that Political Economy Analysis forgot?

While most development research is well on the way to embedding gender analysis, PEA - many donors' key analytical tool - largely ignores it.


Opinion by Evie Browne13th February 2014

Gender and power: six links and one big opportunity

Donors have recently made great efforts to understand power in partner countries. Yet they have largely ignored one of the most pervasive power relations – gender.

Opinion by Diana Koester21st May 2015