Skip to main content

People, Personas and the Unpredictable

A few weeks ago I spoke at an event in London about the LocalGov Digital Content Standards and how they're helping councils make better websites.

Another talk covered user testing and the speaker showed a picture of session they'd helped facilitate. In the picture however, there were no real users, just personas.

Wikipedia describes a persona as "a social role or a character played by an actor" and it's not uncommon for digital teams to create persons to help them design the content, taxonomy and other aspects of their sites.

User testing by young people with learning difficulties
So in the picture I saw, council staff were interviewing other council staff who were role playing users. Now, there's nothing unusual about this in usability testing, however when I asked if they'd tested with real users the reply was "No, we tried that and they're too unpredictable".

This seemed bizarre and reminded me of an example of unpredictably that excluded someone from using one of digital services.

When we created a digital service for people to apply for free school meals we included a select field for the year of birth of the applicant. To make things easier for users, so we they weren't shown a huge list, we set the earliest year an applicant could be born in as 1950.

If you were to construct personas and decide which would apply for free school meals it would probably be those aged between 18 to 40 years old, so setting 1950 as the earliest date should have been fine shouldn't it? It wasn't.

A couple of months after launch we got a phone call from someone saying they they couldn't use our service. Why, because they were born in the 1940s. The unpredictably of a grandparent applying for free school meals had made the service unusable for them.

This was a great lesson for us, and as a result we've been testing out beta.westberks.gov.uk with users at an Age UK session, young people with learning difficulties (pictured above) at a local Post 16 facility, children's centre users and we plan to run more sessions with an even wider range of people.

As a result we've been learning out all sorts of things that I'm sure another member of staff playing a user wouldn't have been able to teach us. I'm not saying I think we've captured all the potential problems before we launch, but I bet we've found a lot more than if we'd just tested with personas, and of course the process of iterative improvement will continue after launch based on real user feedback both in user testing sessions and general use.

Personas have a purpose, but if you're creating new digital services or content I suggest you test it out with as many real people a possible. It's more work, but capturing as much unpredictable behaviour as possible will most certainly help you create a better product.


Comments

Popular posts from this blog

Digital best practice checklist

This week I finished the draft of a digital best practice check-list. It's not digital strategy, in fact I'm increasingly thinking organisations don't need a digital strategy, they need a delivery strategy. My draft has check-list of seven questions and recommendations, with one overall recommendation regarding best practice for delivering digital. Ideally it would be incorporated into a wider service and information delivery strategy. Below I've omitted the bulk of the content, the reasoning behind arriving at the recommendation from the question because it's still in draft, but here are the seven questions and eight recommendations: 1. Is the council properly promoting its digital services and content, to reduce avoidable contact? Recommendation: Establish a “digital first” ethos to the promotion of services and better targeting what, when and where they're promoted. 2. Are the digital services the council offers, especially where the design and

Carl's Conundrum of Internal Influence

I'm writing this partly as a reply to an excellent piece that Carl Haggerty published about the disconnect between internal and external influence and partly due to various conversations over the past month about how to make using tools like collaboration platform  Pipeline common practice. This isn't really about Carl though, or Devon County Council, or any other council specifically, it's more a comment on the influence of digital teams in local governments, or lack of, and how to resolve this. So here's the question that prompted this piece. How can someone who's been recognised nationally for their work, first by winning the Guardian's Leadership Excellent Award and who has more recently been placed in the top 100 of the Local Government Chronicle's most influential people in local government , "sometimes feel rather isolated and disconnected to the power and influence internally". First, let's consider whether is this a problem to

Pipeline Alpha

In September 2014, officers from 25 councils met in Guildford to discuss a platform to enable collaboration across Local Government. A "Kickstarter for local government" is the missing part to Makers Project Teams , a concept to enable collaborative working across different organisations put forward by LGMakers the design and development strand of LocalGov Digital . Based on the user needs captured at the event, LGMakers created collaboration platform Pipeline and by October people from over 50 councils had signed up . Pipeline is an Alpha, a prototype set up to evaluate how a Kickstarter for councils might work. It is a working site though, and is being used as the platform it is eventually intended to be, at present without some of finer features a live offer might have. So what have I've learnt in the eight months since we launched Pipeline? There's a strong desire to collaborate  LocalGov Digital isn't a funded programme. I wrote about how much it

Superfast highways

You may have seen this slide I put together to help explain digital transformation This week we launched a new beta service to report speeding traffic. It looks fairly simple but to give you an idea of what's happening in the background I thought it might be useful to show you the before and after. So here's the before and as you can see it's completely a manual process. Stuff might be recorded electronically but it takes someone to do something seven time to make the process work and send it to the parish or the district. Here's the after What this doesn't tell you is that it's basing whether the request is for the parish or district on three questions. It's also doing a spatial look up to find the parish and returning the parish clerk details using the Modern.Gov API. Because these are already part of our platform this is data that we currently maintain, so there's no additional work to keep this up to date and we've reduced the h

Defining transformation to a wider audience

For the past month I've been putting together a paper on the next steps of digital transformation, for the organisation I work for. I'm proposing we look at two capabilities and two business areas, and if approved I'll be writing more about it. It's been a great exercise in gathering my thoughts and helping me to define digital transformation to a wider audience and how it fits into the bigger picture of service improvement. Here's some of the stuff I've learnt or had affirmed: Transformation, digital or not, starts with understanding the needs of the user through research. This should be obvious, but in local government too often I've seen "build it and they will come" approach applied. It's unlikely a commercial operation would launch a new product without first researching the market, so why would a digital service be any difference? A couple of years ago I wrote how the phrase "digital transformation" was hindering digit