Category Archives: software development

UCD Blog 2: What can we do to make better IT systems?

There is quite a lot of evidence both made by researcher and companies such as the Standish group and Google that one of the key success factors when developing computer systems is user involvement.

If you want to work with user involvement in your projects there are many user centered processes to choose from such as UCSD, rapid contextual design, and participatory design. These processes vary some in their values and ways of working, but I have chosen to see them as complimentary and when used in practice they are all good in different ways.

There is even an ISO standard that defines user centered design for those who are curious.

User centered design processes are iterative, and you iterate either between all the stages of the process, or the last three stages depending on the complexity of the organization, the requirements and the system built.

The first step in these user centered processes is to understand the context of use where you specify the user and organizational requirements. This is usually done through using one or several of the following methods:

  • Interviews
  • Meetings with users
  • Workshops
  • Field studies
  • Vision seminars

After you have done work on understanding the context of use you move on to specifying the user requirements. This is usually done through using one or several of the following:

  • Personas descriptions
  • Scenarios
  • User Stories
  • Usability goals
  • Vision seminar documentation

When this is done, you work with producing design solutions of different kinds. This is usually done through using one or several of the following methods:

  • Paper prototypes
  • Wireframes
  • Sketches
  • Prototypes

The last step in this iterative design process is the evaluation of the prototype. This is usually done through using one or several of the following methods:

  • Expert evaluation
  • Prototype interview
  • Formal evaluation (in a lab)
  • Informal evaluation

Knowing how to use user centered methods, in what context and in what format is really a professional skill in itself, and I will not elaborate further on the topic in this blog post but recommend the books Rapid Contextual Design and Användracentrerad systemutveckling (in Swedish) for the curious reader.

The next blog post in this series will elaborate on the problems encountered when trying to establish or institutionalize user centered design and UX in organizations.

Visit at the University of Pretoria – Now My Research Batteries are Fully Charged Again with Inspiration:-)

My visit to the University of Pretoria was really great.

I am so happy I took the time to do this despite a full calendar!

I met Helene Gelderblom and her research group “UX in South Africa”.  They do research related to establishment of UX in organizations. This is indeed very related to the large majority of my research projects. See for example the blog posts on the SISU project and the blog post describing my PhD.

The whole visit was very well organized, and I had meetings with very many interesting people about their research in my areas such as research on eHealh, professional competencies, management and IT and why UX is not included in software development.

During the week, I did a seminar in one of their courses, see previous blog post. I also did an open seminar for the whole department, and participated in a workshop where we discussed their research studies. There were indeed many extremely relevant and interesting studies presented. I was impressed with the depth and quality of their work! This gave me inspiration, and also motivating to continue doing research in this area!! My research batteries are now fully charged again J

I also helped some with reviewing an application for funding. If funded the project would create a platform for their UX in South Africa work, including funding for traveling etc. I really hope that they are funded! They are so worth it given their ambitions and the quality of their work!

The visit resulted in a plan for a journal publication and trying to edit a special issue on our topic.

This weekend we also went on a safari together. The elephant experience was really something special. We go to see wild elephants just two meters away. Such an amazing experience!

UCD Blog 1: IT Projects are Seldom Successful, and IT for Work is Problematic 

The last few weeks I have done lectures related to IT and UCD in different organisations.  I will do a blog series about these lectures, and I will also write some words about the different aspects that have been discussed in these seminars. I start out by saying a few words abou the situation with IT projects and the quality of IT systems.

Many investigations conclude that a majority of IT projects fail and do not deliver on time, on budget and with a satisfactory result. According to the Standish group’s definition of success only around 30 % of all IT projects are successful. This means that around 70% of all IT projects deliver too late, with low quality or with unsatisfactory results. These numbers are really horrible!

If one look at the computer systems for work, the problems are obvious and enormous. This is for example reflected in the organisation Unionen’s reports on digital work environment for white collar workers in Sweden.  These reports are based on surveys to employees that are members of the union named Unionen. They are named in the following way (translated from Swedish), and I let the titles speak for themselves:

2008: Why does not it get any better ?
2010: A system error ?
2011: Always Connected – Never Relaxed.
2012: One step ahead and two steps back.
2014:- No Lighting in sight.

The IT systems in health care do not work any better, as can be discvovered when reading any newspaper. The headlines in the photo to this blog post show some of the recent ones that I could find, and here you see some of the problems in the headlines:

X-ray Care has Large Problems Due to New IT system

Mapping shows: Non-stable IT support in ambulance care

Windows update reason for enormous breakdown at the hospitals in Uppsala

Stockholm cleans up among health care systems – investing 200 millions

Collaborative Project with the Department of Finances

My research group, the  HTO group have just worked out a contract for a participatory research project with the finance department at Uppsala University.

In this project we will collaborate with the department of finances and do action reserach related to the following areas:

  • Usability mentoring about working in different roles with the aspect of digital work environments in mind.
  • Vision seminars about the future work with economy with a special focus on communication, development of competencies and deploymen of IT.
  • Education and the introduction of new IT systems.

We will be recruiting people to this project – so look out for the ad.We are looking for reserachers who have a PhD in areas related to digital work environments, and who are looking for a post doc position in a dynamic and growing reserach group.

🙂

Collaboration with the Department of EMR in Region Uppsala

We have had a very good collaboration with the department of EMR in the Region Uppsala since a few years. We call this collaboration the Dive (Digital work enVIronment and Ehealth) project, and we are a group of 3-4 reserachers who participate.  This collaboration has been in the form of an action research project where researchers from our department worked togehter with people from the EMR department in designing a new IT system for surgical planning. We have also collaborated in doing some evaluations of usability aspects that has been used in the deployment of the system. We will also do follow up evaluations of usability. Now we have moved on to looking into decision support systems, and my collegues do vision seminars and will work on a design.

The department of EMR also collaborate with us around the IT in Society class  that has resulted in a report, a presentation and also visibiliy at Vitalis 2017.

The Disa project is also supported by the department of EMR, and we collaborate around this project too. This project includes around 10 reserachers who will look into the effects of digitaliczation in health care and the project will result in concepts and a eWorkenvironment framework possible to use when implementing IT in health care. The department of EMR has an excellent and very active representative on the advisory board of the project who has helped us a lot in understanding the organisation.

In these kinds of collaborations it is crucial to find a win-win situation, where both the reserachers and the organisations feels that they get energy and effect from the collaboration. In our case the collaboration in the  Dive project has given us much insight in eHealth development and in the complexities of working with IT in health care, which is crucial to be able to work in that area. And I know that the department of EMR are very pleased with the input regarding design that we have given hem. The Disa project has just started, and hopwfully that will result in a win-win too.

We are extremely happy about this colllaboration, and strongly recommend other reserach groups to try the same approach to collaboration!

Uppsala University Psychosocial Care Programme: U-CARE

Since not so long I am connected to “the Uppsala University Psychosocial Care Programme: U-CARE” as a member of an advisory group for the programme (programberedning). 

U-CARE is one of the Swedish government’s strategic research programmes and started in 2010. U-CARE studies how people with physical illnesses and their families are affected psychosocially, and what help they need to deal with various psychological problems. U-care are developing self-help programs for these disorders. They are also working to develop and continuously improve an Internet platform (U-CARE portal) through which it is possible to offer and study the effect of psychosocial support and psychological treatment.

You can find a very informing YouTube film about U-care here: https://media.medfarm.uu.se/play/video/embed/4392

A few weeks ago Helena Grönqvist visited our department to present their work with U-care and the how the programme has developed. You can find the seminar at the seminar series on “Current Challenges in Biomed-IT”

 

 

In this seminar Helena Grönqvist talks about that they forgot to include the users in a structured way when developing the U-care platform and that they ran into problems due to this mistake. She also talked of the problems they encountered using Scrum and Agile.

(Not including the users is really a very common mistake, and I have written a few papers on user are included in Scrum projects (You find some of them here at Reserach Gate). Such a common mistake!)

They have now changed their way of developing the U-care portal so they now have a cyclical process where the users are included and a part of the development.

Some of the challenges that U-care face in the future, according to Helena Grönqvist, are:

  • New technology changes what users want. Do they need to have the portal avaliable on different platforms?
  • Legislation and for example the professors’ privelege is a problem since they want U-care knowledge to be open access.
  • Implementation problems: It takes 17 years until their innovation is implemented in health care. How can we make things move faster?

I am really looking forward to continuing this work and I will keep you updated on the work. 🙂

My PhD thesis: Usability – Who Cares?

It’s been almost seven years ago that i defended my PhD that is a collection of eight papers related to the establishment of User Centred Design (UCD) in organisations when developing IT for work. You find the thesis in the university system Diva.

The fundamental idea on which the thesis work is is based is that future work situations, usability of systems, and users’ needs, must be considered when developing computer systems for work, in a manner which involves the entire organisation. Usability needs to be a part of, for example, the organisational culture, strategy documents, budgets, and methods for procurement. During my PhD work I participated in large action research (see blog posts about this) projects in eight different organisations.

It took me eight calendar years to finish my PhD education (!), but four years of full-time work since I got three of my children during this period. We have paid parental leave in Sweden, and I was off for a bit more than a year for each kid.  My supervisor Jan Gulliksen was very engaged, and the best supervisor I could get. Towards the end of the process I was a single mother of three boys, and with the support of my parents and collegues I managed to wrap things up.  This was not easy, as you can imagine. But somehow this very stressful life situation made the thesis writing the fun part of life! I honesly also think that the text became better since I just wrote down things I have learned without any aim of it being perfect or complete.

The thesis has three research questions:

  1. What happens when UCSD is introduced in a public authority?

I was also interested in the values and perspectives of people involved in the organisation as well as how UCSD can be introduced through new methods that affect the values and perspectives of the stakeholders including the system developers in the organisation. Therefore, this thesis also aims at understanding the following questions:

  1. How do perspectives of stakeholders in systems development projects affect the work with UCSD, usability and users’ health in the organisations studied?

The final question addresses the issues of how we can address the introduction of UCSD and change perspectives:

  1. What new methods can be used to introduce UCSD and to influence perspectives?

 

Many answers to the questions in the thesis are still valid today, and it is indeed very difficult to establish a human centred perspective and UCD in organisations. One can wonder why this is the case? Some of my findings presented in the thesis are presented as the problems with establishing UCD when developing computer systems for work:

Some organisational problems found in the study presented in papers Sandblad et al (2003) and Cajander (2007).

Organisational problem Description of problem
Focus on surveillance and control ·    Detailed supervision of work and work performance through computer system.

·    Some saw surveillance as contributing to productivity

·    Some expressed that surveillance implied mistrust from management level

Administrative work was regarded as trivial ·    It-professionals claim that they have a good picture of case handling and core business.

·    Administrative staff believe that their work is much more complex than is generally understood

 

Development of IT systems based on technology and process descriptions ·    Abstract models of work as flow diagrams guide the development of new computer systems.

·    This has lead to some inflexible computer systems that shape work

·    Situated nature of work (Suchman, 1987) not taken into account

IT-department and users – two separate worlds ·    Alienation between groups and little understanding of the needs of the other group
Usability in systems development ·    Little or no usability activities in system development.

·    Few usability goals in the requirements specification

·    Usability activities often limited to test

·    Usability perceived as a vague and unclear concept

I also explore some (at the time of the thesis) new methods to work with the establishment of UCD:

  • System developers doing field studies to see the context in which the computer systems they build is used.
  • Usability coaching
  • Usability Index
  • Management’s perspectives on usability
  • Collaborative policy writing

I hope that some of you who work with usability take the time to skim parts of the thesis!

 

 

 

Seminar on Digital Work Environment with Examples from Health Care and DOME

Last week Gerolf Nauwerck and I did a presentation about Digital Work Environment at the Swedish Ergonomic Society’s yearly meeting. This blog post will shortly describe this presentation. It was the first time that Gerolf and I presented together, but despite limited time for preparing it went really well much thanks to Gerolf and an enthusiastic audience.

Gerolf started off the presentation by discussing the term Digital Work Environment that is used by for example Digitaliseringskommissionen, Prevent and Vision. For example Digitaliseringskommisionen defines it as:

 “The work environment in the digital economy”.

There is no scientific definition of the word, and in research other terms are used such as work engagement and healthy work.

Twenty years ago there were numerous different professions that worked with different tools, but working life has changed and today most work is done using a computer or an iPad, or other ICT technology, see image below:

arbete-fo%cc%88ra%cc%88ndring

When looking at the digital work environment there are numerous alarm reports from health care such as Isabella Scandurras “Disturbing or Facilitating“. Most health care professionals use around 25 different computer systems in their work, and these are often not connected or made to work well together even though they spend much of their time working through these systems. Physicians spend around 50% of their time working with the computer, and around 50% doing other things such as meeting patients. There are numerous media articles about the problems with ICT in health care, see the picture of the blog post. The problems are alarming, and health care professionals are as a consequence not always positive to changes related to IT.

One example of digitalisation in health care is medical records online for patients. Most physicians and nurses are very worried of the effects of this system. Mostly they are worried about the effects on the patient, but they are also worried about the effects on their work environment through the following changes:

  • Changes in well established work routines
  • Time pressure
  • Less time for preparation
  • Increased risk of misjudgements

Health care is not the only area where the digital work environment is problematic. Unionen (one of the largest Swedish unions) distribute a yearly or biannual survey to their members to investigate the digital work environment. The sub-titles of their reports called “The digital work environment of white-collar workers” tell us about the results from the survey:

2008: Why doesn’t it get better?

2010: A system error?

2011: Always online – never relaxed

2012: One step forward and two steps back

2014: No lightning ahead

In the seminar we continued with discussing what is known about software development and success factors, and we presented the results from the CHAOS report and research reports that show that one of the most important things when developing good IT for work is user involvement. But I guess that you already knew that 🙂

 

What is DOME? Some Words about the Background and the Consortium from My Perspective.

I have collaborated with the county council in Uppsala since 2003 as a part of the project course IT in Society. In this course I collaborate with my husband Mats Daniels who does research on learning environments for developing professional competencies related to IT systems development. The course is based on the teaching strategy of Open Ended Group Projects. Through this course we worked on the topic “Medical Records Online for Patients” a couple of three times between 2003 and 2011. The students did thorough research as a part of their course, and they also wrote one of the white papers that the county council sent to Brussels to get funding for the SUSTAINS project.

Around 2012/ 2012 the large EU project named SUSTAINS started and was coordinated by the county council in Uppsala. Mats Daniels and I were contacted by the project managers Benny Eklund and Leif Lyttkens (with whom we collaborated in the IT in Society course) who asked if we wanted to start a research project and do research on the implementation and consequences of putting medical records online in Uppsala county.

The SUSTAINS project had a meeting in Uppsala around new years eve in 2011/2012 and my husband and I set up a brief document describing the major ideas behind a research project and you still find these ideas in DOME today. These idead were presented at the meeting to see if there were other researchers interested:

  • Three work packages:
    • 1) patients & relatives
    • 2) health care professionals
    • 3) systems development and implementation
  • Multidisciplinary research
  • Studies on the effects of the implementation from different perspectives using both qualitative and quantitative research methods.

My main research areas are IT and work, and how we develop and implement IT for work. However, in DOME I have not only done this but also research looking at the implementation from the patient perspective.

After this initial meeting we organised a few start up meetings in Uppsala for researchers that would be interested in this work. We got help from the EU coordinators at the university to find people, and somehow the words spread and we became a group of around ten people very quickly. I had never met most of these researchers, but we had very open and creative discussions.

During the first years the DOME project had funding from VINNOVA, and the last few years it has changed into a research consortium that consists of  researchers with funding from different sources. This fall we have funding from AFA through the EPSA project, Forte through the DISA project as well as strategic research funding through Örebro University and Uppsala University. This spring there will also be some funding from NordForsk through a new centre for gender research, and from Forte through the PACESS project.

The number of active researchers in DOME has varied over the years, but we are around 12-15 people that participate in meetings and do studies on medical records online. We come from six different universities, and we meet using Skype every three weeks and have a conference every semester at one of the universities. The next DOME conference is organised in Skövde in March 2017. DOME has a small group of leaders, and I am the coordinator of the consortium.

DOME is an open consortium and the only criteria for joining us is that you want to do research in the area of medical records online for patients, and that you spend time with us in DOME.  You can come from any area of research, and any university. 🙂

Working with Usability in Scrum Projects – what Usability Activities are Used in Practice?

A few years ago Yuan Jia worked with Marta Larusdottir and me as a master student doing her master thesis study in our research project on Agile development and UCD.

There was lack of studies describing to what extent different user centred methods were used in Scrum projects, so this became the topic of Yuan Jia’s master thesis, and which resulted in a conference paper. I remember that we had a very good collaboration with Yuan Jia, who now is a PhD student in the US.

When designing the study we quickly ran into problems with the number of respondents to our web based questionnaire. We did not have the mail contact information to people in organisation working with Scrum and user centred design. First we distributed the survey through the Uppsala Tax Office and LokaIdelen which is a website offering information to companies in Sweden. I also remember Yuan Jia’s long lists of company names and phone numbers as she systematically contacted company after company. Tedious work, but to be honest research work can be very much administration from time to time. In the end we had around 50 people who answered the survey 🙂

The survey has some interesting results, se Figure below. The most commonly used usability technique in Scrum projects is workshops, followed by lo-fi prototyping, interviews and meetings with users, all used by more than half of the participants.

One can note that all these usability techniques are informal, meaning that these techniques can be used quickly without much preparation. Formal usability evaluation with users is a highly ranked technique by the participants but not commonly used by them.

 

the-usage-of-usability-techniques

 

We presented the paper at the Human Centred Software Engineering Conference (HCSE) in 2012.

You find the paper here.