No matter of how long and carefully you prepared a usability test.
Sometimes, setting up your usability lab can be very complex and chances are that you will soon or later face some sort of technical issue.
Here is a brief guide on how to prevent and deal with them.
Test your setup before each study.
This is the best way to prevent any issue. Even though the setup hasn’t change from your last study, test it anyway.
What worked fine yesterday will not necessarily work today.
Check everything and pay special attention to:
- the stimuli: am I able to open what I’m testing in the devices I will be using? Is my stimuli displayed correclty?
- video recordings: are videos being recorded? Do I have enough disk space for all of them? Is the audio quality good? Is the volume too high/too low?
- the audio/video connection between the lab and the observation room
Avoid last minute experiments with your setup.
If your current solution works and unless you have plenty of time to undo things -days, not hours-, don’t make last minute changes.
Even connecting a bigger a screen in the observation room can turn into a problem.
If you are modifying your wired connections, take pictures, so you will be able to bring them back to their original state if you need it.
Always schedule a break between 30 and 60 minutes between the first and the second participant.
In most cases, you won’t need such a long break. You can use it to share your thoughts about the first session with your observers and, if necessary, to make changes to the testing script.
Have a backup setup ready.
If you are testing with smartphones or tablets, you should have a second device ready for use in case the first one stops working.
A little technical knowledge helps.
However, knowing the basics of how computers, networks and audio mixers work can be extremely useful in your daily job.
You don’t need to know how an engine works to drive a car, but being able to change a flat tire is indeed a plus.
Ensure your internet connection is reliable.
If you can only use wireless access, make sure you have a good coverage in the lab.
If you are testing on a mobile phone, make it sure it can also connect to a 4G/LTE network, in case your WIFI is down.
What if the website you're testing is down?
Companies, especially the largest ones, are made of departments and, the bigger the company, the less likely its departments talk to each other.
Usability tests are often managed by the UX/marketing/communication team and the IT guys are not always aware that there is a study running.
That means that your testing sessions may coincide with a maintenance window or with some new release that has been scheduled and you -and your client- were not aware of.
If the website goes down in the middle of a study, don’t panic. Take a deep breath and think that, most probably, it will be online again in a few minutes.
Use the time you have to ask questions to your participant and tell your clients about the problem, either via chat or email, if they are not observing the sessions.
There should be a break of 15-20 minutes between each session, so you already know you have some time available to spend waiting for the solution of the problem without affecting the rest of the scheduled participants.