glueglue™ | Expert review vs Usability testing

SUMMARY:Usability testing and expert review are both valid methods. Leaving aside the time and the budget available, I can advise you to use one or the other method mainly depending on the objectives you want to achieve and the conditions of your product’s interface.

When it comes to improving the usability of a website or application we can find ourselves at a crossroads: conduct a series of tests on real users – usability testing – or request a review by one or more UX designers, with an expert review or UX review, as we call it here at glueglue.

Premise: the two options are not necessarily alternative to each other. In an ideal world, they should be dealt with one after the other, with a direct comparison of the results of the two different approaches. Anyway, we know that reality, made of deadlines and budget limitations, rarely meets the dream world. But let’s start from the basics.

What is a usability test?

Usability testing is a method used in order to understand how usable an interface can be through a series of tests conducted with real users. We usually ask a variable number of people interested in our service to try and complete specific tasks. Those tasks may vary depending on the website or application we want to test. An expert will observe and take particular care when users encounter a problem.

The advantages of usability testing

Every day we hear about user-centered design, and this is not by chance. Digital products that have been able to differentiate themselves over the long term are those that gave priority to the actual users’ needs. See the well-known Uber and Airbnb which have created industry wars by improving the lives of millions of unsatisfied users. And obviously their founders’, too. What’s better than getting feedback directly from the people I’d like to sell my service to? Here are the main advantages:

Authenticity of the results
If well conducted, a usability testing session leads to spontaneous and authentic results. Those are crucial in order to understand how to proceed and manage the efforts on the product.
Focus on specific actions
If you want to improve a specific area or action, e.g. your e-commerce, watching 20 different users add a product to their cart and complete the purchase can reveal deep and hidden problems.
You can say it: we are a user-centered company
There is no user-centered company that does not ‘listen’ to its users: a usability test puts the user at the center of the process. In fact, a video of a user who is not able to register is also incredibly effective.

The disadvantages of usability testing

High number of participants
There are countless debates on the exact number of useful participants. As a matter of fact, their task is to detect an actual amount of interface problems. An NN group study reveals that with 5 participants you have the best cost / benefit ratio. Especially if you have clear ideas on what makes more sense to test. However, this number may vary significantly depending on the product and its complexity.
Time…
The time used to conduct a usability test may vary. You will need a suitable place, an expert and at least 5 people who actually use your service. You will then have to process the data and focus on the essence of the conducted test. Consider at least 3-4 days in total to do things right.
Will to listen and learn
Obvious? Absolutely not. The mindset of the expert who conducts the test and will have to ‘read’ the results is key. It is not always easy to accept reality, especially when it’s uncomfortable. The will to listen and really improve the interface are fundamental requirements.

What is an expert / UX review?

An expert review, or UX review of a website or application, consists of a review made by UX designers (experts). They proceed to a cross-functional analysis of the product’s functional areas. Plus, they assign a percentage score to every area, highlighting the gaps. It allows to have an overview of the general usability and helps to prioritize improvement actions.

The advantages of an Expert or UX review

The figure of the UX designer is increasingly transversal and let’s say it, sometimes even “fashionable”. This is the case when a person with usability, information organization and visual design skills can really make a difference. No matter how unique a service or product is, it will always have to respond to a series of standard and consolidated patterns. This is why many of the problems of an interface can be detected easily. Here are the main advantages:

Easier times
Products may vary a lot (iOS and Android apps etc) but this is not really a problem. A skillful team of UX designers can bring to light a big amount of problems in less than 24 hours.
General view of the product
A UX review is the ideal way to start off on the right foot. It will allow you to have a global view of the state of the product and prioritize the actions.
Reduced costs
It’s safe to say that a UX review will give you very useful information with a few thousand Euros.

The disadvantages of the UX review

A matter of points of view
The output of a UX review is based exclusively on the point of view of a group of professionals, which is not necessarily bad, but it must be considered that the user has not actually been consulted, at least directly. This means that you will have to have great confidence in the experience and opinion of the experts at hand.
Superficiality of the analysis
As we said, this approach is particularly suitable when you want to have an overview of the usability of an interface. On the other hand, it will rarely give ideas regarding problems related to the typical way of use of a specific consumer in line with your target, considering the fact that users are not real customers.
Effective validity of the method
Here, again, there are several methods that can be followed, here at glueglue we rely for example on hundreds of questions divided into 9 main areas to which each UX designer assigns a score. These questions must be frequently updated to actually be effective and, in this case, we can say that the method chosen to proceed is of great importance.

Conclusions

Usability testing and expert review are both valid methods that allow us to identify the gaps of an interface and understand how to improve them. Leaving aside the time and the budget available, I can advise you to use one or the other method mainly depending on the objectives you want to achieve and the conditions of your product’s interface.

Do you have an e-commerce that presents different problems that are not yet fully identified? Probably an expert review will be the right choice, allowing you to photograph the product’s global status of usability and indicating the areas to focus on the most.

Do you have an application that has a low user registration rate? A usability test focused on this specific aspect will allow you to thoroughly investigate this specific feature and improve it accordingly.
These are just examples of how one or the other method can help you improve the usability and the product’s overall user experience, obviously every case has its peculiarities and must be carefully evaluated.
Choosing one or the other way can really make the difference.

Our replies
to your questions

Why choose glueglue?

We are a digital product agency with more than 10 years of experience and highly specialized skills in both design and development.
Over time, we have consolidated an agile and effective method to work best with all types of clients: from the start-up that needs some kind of support to the multinational corporation that wants to integrate a team with design and executive agility, our most appreciated peculiarity.
We are positioned in a medium-high market segment and are able to offer excellent value for money. Direct supervision by glueglue's founding partners of each project ensures the highest quality of service and finished product. We are on the top list of the best User Experience and digital product agencies on Clutch, the most widely used database of digital consulting agencies in the world.

How does glueglue work and what are the areas of expertise?

We always start with a careful analysis of the customer's needs considering not only the product needs but also the medium and long-term business objectives.
As a first step, we often deal with the visual identity, evaluating the positioning by analyzing the competitor and identifying areas for improvement in terms of branding and image.
Then, we move on to the UX/UI area: we study the user experience of your product or service through a UX Review with 3 dedicated professionals to identify the points which it is necessary to act to improve the usability of the site or app examined.
In the following phase, we design the User Journey Map, i.e. the map of all the paths that the user follows, interacting with the product and the brand . Identifying all the contact points is of strategic importance in order to immerse ourselves in situations of real use and understand where value can really be created for the end user and therefore for the product.
We will then move on to the phase of creating the wireframes, with the sharing of an interactive prototype that will define the functionality and structure of each single page and interaction of the product.
Once the wireframes have been consolidated, we will move on to the design phase of the graphic interface, with attention paid to the smallest details in so as to ensure a positive and truly satisfying user experience.
At this point, our developers come into play for the implementation part. We use the most current technologies such as React, Flutter, Gatsby JS, Symfony, Node.JS and others to create products with high standards of quality and stability, working and pixel perfect.

What distinguishes glueglue from other top design or product agencies?

To offer maximum value, the glueglue team works on a limited number of projects. In this way, our professionals can dedicate an uninterrupted focus to always obtain excellent results.
Each project is managed on the basis of precise deadlines and intermediate meetings with the client. We take care of the unique needs and potential of each product and consequently, each solution created is exclusive and highly customized.
Thanks to the experience of 10+ years in the digital sector, we have developed a successful method to achieve the highest goals in the areas that matter: strategy, design and development.

Can you do web design?

We work on all types of digital products, from iOS and Android apps to webapps and complex platforms.
Furthermore, part of the team specializes in creating marketing websites, i.e. websites totally focused on promoting the product or services.

Do you also do branding or should I look for another agency?

Being a full-service agency, we also offer branding services such as naming and logo design. Among the products we create for our customers, the brand guidelines stand out, i.e. the detailed guidelines document for the corporate image. We are totally comfortable working on existing guidelines or in collaboration with a branding agency.

How much does it cost to entrust you with a digital project?

We like to always be as transparent as possible and we believe that talking openly about the budget is important to understand how to get added value from the partnership for both parties. Given this, since each customer has its own peculiarities and presents different challenges, we do not use a price list, but we invest time to understand the customer's reality well and provide a specific approach and an appropriate price.
Indicatively, the price of user experience and graphical interface design projects can vary in a range between €10,000 and €30,000, depending on various factors such as the client's needs and the complexity of the project.
The cost of the projects in area Branding is positioned between €5,000 and €15,000, always taking into account any possible peculiarities.
As regards the more technical part, the cost for the development of iOS and Android web and mobile apps ranges from €20,000 upwards .
Website development starts from a minimum of €10,000. Our average hourly rate for single consultations is €60 per hour.
If you want to get to know us better, you can schedule 30 minutes free by appointment.

Do you also work with early stage startups, therefore with limited resources?

Of course, we love startups! Over time we have met many enlightened and highly talented entrepreneurs.
We have invested in some startups, preferring work for equity. Our experience has always been positive, contributing to the achievement of various rounds of investments for a total value of over 30 million Euros.

Expert review vs Usability testing