What online tests have to achieve

Online assessments have become an integral part of modern recruiting processes – but with digitalization, the demands on the fairness and security of tests are also increasing. In this article, you can find out why test conditions are crucial, what current studies show and how proctoring ensures equal opportunities.

Test results have an impact on key areas of life such as education, career and health – and not only affect the self-image of the people tested, but also how they are perceived by others. As a “visible tool of psychology”, they also shape the social image of this discipline. This makes it all the more important that tests are carried out in a high-quality, fair and professional manner. This is because incorrect procedures or improper applications can have serious negative consequences. The issue of test fairness is becoming increasingly important, especially in the context of online assessments: digital administration brings many advantages, but also poses new challenges.

Why online assessments are becoming increasingly important in recruiting

Over the past two decades, online assessments have developed from an initially experimental approach into an integral part of modern personnel selection processes. What once began with pilot projects is now common practice in many companies. It is no longer just large corporations that rely on web-based, location-independent test procedures. Small and medium-sized companies are also increasingly turning to digital solutions. This development is due, among other things, to rapid technological progress, the ongoing digitalization of HR processes and the acceleration of digital selection procedures triggered by the Covid-19 pandemic.

In addition, more and more HR specialists have in-depth knowledge of business psychology and are systematically promoting the use of scientifically validated test procedures. Such tests enable objective, efficient and data-based decisions – and thus contribute to the quality and fairness of selection processes. Another key advantage of digital assessments is that they not only provide past-related information like traditional application documents, but also allow potential-oriented insights into key skills. These include problem-solving skills, the ability to learn and the ability to concentrate – skills that are becoming increasingly important in a changing world of work.


Open versus controlled test settings: which is fairer?

There are two basic test modes for conducting online assessments: Open mode and Proctored mode.

In Open mode, test takers work on the tasks independently, usually anonymously and without supervision. This setting offers maximum flexibility and is particularly cost-efficient, which is why it is often used for self-assessments or Screenings. However, this mode is associated with a number of challenges: There is an increased risk of attempted fraud, technical difficulties such as unstable internet connections can disrupt the test process, and there are potential inequalities in the framework conditions – for example due to sources of noise or differences in the technical equipment of the test subjects.

Proctored mode, on the other hand, is where testing is carried out under supervision via video conference. In this way, test conditions can be created that come very close to classic on-site testing. The advantages of this mode include a higher validity of the selection procedure, the possibility of observing behavior and the fact that a high degree of control is guaranteed despite the fact that there is no need to travel. At the same time, however, the Proctored mode also brings challenges – in particular a higher technical effort and the need to comply with strict data protection requirements.


Unsupervised = unfair? What the research shows

A meta-analysis by Steger et al. (2020) with over 100,000 test subjects shows that unattended tests lead to higher results on average. In particularly important selection procedures, so-called “high-stakes” situations, the difference even increases. Attempted cheating is considered a possible cause. However, factors such as test anxiety, different test conditions or group differences can also play a role. Interesting: Test anxiety is often higher in supervised tests (e.g. face-to-face tests), which can have a negative impact on performance. The observed effects are small but constant – and they show that not everyone cheats: Not everyone cheats, but even a small proportion can strongly distort the ranking order. In the USA, it is therefore common practice to check outstanding results by means of a so-called confirmation test in a test center. This involves taking a second, more difficult test under supervision.


Ensuring test fairness: What companies can do

Even small differences at group level can have a major individual impact in selection procedures. It is therefore crucial to take targeted measures to ensure fairness and minimize attempts at fraud. One of the most effective measures: Supervision through so-called proctoring systems.

Proctored mode from SCHUHFRIED

With Proctored mode, SCHUHFRIED offers a reliable alternative to on-site testing. Supervision is carried out by camera – without traveling, but with a high level of safety:

  • Manipulations are minimized
  • Test security is maintained as far as possible (e.g. no publication of tasks)
  • Valid and fair results are guaranteed
  • Compliant with DIN 33430

Participants also benefit from a more pleasant test environment and the opportunity to ask questions during the instruction phase.


Fairness and quality must also be guaranteed online

Online assessments have become an integral part of personnel selection – they are fast, objective and efficient. However, they can only remain fair and valid with the right framework conditions, such as the use of proctoring. This is crucial when making important decisions about careers and opportunities – for companies and applicants alike.

Sources:

  • Steger, D., Schroeders, U., & Gnambs, T. (2020). A meta-analysis of test scores in proctored and unproctored ability assessments. European Journal of Psychological Assessment, 36(1), 174-184. https://doi.org/10.1027/1015-5759/a000494
  • Ortner, T. M., & Vetter, M. (2024). Fairness, digitalization and higher demands on quality: Current developments in psychological diagnostics. Psychology in Austria, 44(4&5), 271-277.

Newsletter

Newsletter

Stay up to date on the latest tests, practical tips and tricks on subjects related to digital assessment or interesting offers for continuing professional development.