Demystifying the User Experience: A Case Study on Online Job Search Engines

Chynar Amanova; Sena Bulak  Ozgur; Fortunata Msilu; Fatih Demir

doi:10.29333/ajqr/11411

Chynar Amanova ¹ ^* , Sena Bulak Ozgur ², Fortunata Msilu ², Fatih Demir ³

More Detail

AM J QUALITATIVE RES, Volume 5, Issue 2, pp. 233-250

https://doi.org/10.29333/ajqr/11411

OPEN ACCESS 1537 Views 6901 Downloads

Download Full Text (PDF)

Abstract

Since the onset of the COVID-19 pandemic in 2020, the demand for job search engines has increased because of the availability of searching for remote job positions. However, there is still a lack of research on how people interact with different job search engines. It is critical to assess the effectiveness and efficiency of these tools for people searching for jobs because search engines help job seekers find positions that best fit their qualifications. This study assessed a job search engine by utilizing surveys, interviews, and observational methods to provide an improved understanding of individuals’ behavior and decision making in their search for career. The results showed that the job search engine needs improvement in the usability aspect because the website has an unintuitive interface and features, suggesting novice users may face difficulties in using it. The findings contribute to the limited body of literature that examines the user experiences in searching for jobs.

Keywords: Usability, Job Search Engine, Online Recruitment, System Usability Scale, Satisfaction.

References

Agazzi, A. E. (2020). Study of the usability of LinkedIn: A social media platform meant to connect employers and employees. https://arxiv.org/abs/2006.03931
Ahmed, S., Tahir, H., & Warsi, S. W. (2015). E-recruitment transforming the dimensions of online job seeking: A case of Pakistan. International Journal of Human Resource Studies, 5(1), 96–105. https://doi.org/10.5296/ijhrs.v5i1.6161
Al-Kinani, M. N. H., Adetunmbi, S. B., & Hussain, A. (2020). Usability testing of mobile flipboard application on both non-users and novice users. International Journal of Interactive Mobile Technologies, 14(5), 47–56.
Arora, S., & Kumari, N. (2021). Recruitment search engines for screening resumes through AI by using Boolean search functions. Journal of Asian Development, 7(2), 16–26. https://doi.org/10.52941/jad.v7i2.23
Attaran, M., Attaran, S., & Kirkland, D. (2019). The need for digital workplace: increasing workforce productivity in the information age. International Journal of Enterprise Information Systems, 15(1), 1–23. https://doi.org/10.4018/IJEIS.2019010101
Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human–Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
Barak, A. (2003). Ethical and professional issues in career assessment on the Internet. Journal of Career Assessment, 11(1), 3–21. https://doi.org/10.1177/106907202237457
Barnum, C, M. (2020). Usability testing essentials: Ready, set–test! (2nd ed.). Elsevier Science.
Barnum, C. M. (2011). Usability testing essentials: Ready, set–test. Morgan Kaufmann.
Brooke, J. (1996). SUS: A “quick and dirty” usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & A. L. McClelland (Eds.), Usability evaluation in industry (pp. 189–194). Taylor and Francis.
Cho, C. H., & Hyun, J. H. (2016). What e-SERVPERF in recruiting websites does affect users’ perceived value, satisfaction, and revisit intention in Korea? Total Quality Management & Business Excellence, 27(7-8), 818-835. https://doi.org/10.1080/14783363.2016.1188658
Creswell, J. W., & Plano-Clark, V. (2007). Designing and conducting mixed methods research. SAGE Publications.
Csontos, A. (2019, August 17). All you need to know to run successful usability testing. https://uxstudioteam.com/ux-blog/usability-testing/
D'Silva, C. (2020). A study on increase in e-recruitment and selection process. International Journal of Research in Engineering, Science and Management, 3(8), 205–213. https://www.journals.resaim.com/ijresm/article/view/162
Demir, F., Karakaya, M., & Tosun, H. (2012). Research methods in usability and interaction design: Evaluations and case studies (2nd ed.). Lambert Academic Publishing.
Drost, E. A. (2011). Validity and reliability in social science research. Education Research and Perspectives, 38(1), 105–123.
García-Peñalvo, F. J., Vázquez-Ingelmo, A., García-Holgado, A., & Seoane-Pardo, A. M. (2019). Analyzing the usability of the WYRED platform with undergraduate students to improve its features. Universal Access in the Information Society, 18(3), 455–468. https://doi.org/10.1007/s10209-019-00672-z
Garg, R., & Telang, R. (2012). To be or not to be linked: Online social networks and job search by unemployed workforce. Management Science, 64(8), 3926–3941. https://doi.org/10.1287/mnsc.2017.2784
Ghasemifard, N., Shamsi, M., Kenari, A. R. R., & Ahmadi, V. (2015). A new view at usability test methods of interfaces for human computer interaction. Global Journal of Computer Science and Technology, 15(1). http://computerresearch.org/index.php/computer/article/view/1126
Gronier, G., & Baudet, A. (2021). Psychometric evaluation of the F-SUS: Creation and validation of the French version of the system usability scale. International Journal of Human-Computer Interaction, 37(6), 1571–1582. https://doi.org/10.1080/10447318.2021.1898828
Guion, L. A., Diehl, D. C., & McDonald, D. (2011). Triangulation: Establishing the validity of qualitative studies. EDIS, 8, 1-3.
Hartson, R., & Pyla, P. S. (2012). The UX book: Process and guidelines for ensuring a quality user experience. Morgan Kaufmann.
Hosain, M. S., & Liu, P. (2020). Recruitment through LinkedIn: Employers’ perception regarding usability. Asian Journal of Management, 11(1), 54–60. https://doi.org/10.5958/2321-5763.2020.00010.4
Hosain, Md., Hena, A., Arefin, M., & Hossin, M. (2020). E-recruitment: A social media perspective. Asian Journal of Economics, Business and Accounting. 16(4), 51–62. https://doi. org/10.9734/ajeba/2020/v16i430248
Huang, Z. (2020). Usability of tourism websites: A case study of heuristic evaluation. New Review of Hypermedia and Multimedia, 26(1–2), 55-91. https://doi.org/10.1080/13614568.2020.1771436
Hui, B., Wood, E., & Khalil, C. (2021, July). An analysis and evaluation of the design space for online job hunting and recruitment software. In International Conference on Human-Computer Interaction (pp. 365–383). Springer, Cham.
Indeed Editorial Team (May 31, 2017). Indeed delivers 65% of all hires made in the US from online sources. https://www.indeed.com/lead/indeed-delivers-65-percent-online-hires
Kochhar, R. (June 11, 2020). Unemployment rose higher in three months of COVID-19 than it did in two years of the great recession. https://www.pewresearch.org/fact-tank/2020/06/11/unemployment-rose-higher-in-three-months-of-covid-19-than-it-did-in-two-years-of-the-great-recession/
Lazar, J., & Preece, J. (2002). Social considerations in online communities: Usability, sociability and success factors. In H. van Oostendorp (Ed.), Cognition in the digital world (pp.127-15). Lawrence Erlbaum.
Leelavathi, D., Senjith, S. A., & Rafiq, M. (2020). An analysis on job seekers perception and behavioural intention towards online recruitment portals in Chennai city. Test Engineering & Management, 83, 9765–9771.
Lewis, J. R., & Sauro, J. (2018). Item benchmarks for the system usability scale. Journal of Usability Studies, 13(3), 158–167.
Lin, H. F. (2010). Applicability of the extended theory of planned behavior in predicting job seeker intentions to use job‐search websites. International Journal of Selection and Assessment, 18(1), 64-74. https://doi.org/10.1111/j.1468-2389.2010.00489.x
Lincoln, Y. S., & Guba, E. A. (1985). Naturalistic inquiry. SAGE Publications.
Majrashi, K., Hamilton, M., Uitdenbogerd, A. L., & Al-Megren, S. (2020). Cross-platform usability model evaluation. Multimodal Technologies and Interaction, 4(4), 1–23. https://doi.org/10.3390/mti4040080
Maurer, R. (2015). Online job searching has doubled since 2005. A minority of Americans still have trouble using online resources. https://www.shrm.org/resourcesandtools/hr-topics/talent-acquisition/pages/online-job-searching-doubled.aspx
Mehra, S., Visser, B., Cila, N., van den Helder, J., Engelbert, R. H., Weijs, P. J., Krose, B. J. (2019). Supporting older adults in exercising with a tablet: A usability study. JMIR Human Factors. 6(1), e11598. https://doi.org/10.2196/11598
Moreno-Ger, P., Torrente, J., Hsieh, Y. G., & Lester, W. T. (2012). Usability testing for serious games: Making informed design decisions with user data. Advances in Human-Computer Interaction, 13,1–13. https://doi.org/10.1155/2012/369637
Nielsen, J. (1993). Usability engineering. AP Professional.
Osada, K., Muke, P. Z., Piwowarczyk, M., Telec, Z., & Trawiński, B. (2020). Comparative usability analysis of selected data entry methods for web systems. Cybernetics and Systems, 51(2), 192–213. https://doi.org/10.1080/01969722.2019.1705552
Porteli, J. (2008). Researching a secondary school in Malta. In P. Sikes & A. Potts (Eds.), Researching education from the inside (pp. 80–94). Routledge.
Reile, D. M., & Harris-Bowlsbey, J. (2000). Using the internet in career planning and assessment. Journal of Career Assessment, 8(1), 69–84. https://doi.org/10.1177/106907270000800106
Rong, H. (2019). Developing heuristics for evaluating online recruitment websites. http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-421034
Sabha, S. (2018). Impact of online recruitment on recruitment. International Journal of Education and Research, 6(4), 47–52
Sauro, J. (2011). A practical guide to the system usability scale. http://www.measuringu.com/sus.php
Sauro, J., & Lewis, J. (2016). Quantifying the user experience: Practical statistics for user research. Elsevier/Morgan Kaufmann.
Shahbazi, R., & Hedayati, A. (2016). Identifying digital librarian competencies according to the analysis of newly emerging IT-based LIS jobs in 2013. Journal of Academic Librarianship, 42(5), 542–550. https://doi.org/10.1016/j.acalib.2016.06.014
SilkRoad (2017). Source of hire report. http://hr1.silkroad.com/source-of-hire-report-download
Stage, J. (2018). Commentary: Usability in theory and practice. Human–Computer Interaction, 33(2), 195–197. https://doi.org/10.1080/07370024.2017.1333908
Sundaram, A. (2011). Job aggregation search engine. https://library.ndsu.edu/ir/bitstream/handle/10365/29204/Sundaram_Anita_Computer%20Science%20MS_2011.pdf
Surmiak, A. (2020). Ethical concerns of paying cash to vulnerable participants: The qualitative researchers' views. The Qualitative Report, 25(12), 4461–4480.
Tractinsky, N. (2018). The usability construct: A dead end? Human–Computer Interaction, 33(2), 131–177. https://doi.org/10.1080/07370024.2017.1298038
Tullis, T. S., & Stetson, J. N. (2004, June 7–11). A comparison of questionnaires for assessing website usability. Usability Professionals Association 2004 Conference, Minneapolis, MN, USA.
Vaezi, R., Mills, A., Chin, W. W., & Zafar, H. (2016). User satisfaction research in information systems: Historical roots and approaches. Communications of the Association for Information Systems, 38(27), 501–532.
Vlachogianni, P., & Tselios, N. (2021). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 1–18. https://doi.org/10.1080/15391523.2020.1867938
Wadhawan, S., & Sinha, S. (2018). Factors influencing young job seekers perception towards job portals. AIMS International Journal of Management, 12(3), 199–212.
Wanberg, C. R., Ali, A. A., & Csillag, B. (2020). Job seeking: The process and experience of looking for a job. Annual Review of Organizational Psychology and Organizational Behavior, 7, 315-337. https://doi.org/10.1146/annurev-orgpsych-012119-044939
Wichansky, A. M. (2000). Usability testing in 2000 and beyond. Ergonomics, 43(7), 998–1006. https://doi.org/10.1080/001401300409170

Citation

Amanova, C., Ozgur, S. B., Msilu, F., & Demir, F. (2021). Demystifying the User Experience: A Case Study on Online Job Search Engines. American Journal of Qualitative Research, 5(2), 233-250. https://doi.org/10.29333/ajqr/11411

Amanova, C., Ozgur, S. B., Msilu, F., and Demir, F. (2021). Demystifying the User Experience: A Case Study on Online Job Search Engines. American Journal of Qualitative Research, 5(2), pp. 233-250. https://doi.org/10.29333/ajqr/11411

Amanova C, Ozgur SB, Msilu F, Demir F. Demystifying the User Experience: A Case Study on Online Job Search Engines. AM J QUALITATIVE RES. 2021;5(2), 233-250. https://doi.org/10.29333/ajqr/11411

Amanova, Chynar, Sena Bulak Ozgur, Fortunata Msilu, and Fatih Demir. "Demystifying the User Experience: A Case Study on Online Job Search Engines". American Journal of Qualitative Research 2021 5 no. 2 (2021): 233-250. https://doi.org/10.29333/ajqr/11411

Amanova, Chynar et al. "Demystifying the User Experience: A Case Study on Online Job Search Engines". American Journal of Qualitative Research, vol. 5, no. 2, 2021, pp. 233-250. https://doi.org/10.29333/ajqr/11411

Amanova C, Ozgur SB, Msilu F, Demir F. Demystifying the User Experience: A Case Study on Online Job Search Engines. AM J QUALITATIVE RES. 2021;5(2):233-50. https://doi.org/10.29333/ajqr/11411