We tested the artificial intelligence interview tool. This is what we found.
[ad_1]
More than a year after the covid-19 pandemic, millions of people have been look for a job In the U.S. Artificial intelligence-driven interview software claims to help employers screen applications to find the most suitable candidates for the job.Reports from companies specializing in this technology Business is booming During the epidemic.
But as the demand for these technologies increases, Questions about its accuracy and reliability. In the latest episode of the MIT Technology Review podcast “In the machine we trust,” We tested the software of two companies specializing in AI interviews, My interview with Curious stuffWe found that changes in predictions and job matching scores raise concerns about what these algorithms are evaluating.
Start to get to know you
MyInterview measures the characteristics considered in the Big Five personality test, a psychological assessment often used in the recruitment process. These characteristics include openness, conscientiousness, extroversion, pleasantness and emotional stability. Curious Thing also measures personality-related characteristics, but instead of the Big Five, it evaluates candidates based on other indicators, such as humility and adaptability.
Hilk Sherman
The algorithm analyzes the candidate’s reaction to determine personality characteristics. MyInterview also compiled scores that indicate how closely the candidate matches the characteristics determined by the hiring manager for the position.
To complete our test, we first set up the software. We uploaded false recruitment information for office administrators/researchers on MyInterview and Curious Thing. Then, when prompted by the system, we construct our ideal candidate by choosing characteristics related to personality.
On MyInterview, we selected features such as attention to details and ranked them by importance. We also selected interview questions, which will be displayed on the screen when the candidate records the video answer. On Curious Thing, we chose the characteristics of humility, adaptability and resilience.
Hilke, one of us, then applied for this position and completed an interview for the roles of MyInterview and Curious Thing.
Our candidate completed the phone interview with Curious Thing. She first conducted regular job interviews and received 8.5 points (out of 9 points) in English proficiency. In the second attempt, the automated interviewer asked the same question, and she answered each question by reading the German psychometric entry on Wikipedia.
However, Curious Thing gave her English proficiency 6 points (out of 9 points). She completed the interview again and got the same score.
Hilk Sherman
Our candidate turned to MyInterview and repeated the experiment. She read the same Wikipedia entry aloud in German. The algorithm not only returned a personality assessment, but also predicted that our candidate’s match rate with the fake job was 73%, making her one of the best among all applicants we asked to apply.
[ad_2]
Source link
