Nathaniel M. Glasser, Member of the Firm in the Employment, Labor & Workforce Management practice, in the firm’s Washington, DC, office, was a featured guest on the MIT Technology Review podcast, “Playing the Job Market,” hosted by Jennifer Strong. Adam S. Forman, Member of the Firm, also contributed to this podcast interview.

Following is an excerpt:

Jennifer:… in this third episode of our series on AI and hiring, we look at the role of games in the hiring process. …

Nathaniel Glasser: I think the underlying question was do these tools work? And I think the answer is ... in some circumstances they do. And in some circumstances they don't, a lot of it is, it is both vendor slash tool dependent and, also employer dependent and, and how they're being put to work. And then practically, what's the tool doing? And to the extent that we see problems and more specifically an adverse impact on a particular group, what are the solutions for addressing those issues? …

Nathaniel Glasser: So monitor, monitor, monitor, and if we see something wrong, let's make sure that we have a plan of attack to address that. And that might be changing the algorithm in some sense, changing the inputs or if it doesn't work, just making that decision to say, actually this tool is not right for us. It's unfortunate that you know, we spent a little bit of money on it, but in the long run, it's going to cause more problems than it's worth. And so let's cut ties now and move forward. And I've been involved in that situation before.

Jennifer: And he recalls a specific incident involving a startup vendor of AI-games.

Nathaniel Glasser: And unfortunately after multiple rounds in beta prior to going live, the tool demonstrated adverse impact against the female applicants and no matter the tweaks to the inputs and the traits and, and, and the algorithm itself, they couldn't get confident that it wouldn't continue to create this adverse impact. And they ultimately had to part ways and they went out to the market and they found something else that worked for them. Now that initial vendor, that was a startup five years ago, has continued to learn and grow and do quite well in the market. And, and I'm very confident, you know, that they learned from their mistakes and in working with other companies have figured it out.

Jump to Page

Privacy Preference Center

When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. This information might be about you, your preferences or your device and is mostly used to make the site work as you expect it to. The information does not usually directly identify you, but it can give you a more personalized web experience. Because we respect your right to privacy, you can choose not to allow some types of cookies. Click on the different category headings to find out more and change our default settings. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer.

Strictly Necessary Cookies

These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work. These cookies do not store any personally identifiable information.

Performance Cookies

These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site. All information these cookies collect is aggregated and therefore anonymous. If you do not allow these cookies we will not know when you have visited our site, and will not be able to monitor its performance.