Since Amazon has exploded in growth and needs more and more employees to run things, they created a machine learning system to help them with the hiring process.
They recently scrapped the system though, as it was discovered in 2015 that the AI somehow learned to be bias against women while analyzing resumes. Since most resume's came from men (the tech industry is male dominated), the AI assumed males were better suited for the job. It even went so far as to subtract importance from the word "women's," and disfavored graduates from two all women's colleges. The AI also preferred typical male verbiage such as "executed" and "captured."
They haven’t been able to fix the system, thus leading to it being shut down.
For more info, check out Reuter's article!