Later, the creator of this task, Felipe “The Computer Vision Engineer”, also took to YouTube to point out what the AI did wrong and there are some key details that need to be examined.
First of all, Devin failed in the most important part of the job – understanding the problem. You see, the original post said: “I want to do inferences with the models in this repository. Your output will be detailed instructions on how to do this in an EC2 instance in AWS. Please give your assessment to complete this work.”
Felipe couldn’t meet the requirements and match the different software versions, so the AI had to do it for him. However, Cognition only gave Devin the first sentence and told him to “figure it out.” Given that the request was in the second part, this is a significant mistake by the company, so the AI could not deliver the expected result, of course.