Emerging Tech Brew (2024-04-26)
Reece Hayden, senior analyst at ABI Research, said that in addition to the risks already inherent to generative AI—e.g., hallucinations, bias—agents could also drift in response consistency as they evolve based on their own interactions, compound the risk of fabrications as they network among each other, and slip in latency due to the complex processes required from agents.
“The risk with AI agents [is that] you provide them with the autonomy to iterate…change their responses, react to feedback, and all of those different elements. That brings in more challenges around response inconsistency,” Hayden said. “Guardrails for AI agents, who have a much wider understanding, who have a much wider reach across an organization, who can pull from different data sets, who can perform iterative tasks, are much more difficult to implement.”
Citation