Farmer accidentally kills 25 acres of crops after trusting AI advice

Farmer accidentally kills 25 acres of crops after trusting AI advice AI chatbot suggested a treatment plan that completely destroyed sesame seedlings - Bookmark - CommentsGo to comments A farmer in China claims to have lost 25 acres of crops “overnight” after following pesticide advice from an AI assistant. The 67-year-old from Chuzhou in Anhui province had been using artificial intelligence software for a year prior to the incident, according to local reports, using it to ask for advice on everything from scheduling to fertilising. Initial success led to him trusting the AI and blindly following its instructions without confirming the information with other sources. After asking about the best course of treatment for controlling weeds and pests on sesame crops, the AI suggested a treatment plan that completely destroyed a large field of seedlings. Agricultural experts attributed the error to a herbicide called flufenacet, which can be harmful to sesame fields if not used in a highly targeted manner. “The seedlings were no good the day after I sprayed them,” the farmer told Taiwanese news site CTWANT. “The weeds and seedlings died together, and the seedlings died even faster.” The unnamed AI app that the farmer used reportedly carried a warning at the top of the dialogue page that stated: “AI generation may be incorrect, please verify.” Similar disclaimers can be found on popular AI apps like OpenAI’s ChatGPT and Google’s Gemini, though some users have suffered for not double checking answers provided by chatbots. Last year, a ChatGPT user developed a rare condition after using it for health and dietary information. In an effort to remove table salt from his diet, the 60-year-old man replaced it with sodium bromide on the advice of the AI assistant. After three months of using the chemical in his food, the man developed bromism, or bromide toxicity, and was admitted to hospital to be treated for psychosis – a common symptom of the syndrome. An article published in the Annals of Internal Medicine, which detailed the case, warned that artificial intelligence “can potentially contribute to the development of preventable adverse health outcomes.” The authors added that AI apps could “generate scientific inaccuracies, lack the ability to critically discuss results, and ultimately fuel the spread of misinformation.” OpenAI has since rolled out an upgrade for ChatGPT that provides better answers for health-related questions, though the company warned that its chatbot is “not intended for use in the diagnosis or treatment of any health condition.” Join our commenting forum Join thought-provoking conversations, follow other Independent readers and see their replies Comments