Babylon Health makes a medical AI chat bot, Doctors question safety

While medical AI improvements have been happening in several sectors, there has been concern over an AI chat bot. Babylon Health has released a medical AI chat bot inside of their app GP at Hand. A Dr. Watkins has voiced opinions over the past couple of years that has stated this chat bot is dangerous. With every concern Babylon Health has been improving their AI, but when should they have to pull this from the market? Should the government let them keep making errors like this without a price?