Pennsylvania has filed a lawsuit against Character.AI, alleging that one of its chatbots unlawfully impersonated a licensed psychiatrist in violation of the state’s Medical Practice Act. Governor Josh Shapiro said residents must be able to trust whether they are receiving advice from a qualified professional, particularly regarding their health.
During testing by a state investigator, a Character.AI chatbot named Emilie claimed to hold a valid Pennsylvania medical licence and fabricated a licence serial number while providing guidance on depression treatment. Pennsylvania’s action is the first lawsuit to specifically target AI chatbots presenting themselves as medical professionals.
Character.AI said user safety was its highest priority and stressed that its characters are fictional and user-generated, with disclaimers in every chat. The company declined to comment further on the pending litigation.