Chatbots face crisis alerts and disclosure rules

Summary#

SB-796 would add a new chapter to the Virginia Code, called the Artificial Intelligence Chatbots and Minors Act. Its supplied bill title refers to “Artificial Intelligence Companion Chatbots and Minors,” but the chapter name and text use “Chatbots.” The bill’s apparent goal is to reduce risks to users, including minors, from chatbot interactions; that is a goal, not a guaranteed result.

  • Covered entities—operators with at least 500,000 monthly active users worldwide, counted across their chatbots and affiliates—must use reasonable systems to identify emotional dependence and crisis signs, reduce related risks, and give crisis information to users showing signs of an acute mental health crisis.
  • Those covered entities must not let a chatbot materially falsely claim to be human. Operators of chatbots offered in Virginia, including operators below the user threshold, must keep a “not human” disclosure visible and give pop-up notices at login, every 30 minutes of sustained engagement, when asked, and when the chatbot is asked for regulated advice such as medical, financial, or legal advice.
  • If a covered entity learns a user faces imminent risk of death or serious physical injury, it must make reasonable efforts to notify emergency services or law enforcement within 24 hours, where practicable. Covered entities must report covered incidents to the Attorney General within 15 days.
  • The Attorney General may investigate, seek injunctions, and seek civil penalties of up to $50,000 per violation; each day of noncompliance is a separate violation. A person harmed by a violation, or a minor’s parent or guardian, may also sue for specified remedies.
  • The bill does not ban minors from using chatbots, require age checks, or prohibit explicit content as such.

What it means for you#

  • Chatbot users, adults and minors: You would receive persistent and timed notices that you are interacting with a chatbot. The bill does not require users to disclose their age or obtain a parent’s permission.
  • Parents and guardians: A parent or legal guardian could bring a civil action if a minor is harmed by a violation. The bill does not set out a separate process for parental involvement in chatbot use.
  • Chatbot operators: The disclosure rules apply to operators of chatbots offered in Virginia. The more extensive dependence, crisis-response, and incident-reporting duties apply to covered entities, with exclusions for certain non-public tools and narrowly described customer-service chatbots.
  • Covered entities: If they lack enough information to notify emergency responders, they must give the user crisis information, encourage immediate help, and document why notification was not practicable. A good-faith emergency notification has limited protection from damages.
  • Anyone harmed by a violation: The bill allows a civil suit for actual damages, attorney fees and costs, and court orders; punitive damages are available only if the violation was willful and wanton, reckless, or grossly negligent. Contract terms could not waive these rights or require arbitration of such a claim.

Money#

No publicly available information on estimated public cost.

  • Covered entities must build or use systems for identifying dependence and crisis signs, responding to emergencies, and reporting incidents. The bill gives no staffing or implementation cost estimate.
  • The Attorney General could incur investigation and enforcement costs; the bill allows recovery of reasonable case-preparation and investigation expenses and attorney fees in an enforcement action.
  • The bill sets civil penalties of up to $50,000 per violation, with each day of noncompliance counting separately. It does not estimate penalty revenue.

What is unclear#

  • The bill does not define how operators should decide that a user is emotionally dependent, what counts as “reasonable” steps, or what qualifies as an acute mental health crisis.
  • It does not set detailed standards for identifying users at risk, verifying a user’s location, or deciding when emergency notification is practicable.
  • It is unclear how the duties apply where more than one company operates or controls a chatbot, or how the exclusions for certain tools and customer-service bots would be applied.
  • The bill does not specify a start date. The supplied status says it passed the Senate, while the supplied text labels itself a proposed House committee substitute; the final wording and enactment are not shown.
  • The current Virginia laws that may overlap with or interact with these new duties were not supplied, so that relationship could not be verified.

Case for#

  • A possible argument for the bill is that it sets concrete duties for large chatbot operators when users show signs of crisis or reliance on a chatbot for emotional support.
  • Requiring visible and repeated notices may help users understand they are interacting with software, including when they seek regulated advice.
  • Reporting serious incidents to the Attorney General could provide information about harms while keeping reports confidential and allowing only non-identifying aggregate publication.
  • The bill offers both government enforcement and a way for harmed people to seek remedies in court.

Case against#

  • One concern is that key duties rely on terms such as “reasonable” and “emotional dependence” without detailed standards, which could leave operators uncertain about what compliance requires.
  • The bill creates substantial potential liability, including daily penalties and private lawsuits, but does not specify detailed procedures or limits for those claims.
  • The emergency-notification duty could be difficult to carry out when an operator lacks reliable information about a user’s identity or location; the bill does not fully resolve that problem.
  • The costs of building systems, handling reports, and defending claims are unknown, and the supplied materials do not explain how the Attorney General would oversee compliance.