Requiring mental health service providers to disclose the use of artificial intelligence systems

Summary#

Introduction 1048-2026, sponsored by Council Member Virginia Maloney, would amend Chapter 5 of title 20 of the New York City Administrative Code. Its stated goal is to require mental health service providers to tell clients when they use artificial intelligence (AI); it is not law and is waiting in committee.

  • Providers located in the city that offer mental health services for compensation and use AI in connection with those services would have to give each client a notice before or when services begin.
  • The notice would have to say whether AI is used in client communications or in administering or delivering services, and whether AI may record, transcribe, summarize, analyze, or process communications.
  • It would also have to say whether a third-party vendor may receive or process client information. The notice must be in plain language, in English and designated citywide languages, and separate from general terms of service and privacy policies.
  • Disclosures could not violate applicable privacy laws or contracts, including a HIPAA business associate agreement. The bill would take effect 180 days after becoming law.

What it means for you#

  • Mental health service providers: Covered providers would have to prepare and give the required notice. The bill does not ban AI use or require client consent.
  • Clients: You would receive information about the provider’s use of AI and possible vendor processing before or at the start of services. The bill does not require providers to offer an option to refuse AI use.
  • Other city residents and businesses: The bill does not directly change their rights or duties unless they are covered providers or clients.

Money#

No cost information is in the available material.

  • Providers would need to prepare and provide notices in the required languages, but the bill gives no cost estimate.
  • The bill does not specify new city spending, fees, fines, or staffing.

What is unclear#

  • The bill does not identify which languages are the “designated citywide languages.”
  • It does not name an agency to enforce the disclosure rule or set penalties, complaint procedures, or oversight.
  • The bill refers to a federal definition of AI but the definition itself is not included in the supplied material.
  • It is unclear how providers should handle required notice information when a contract or privacy law limits disclosure.

Case for#

  • A possible argument for the bill is that clients should know when AI may be involved in their communications or care, including when a vendor may process their information.
  • Requiring notice before or at the start of services could give clients that information in a separate, plain-language document rather than burying it in general terms or a privacy policy.

Case against#

  • One concern is that the bill requires notice for AI use across a broad range of mental health services, but does not explain how providers should resolve conflicts between the notice and limits in privacy laws or contracts.
  • The bill requires disclosure but does not require consent or give clients a stated way to refuse AI use.
  • The bill does not specify enforcement, penalties, or how providers can confirm they have met the language requirement.