Search for:

In brief

In a recent article titled The Cybersecurity of Gen-AI and LLMs: Current Issues and Concerns, the Cyber Security Agency of Singapore (CSA) provides helpful thought leadership on the security and privacy challenges associated with generative artificial intelligence (Gen-AI) and large language models (LLMs). The article outlines issues such as accidental data leaks, vulnerabilities in AI-generated code and potential misuse of AI by malicious actors, before providing recommendations on the steps that technology companies can take to address these concerns.


In more detail

The rapid growth of Gen-AI and LLMs has led to significant security and privacy concerns, and the key issues highlighted by the CSA include the following:

  • Accidental data leaks: Gen-AI systems, particularly LLMs, are susceptible to accidental data leaks, which may occur through overfitting or inadequate data sanitization. Sensitive information may be exposed when employees use ChatGPT for coding. The growing integration of AI in personal devices also increases the risk of data being inadvertently transferred to the cloud.
  • Risks in AI-generated code: The use of AI in coding increases cybersecurity risk because, without supervision, such code may contain undetected security flaws. Human oversight remains essential to mitigate such risks.
  • Misuse of AI: Malicious actors may leverage LLMs to exploit vulnerabilities identified in common vulnerabilities and exposures (CVE) reports. Such risks are generally reduced when training data does not include CVE descriptions.
  • Mitigating privacy concerns: Tech companies are helping to address privacy issues by controlling data usage, for example, by providing options for users to delete stored information and to prevent data from being used to train models. Users are nevertheless advised to refrain from sharing sensitive data with AI platforms.

The CSA’s list of best practices to address the privacy and security concerns associated with Gen-AI and LLMs include the following:

  • Enhancing employee awareness and training on associated risks
  • Reviewing and updating IT and data loss prevention policies
  • Ensuring human supervision over Gen-AI systems and LLMs
  • Staying updated on developments in Gen-AI and associated risks

Key takeaways

The article demonstrates the CSA’s cautiously optimistic outlook in the Gen-AI and LLM space, noting the sensitive balance required in developing responsible Gen-AI and LLMs. Understanding these realities and implementing the necessary guardrails will be critical for organizations keen on integrating Gen-AI and LLMs into their business processes.

* * * * *

LOGO_Wong&Leow_Singapore

© 2024 Baker & McKenzie.Wong & Leow. All rights reserved. Baker & McKenzie.Wong & Leow is incorporated with limited liability and is a member firm of Baker & McKenzie International, a global law firm with member law firms around the world. In accordance with the common terminology used in professional service organizations, reference to a “principal” means a person who is a partner, or equivalent, in such a law firm. Similarly, reference to an “office” means an office of any such law firm. This may qualify as “Attorney Advertising” requiring notice in some jurisdictions. Prior results do not guarantee a similar outcome.

Author

Andy Leck is the head of the Intellectual Property and Technology (IPTech) Practice Group and a member of the Dispute Resolution Practice Group in Singapore. He is a core member of Baker McKenzie's regional IP practice and also leads the Myanmar IP Practice Group. Andy is recognised by reputable global industry and legal publications as a leader in his field. He was named on "The A-List: Singapore's Top 100 lawyers" by Asia Business Law Journal 2018. In addition, Chambers Asia Pacific notes that Andy is "a well-known IP practitioner who is highlighted for his record of handling major trade mark litigation, as well as commercial exploitation of IP rights in the media and technology sectors. He's been in the industry for a long time and has always been held in high regard. He is known to be very fair and is someone you would like to be in the trenches with you during negotiations." Furthermore, Asian Legal Business acknowledges Andy as a leading practitioner in his field and notes that he “always gives good, quick advice, [is] client-focused and has strong technical knowledge for his areas of practice.” Andy was appointed by the Intellectual Property Office of Singapore (IPOS) as an IP Adjudicator to hear disputes at IPOS for a two-year term from April 2021. He has been an appointed member of the Singapore Copyright Tribunal since May 2010 and a mediator with the WIPO Arbitration and Mediation Center. He is also appointed as a Notary Public & Commissioner for Oaths in Singapore. He previously served on the International Trademark Association’s Board of Directors and was a member of the executive committee.

Author

Ren Jun Lim is a principal with Baker McKenzie Wong & Leow. He represents local and international clients in both contentious and non-contentious intellectual property matters. He also advises on a full range of healthcare, as well as consumer goods-related legal and regulatory issues. Ren Jun co-leads Baker McKenzie Wong & Leow's Healthcare as well as Consumer Goods & Retail industry groups. He sits on the Law Society of Singapore IP Committee and on the Executive Committee of the Association of Information Security Professionals. He is also a member of the Vaccines Working Group, Singapore Association of Pharmaceutical Industries, a member of the International Trademark Association, as well as a member of the Regulatory Affairs Professionals Association. Ren Jun is ranked in the Silver tier for Individuals: Enforcement and Litigation and Individuals: Prosecution and Strategy, and a recommended lawyer for Individuals: Transactions by WTR 1000, 2020. He is also listed in Asia IP's Best 50 IP Expert, 2020, recognised as a Rising Star by Managing IP: IP Stars, 2019 and one of Singapore's 70 most influential lawyers aged 40 and under by Singapore Business Review, 2016. Ren Jun was acknowledged by WTR 1000 as a "trademark connoisseur who boasts supplementary knowledge of regulatory issues in the consumer products industry." He was also commended by clients for being "very responsive to enquiries and with a keen eye for detail, he is extremely hands-on. His meticulous and in-depth approach to strategising is key to the excellent outcomes we enjoy."

Author

Ken Chia is a member of the Firm’s IP Tech, International Commercial & Trade and Competition Practice Groups. He is regularly ranked as a leading TMT and competition lawyer by top legal directories, including Chambers Asia Pacific and Legal 500 Asia Pacific. Ken is an IAPP Certified International Privacy Professional (FIP, CIPP(A), CIPT, CIPM) and a fellow of the Chartered Institute of Arbitrators and the Singapore Institute of Arbitrators.

Author

Sanil is a local principal in the Intellectual Property & Technology Practice Group in Baker McKenzie Wong & Leow. Sanil is qualified in both Singapore and Australia, and is a Certified Information Privacy Professional (CIPP/A) by the International Association of Privacy Professionals. Sanil is recognized as a Rising Star by both Legal 500 Asia Pacific in the Intellectual Property: Local Firms category as well as by IP Stars for his advisory work in the IP space. Sanil is also recommended by World Trademark Review 1000 for IP enforcement, litigation, prosecution and strategy.

Author

Daryl Seetoh is a local principal in the Intellectual Property & Technology (IPTech) practice group at Baker McKenzie Wong & Leow. He is a qualified lawyer in Singapore, and is a member of the International Association of Privacy Professionals (IAPP) as a Certified Information Privacy Professional for Asia (CIPP/Asia), an IAPP Certified Information Privacy Manager (CIPM) and a Certified Information Privacy Professional for Europe (CIPP/E). Daryl has previously worked at Baker McKenzie’s San Francisco office and has also been seconded to financial institution and technology multinational clients.