In an era dominated by technological advancements, the financial services industry finds itself at a crossroads, grappling with an emerging menace that threatens the very fabric of trust and security—Artificial Intelligence (AI) and DeepFake videos. As financial institutions worldwide race towards digitization, the ill-potential of AI-driven manipulation, particularly through DeepFake technology, has cast a shadow over the industry's safeguards.
The escalating threat due to AI and DeepFake videos poises profound implications for customer identity verification, regulatory compliance, and the delicate balance between technological innovation and the imperative of securing financial transactions.
Nithin Kamath, the CEO of Zerodha, a prominent financial services Startup, has issued a stark warning about the escalating threat of deepfakes and AI-generated content within the financial services sector.
In a video posted on X, Kamath emphasizes the formidable challenge faced by banks and institutions in the verification of customer identities, attributing the difficulty to the advancing sophistication of deepfake technology.
The rise of AI technology and deepfakes pose a large risk to the financial services industry.— Nithin Kamath (@Nithin0dha) December 13, 2023
The tipping point for Indian financial services businesses was when onboarding became completely digital, thanks to Aadhaar, etc. For businesses onboarding a new customer, an important… pic.twitter.com/DI9Z1Q3jxY
Verifying Real from AI: A Mounting Challenge
As deepfake capabilities continue to evolve, the task of validating whether a person is authentic or AI-generated becomes increasingly difficult posing a significant problem for financial institutions subject to stringent regulatory requirements. Banks, in particular, find themselves grappling with the repercussions of the growing sophistication of deepfake technology, which may necessitate a re-evaluation of existing regulations.
Kamath's Video Message: A Cautionary Post
In a bid to raise awareness, Nithin Kamath posted a video to explain the pressing issues arising from the proliferation of artificial intelligence. The deepfake in the video, seemingly indistinguishable from the real Kamath, discusses the mounting challenges faced by banks and financial institutions in authenticating customer identities.
"As the deepfakes improve, I think it will only become harder over time to validate if the person on the other side is real or AI-generated. This problem will be bigger for banks that have more stringent regulatory requirements during onboarding," remarked Kamath in the minute-long video clip.
Accompanying the video, Kamath posted a message underscoring the dangers posed by the rise of AI technology and deepfakes in the financial services industry. He highlighted the critical juncture at which Indian financial services transitioned to fully digital onboarding, primarily facilitated by Aadhaar and similar technologies. The emphasis was on the pivotal role of ensuring the authenticity of documents and individuals during the customer onboarding process.
“The rise of AI technology and deepfakes pose a large risk to the financial services industry. The tipping point for Indian financial services businesses was when onboarding became completely digital, thanks to Aadhaar, etc. For businesses onboarding a new customer, an important aspect is ensuring that the documents and the person opening the account are real. The normal process that's followed today is to fetch the ID or address proof data from the source using Digilocker and or Aadhaar. Also, match the face from this ID proof with the person opening the account through a webcam. Today, we have a bunch of checks in place to check for liveliness and if the other person is real or not. But as the deepfakes improve, I think it will only become harder over time to validate if the person on the other side is real or AI-generated. This problem will be bigger for banks that have more stringent regulatory requirements during onboarding. It will be interesting to see how the regulations around this evolve. Going back to the physical way of opening accounts will bring the growth of the entire sector to an abrupt stop. And the video isn’t me; it is a deep fake."
The Current Onboarding Process
Kamath shed light on the prevailing onboarding procedures, wherein businesses retrieve ID or address proof data directly from the source, utilizing tools like Digilocker and Aadhaar. The verification process involves matching the individual's face from the provided ID proof with the person opening the account through a webcam. While existing security measures incorporate checks for liveliness and authenticity, Kamath expresses concern about the inevitable challenges posed by advancing deepfake technology.
Future Regulatory Landscape
Expressing uncertainty about how regulations will adapt to this evolving landscape, Kamath contemplates the potential impact on the digital onboarding process. Reverting to traditional, physical methods of account opening could stifle the growth of the entire sector, bringing it to an abrupt halt. Kamath concludes his cautionary post by unequivocally stating, "And the video isn’t me; it is a deep fake."
As the financial industry grapples with the advancing capabilities of AI, the call for comprehensive regulatory responses becomes increasingly urgent. The delicate balance between innovation and security in the digital era stands at the forefront of discussions within the financial services sector.
Join Our Thriving Entrepreneurial Community