Are AI tools the next evolution in real-time communication?

Just a few decades ago, video calling first becoming a reality in 1964 when AT&T introduced the Picturephone at the World’s Fair, a clunky and expensive device that never took off. Fast forward to 2003, and Skype emerged, finally making video calls accessible to the masses, albeit with pixelated images and frequent connection drops. 

By 2020, the pandemic catapulted various video-calling platforms into the spotlight. Yet, this rapid evolution is just the beginning. 

With AI-driven enhancements, video calling is no longer just about seeing and hearing—it’s about understanding, adapting, and bridging distances with an unprecedented level of sophistication. The technology that once struggled to make eye contact is now on the cusp of making real-time communication feel more human than ever before.

But what about the other side of the coin? With all the benefits a new technology offers, also brings many challenges. In a conversation with CIO&Leader, Ranga Jagannath, Senior Director – Growth, Agora discusses the challenges, the next step in evolution and more. Below are the excerpts from the interview.

Ranga Jagannath,
Senior Director – Growth,
Agora

CIO&Leader: Can you provide an overview of Agora’s mission as a leading provider of real-time engagement APIs, and how it differentiates itself in the market?

Ranga Jagannath: Agora’s mission is to make real-time engagement widely accessible, allowing everyone to interact with anyone, anytime, and anywhere. As a leading provider of real-time engagement APIs, Agora is dedicated to empowering developers and businesses to create immersive and interactive experiences through its scalable, low-latency platform. The company offers real-time voice, video, and live streaming features that can be seamlessly integrated into various applications, whether for virtual events, online education, telehealth, or social apps.

Agora differentiates itself in the market through its global network, which ensures high-quality and low-latency connections even in regions with less robust infrastructure. Our commitment to innovation is reflected in continuous enhancements to AI-driven features, such as noise suppression and real-time video processing. With a developer-centric approach, Agora provides comprehensive SDKs and support, paired with a flexible pricing model, further solidifying our position as a leader in the real-time engagement space.

CIO&Leader: How does Agora incorporate AI into its voice, video, and chat interactions to enhance user experience? What specific AI-driven features set Agora apart in the realm of real-time communication?

Ranga Jagannath: Agora incorporates AI into its voice, video, and chat interactions to elevate the user experience by making real-time communication more seamless, immersive, and natural. AI-driven features include advanced noise suppression, which filters out background noise to ensure clear audio in any environment, and real-time video processing that optimizes video quality based on network conditions, delivering smooth visuals even on low-bandwidth connections. Agora also uses AI for features like voice recognition and sentiment analysis in chat, enabling more personalized and responsive interactions.

What sets Agora apart in the realm of real-time communication is its continuous innovation in AI technology. For example, Agora’s AI-powered background segmentation allows users to blur or replace backgrounds without needing green screens, enhancing privacy and visual appeal during video calls. Additionally, AI-driven real-time translation and transcription services enable cross-language communication, making Agora’s platform a versatile solution for global and multilingual applications.

CIO&Leader: Data security and privacy are critical, especially in AI-enhanced interactions. What measures does Agora take to safeguard user data while leveraging AI technologies?

Ranga Jagannath: Agora is committed to safeguarding user data, particularly in the context of AI-enhanced interactions, by implementing a range of security measures. A key strategy is the use of end-to-end encryption for all voice, video, and chat interactions, ensuring that data remains protected as it travels across networks. This encryption ensures that only authorized participants can access communications, preventing unauthorized access. Additionally, Agora adheres to the principle of data minimization, collecting only the essential data required to deliver and improve its services, thereby reducing the risk of unnecessary data exposure.

To further enhance privacy, Agora processes AI-driven features like noise suppression and background segmentation on the edge—on the user’s device—whenever possible, minimizing data transmission. The company also ensures compliance with international data protection regulations such as GDPR and CCPA, upholding the highest standards of data privacy. Agora’s secure AI models are designed to avoid retaining or exposing sensitive information during processing, effectively protecting against potential data breaches and misuse. These comprehensive measures enable Agora to offer a secure and reliable platform for real-time communication while leveraging the power of AI responsibly.

CIO&Leader: Maintaining low latency and high-quality connections is essential for real-time communication. What strategies does Agora employ to ensure seamless and reliable performance across the globe?

Ranga Jagannath: Agora ensures seamless and reliable real-time communication across the globe by leveraging its proprietary Software-Defined Real-Time Network (SD-RTN™). This globally distributed network intelligently routes voice, video, and data streams through the most efficient paths, minimizing latency and packet loss. By dynamically adjusting to changing network conditions, SD-RTN™ ensures that users experience consistent, high-quality communication even in regions with less robust infrastructure. This advanced network infrastructure allows Agora to maintain the low latency essential for real-time interactions, regardless of geographic location.

Additionally, Agora employs adaptive bitrate streaming, a technology that automatically adjusts the quality of audio and video based on the user’s network conditions. This ensures that users enjoy smooth, uninterrupted communication experiences, even during bandwidth fluctuations. Agora’s global network of data centers further enhances performance by reducing the distance data needs to travel, which minimizes latency. Continuous network monitoring and optimization allow Agora to deliver dependable real-time communication, ensuring that users can connect seamlessly and effectively, no matter where they are.

CIO&Leader: With AI regulations still under development, there are concerns from businesses that these rules could stifle innovation and productivity. How is your platform preparing to navigate future AI regulations?

Ranga Jagannath: As AI regulations evolve, we acknowledge the concerns businesses have regarding potential impacts on innovation. However, Agora sees these regulations as opportunities to ensure transparency, privacy, and ethical AI deployment. By actively engaging with regulatory bodies and adopting a proactive approach to compliance, we aim to strike a balance between innovation and responsible AI use. Our platform incorporates flexible AI-driven features that can adapt to regulatory requirements, enabling us to continue driving innovation while ensuring our clients’ needs and compliance are met.

CIO&Leader: From your perspective, what are the emerging trends and key developments in AI-driven communication technologies? How is Agora positioning itself to stay ahead of these trends?

Ranga Jagannath: AI-driven communication is seeing key advances in personalization, real-time analytics, and immersive experiences through video and voice. Low-latency interactions powered by AI are becoming essential for more responsive and interactive user engagement. At Agora, we are leveraging AI to enhance these real-time communication technologies, focusing on predictive user insights, content personalization, and seamless integration with platforms through our SDKs. By continuously advancing our AI models and improving real-time capabilities, we ensure that our platform leads in delivering high-quality, adaptive communication experiences across industries.

CIO&Leader: Looking ahead, what is your strategic roadmap, and are there any significant plans for expanding or launching new initiatives in India for FY25?

Ranga Jagannath: Agora’s strategic roadmap for FY25 focuses on broadening its customer base and forging partnerships with top companies across key sectors, including EdTech, Gaming, LiveCommerce, Telehealth, and social media. To achieve this, Agora is enhancing its Conversational AI solutions with new features like real-time speech-to-text (STT), AI-powered noise suppression (AINS), and 3D spatial audio. These advancements aim to improve user experiences by providing clearer communication, immersive audio environments, and better accessibility in real-time applications.

At Agora, we’re always focused on innovation and enhancing our offerings to meet the evolving needs of our customers. As part of our growth strategy, we continuously explore various opportunities to strengthen our AI-driven solutions, whether that’s through partnerships, internal development, or other strategic avenues.

Share on