US-20260129255-A1 - SEAMLESS MOBILE AUDIO-VIDEO RELAY TECHNOLOGY FOR MICROPHONE-CAMERA INTEGRATION AND CONTROL

Abstract

An A/V relay system can integrate the user devices of attendees at a venue with the venue A/V system such that the user devices can be used as cameras and/or microphones with the venue A/V system. The A/V relay system enables an attendee at a venue to use their user device as a camera and/or microphone such that the attendee can be seen on one or more displays at the venue and/or heard at the venue via a sound system having one or more speakers. The user devices can communicate with a server/hub via a network. The server/hub can then relay the audio and/or video from the user devices to the venue A/V system for subsequent presentation to the attendees at the venue via the display(s) and/or sound system.

Inventors

• Raziq Yaqub
• Chance Glenn
• Majed Dweik

Assignees

• Alabama A&M University

Dates

Publication Date

20260507

Application Date

20251103

Claims (6)

1. 1 . A system for relaying audio and video signals comprising: a mobile A/V application installed on each of a plurality of user devices; a venue A/V system having a sound system configured to output audio signals and a display configured to output images and video signals; a server computer in communication with both the mobile A/V application on the plurality of user devices and the venue A/V system, the server computer configured to relay audio and video signals received from a mobile A/V application to the sound system and display of the venue A/V system.
2. 2 . The system of claim 1 , wherein the mobile A/V application uses a camera and a microphone of the corresponding user device to capture the audio and video signal provided to the server computer.
3. 3 . The system of claim 1 , wherein the server computer is configured to apply content moderation to the audio and video signals received from the mobile A/V application.
4. 4 . The system of claim 1 , wherein the server computer is configured to generate a queue when more than one mobile A/V application requests to provide audio and video signals.
5. 5 . The system of claim 1 , wherein the server computer is communication with the mobile A/V applications on the plurality of user devices via a wireless network.
6. 6 . The system of claim 5 , wherein the mobile A/V applications on the plurality of user devices use full-duplex communication over a single, persistent TCP connection to communicate with the server computer.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of U.S. Provisional Patent Application No. 63/715,513, filed Nov. 1, 2024, and entitled “Seamless Mobile Audio-Video Relay Technology for Mic-Camera Integration and Control (SMARTMIC),” which application is hereby incorporated by reference herein in its entirety. BACKGROUND The present application generally relates to an A/V (audio/video) relay system. More specifically, the present application is directed to an A/V relay system that can integrate the microphones and cameras of users'mobile devices with an A/V system at a venue where the users are visiting. In venues like conferences, lecture halls, and entertainment spaces, fostering smooth, interactive audience participation poses logistical and cost challenges. Traditional microphone setups often require costly equipment rentals and can be cumbersome, as traditional microphone setups rely on passing a microphone or having participants move to a fixed station. Additionally, the venue camera operator frequently struggles to locate and focus on the person speaking, and camera placement or angle limitations can make it challenging to capture the speaker's face clearly. These approaches hinder accessibility and disrupt the natural flow of interaction, particularly in large venues. The traditional setups can stall discussions, reduce engagement, and make participation difficult for attendees seated farther away. Additionally, maintaining sound quality and moderating content to prevent disruptions requires constant staff oversight. Alternatives, such as submitting questions through a “web app”, lack the immediacy and connection of in-person engagement, often diminishing spontaneity and discouraging follow-up questions. Therefore, what is needed is techniques for transforming venue attendees' smartphones into integrated, venue connected microphones and cameras, providing an immediate, accessible, and enriched way for attendees to participate at the venue. SUMMARY The present application generally pertains to a system for seamless mobile audio-video relay technology for mic-camera integration and control (the SMARTMIC system). The SMARTMIC system can transform venue attendees'mobile devices into integrated microphones and cameras, thereby enabling direct audio and video relay to venue sound and display systems. The SMARTMIC system can be used in environments such as conferences, classrooms, and entertainment venues and allows attendees to use their smartphones to transmit audio directly through the venue's sound system when asking questions, while optionally sharing live video, profile images, or screen content on the venue's display. The SMARTMIC system can be configured to have the venue's central display feature either the attendee's content alone or a split screen with both the attendee and main speaker for a dynamic experience. Leveraging secure IoT (Internet of Things) protocols, real-time streaming, and advanced AI (artificial intelligence) capabilities, including voice recognition, noise suppression, sentiment analysis, and content moderation, the SMARTMIC system ensures smooth, engaging interactions. If inappropriate content is detected, AI in the SMARTMIC system can instantly mute and pause video to maintain a focused environment. In one aspect, the SMARTMIC system transforms smartphones into intelligent, integrated microphones and cameras, bridging mobile devices with venue audio-visual systems for seamless interaction and real-time visual engagement. The SMARTMIC system can integrate advanced software and hardware components that enable high-quality audio and video integration. With the SMARTMIC system, attendees at a venue can activate their smartphone's microphone to ask a question, and, if desired, share live video, profile images, or even their screen content on the venue's central display. The SMARTMIC system enables a split-screen or full-screen view on the venue's display to feature one or both of the attendee and main speaker, fostering an inclusive, dynamic experience. In large venues, the SMARTMIC system enhances visual engagement and facilitates deeper interaction. Attendees can even display figures or images to accompany their questions, adding substance to discussions. The SMARTMIC system can leverage secure IoT (Internet of Things) and streaming protocols to synchronize audio and video through the venue's systems in real time. The SMARTMIC system integrates AI-driven analysis to moderate content instantly, identifying and muting disruptive material to maintain a respectful environment. In other aspects, the SMARTMIC system revolutionizes event engagement by integrating AI, IoT, and multimedia capabilities, turning mobile devices into versatile microphones and cameras. The SMARTMIC system offers a smooth, high quality experience in various settings—education, corporate events, and entertainment—boosting accessibility, engagement, and operational efficiency. An adv