US-20260129097-A1 - IOT DEVICE CONTROL SYSTEM BASED ON SEARCHING FOR IMAGE

Abstract

Proposed is an IoT device control system. The IoT device control system, which has an IoT server, a local computer, and IoT devices networked through a router, includes a local computer having an operating system and one or more application programs installed therein, and an IoT server configured to receive a predetermined mode command which defines operating situations of the local computer and an IoT device and to transmit a control command to the local computer and the IoT device so that the local computer and the IoT device are executed as defined in the received mode command, and the IoT device includes one or more IoT devices driven by the control command received from the IoT server.

Inventors

• Yongjin SHIN
• Koungbin Kim

Assignees

• SLmedia Co., Ltd

Dates

Publication Date

20260507

Application Date

20241112

Priority Date

20241107

Claims (5)

1. 1 . An IoT device control system having an IoT server, a local computer, and IoT devices networked through a router, the IoT device control system comprising: a local computer having an operating system and one or more application programs installed therein; and an IoT server configured to receive a predetermined mode command which defines operating situations of the local computer and an IoT device and to transmit a control command to the local computer and the IoT device so that the local computer and the IoT device are executed as defined in the received mode command, wherein the IoT device includes one or more IoT devices driven by the control command received from the IoT server.
2. 2 . The IoT device control system of claim 1 , further comprising: an administrator computer which forms a network with the IoT server, the local computer, and the IoT device through a router, and transmits the predetermined mode command to the IoT server.
3. 3 . The IoT device control system of claim 1 , wherein the IoT server searches for a screen image of the local computer to recognize a current situation of the local computer, and transmits a control signal corresponding to the recognized current situation to the local computer and the IoT device to control the local computer and the IoT device in order to execute the received mode command.
4. 4 . The IoT device control system of claim 3 , wherein the situation recognition through the searching for the screen image of the local computer is determined by comparing a location and an RGB value of each pixel of the local computer with a location and an RGB value of the pixel for each situation which are preset.
5. 5 . The IoT device control system of claim 4 , wherein the application program is a golf simulation program, and the IoT device is an environmental facility required for operating the golf simulation program.

Description

CROSS REFERENCE TO RELATED APPLICATION The present application claims priority to Korean Patent Application No. 10-2024-0156688, filed November 7, 2024, the entire contents of which are incorporated herein for all purposes by this reference. BACKGROUND OF THE INVENTION Field of the Invention The present disclosure relates generally to an IoT device control system based on searching for an image. More particularly, the present disclosure relates to an IoT device control system based on searching for an image which enables an IoT server networked with a local computer and an IoT device through a router to recognize and control the situation of the local computer by searching for a screen image of the local computer, thereby preventing local information from being leaked to a separate external cloud server to be safe in terms of security, and operating independently of the external cloud server to enable more stable operation. Description of the Related Art In general, IoT (Internet of Things) refers to intelligent information and communication technology or services that enable communication between people and things and between things by providing network connections to various things on the basis of the Internet. As this IoT technology has developed, it has become possible to comprehensively control peripheral IoT devices connected to a network along with the execution of a specific application program installed on a local computer. FIG. 1 is a drawing illustrating an IoT device control system that is linked with a conventional external cloud server. The following description will be made with reference to FIG. 1. A local computer has an operating system and a plurality of application programs installed. When an application program is executed, it is necessary to control various IoT devices according to the execution of the application program. For example, when a golf simulation program is executed, a lighting device, a heating and cooling device, a beam projector, etc. are controlled according to the progress of the program. To control IoT devices, an IoT server needs information about the current status of the local computer and the execution status of the application program. Typically, a company that develops the application program and a company that develops the IoT server that comprehensively controls the local computer and IoT devices are different from each other. Therefore, the company that develops the IoT server obtains the cooperation of the company that develops the application program and receives the situation information of the application program to recognize the situations of the local computer and the application program. Conventionally, as illustrated in FIG. 1, a local computer and an IoT device are connected to an external cloud server through the Internet, and the current status information of the local computer and an application program is transmitted to the external cloud server. That is, the status information of the application program of the local computer and the status information of the IoT device are disclosed to the outside in real time. In addition, the IoT server is connected to the external cloud server, receives current situation information of the local computer and application program to recognize the current situation, and then controls the local computer and IoT device. When a network is formed in this manner, the situation information of the local computer and IoT device is exposed to the outside, which causes security vulnerability. Moreover, when a problem occurs in the external cloud server, the local computer and IoT device may be uncontrollable, resulting in an unstable situation. Meanwhile, when there is no cooperation between the application program development company and the IoT server development company, it is impossible to build a system for the local computer and IoT device. Therefore, there is an urgent need to develop a new IoT device control system that can control IoT devices according to the progress of a local computer independently of an external cloud server. Document of Related Art (Patent Document 1) Korean Patent Application Publication No. 10-2020-0075080 SUMMARY OF THE INVENTION Accordingly, the present disclosure has been made keeping in mind the above problems occurring in the related art, and the present disclosure is intended to control an IoT device according to the progress of a local computer independently of an external cloud server. In addition, the present disclosure is intended to allow the IoT server to recognize the current situations of the local computer and the application program through searching for an image. In addition, the present disclosure is intended to recognize the situation of the local computer by examining a location and an RGB value of each pixel of the local computer. In order to achieve the objectives of the present disclosure, there is provided an IoT device control system having an IoT server, a local c