Implementation of AI Solution for Armed Person Detection in an Existing Video Surveillance System for a Pawnshop Chain
-
Industry
Finance services, Retail, Security
-
Project type
Software modernization, AI, AI Transformation, DeepML, Computer vision, Model training, Softacom AI Lab
Description
Unfortunately, stores and stalls that process cash and have cash register equipment often get exposed to armed attacks. While financial losses can be endured, the loss of human lives can never be. This problem is especially true for pawnshops, which, in turn, may operate in disadvantaged neighborhoods. But this is their business and it has its own mission.
At the end of 2023, Softacom was contacted by a company that owns a large network of pawnshops (let’s call it Company). All the pawnshops were compliant with legal requirements. Video surveillance, an alarm system, and a panic button had been installed. But since the pawnshops were opened at different times and locations, there was no standardization in equipment and contractors.
The company decided to expand its in-house security department to address armed threats and improve employee safety. The department’s objective was to detect armed individuals in the pawnshop using the existing CCTV infrastructure, without requiring additional funding. It should be noted that the current systems could detect motion and sometimes identify individuals (although with frequent false positives), but could not reliably detect weapons, which was a critical limitation.
The Company turned to Softacom for our expertise in AI, particularly in computer vision and neural network training for physical security applications.
Varied Equipment. Different pawnshops used various video surveillance systems. This made it difficult to standardize connections and retrieve video streams.
Outdated Technology. The use of both digital and analog video surveillance required the identification of feasible connection methods, researching existing SDKs, and performing video signal demultiplexing and digitization.
Critical Accuracy. Ensuring reliable detection of armed individuals was a crucial requirement.
Distributed Operators. Supporting the system’s functionality was challenging due to the widespread distribution of pawnshops across the country.
Solutions
Softacom has extensive experience implementing AI systems for the technical security sector and developing such systems from the ground up. In addition to video surveillance systems, we have successfully participated – and keep participating – in the development of access control systems, as well as security and fire alarm systems. AI solutions often serve as the link and the decision-making core across these subsystems.
For the pawnshop project, we decided to develop a localized solution to be installed at each pawnshop. This system processes video surveillance footage in real-time at a rate of one frame per second (this limitation is based on the computing capabilities at each location). If an armed person is detected, the system sends a digital signal to the central security system and activates a physical relay.
In the first phase, the system was deployed with operator confirmation from the central security center. The purpose was to test the system’s performance and build trust among pawnshop employees and security personnel.
Softacom, using its own proprietary solutions and the capabilities of Softacom AI Lab, developed a native desktop application for Windows. The application processes video camera frames through a neural network. In case of detecting a threat, it sends a message via TCP/IP to the company’s central security service. If the event is confirmed by an operator, the system triggers a relay closure through the COM port. Depending on the specific pawnshop’s setup, this relay is connected to the required security or locking devices, sirens, etc.
Softacom collaborated with the Company to develop and integrate an AI-powered detection system into its existing video surveillance infrastructure.
Our approach focused on enhancing the company’s legacy software instead of building a completely new solution from scratch. This not only saved time and resources but also ensured a seamless upgrade.
Outcomes
Control. The client’s security department received the required solution. This enabled them to respond effectively to critical situations in pawnshops.
Safety. Pawnshop employees feel more secure, as they know that they no longer need to press the panic button themselves, and thus put their lives at risk.
