Shinsegae duty-free deploys AI-powered CCTV system in industry first

Shinsegae DF said Tuesday it has launched a vision AI-based safety management system at Shinsegae Duty-Free's Myeong-dong store and its integrated logistics center at Incheon Airport.

The system uses AI to detect anomalies in real time and immediately alert operators, moving away from the conventional approach of having staff visually monitor CCTV footage. It was introduced to create a prevention-focused, intelligent monitoring environment.

At its core, the system combines vision AI with a vision-language model, or VLM. When the vision AI detects an abnormal situation in CCTV footage — such as a customer collapsing or dangerous behavior — the VLM performs a secondary analysis of the context and circumstances to cross-verify whether the situation genuinely requires a response.

The company also built customized AI safety networks tailored to each site, reflecting the distinct characteristics of the Myeong-dong store, which sees heavy foot traffic from foreign tourists and luggage-carrying visitors, and the integrated logistics center, where forklifts operate and cargo is loaded.

At the Myeong-dong store, the system detects hazards such as people moving against the flow on escalators, strollers attempting to board, and passengers riding without holding the handrail — automatically triggering announcements, floor warning lights and voice guidance. If a customer collapses, it supports a rapid initial response by security personnel. The system also guides foot traffic based on crowd density at entrances and elevator lobbies.

At the integrated logistics center, the system monitors in real time whether forklift operators and signal workers are following the required two-person safety protocol, and detects dangerous driving by logistics vehicles to support workplace safety.

Meanwhile, Shinsegae DF has been steadily strengthening its safety management framework through advanced technology. The company uses its in-house safety work management system, S-DRI (Shinsegae Daily Inspection), to identify and manage hazards before on-site work begins. It has also introduced a smart electrical fire prevention system at the logistics center.

"We have laid the groundwork to manage the safety of customers and on-site workers more precisely by applying AI technology across duty-free stores and logistics centers," said Lee Hee-jae, executive director at Shinsegae DF. "We will continue to actively leverage advanced technology to raise the level of safety management at our worksites."