John Deere Adds SmartDetect to Select Loaders

Oct. 17, 2024
SmartDetect utilizes the machine’s integrated digital cameras to supplement operator visibility.

Editors note: This article has been updated.

John Deere has added its SmartDetect, an object detection system that enhances overall situational awareness for operators, to select utility-class and production-class loaders.

This summer, John Deere introduced the SmartDetect Field Kits for 444-904 P-Tier and X-Tier models. With safety being a constant concern in the construction industry, the technology aims to provide operators with greater visibility.

“SmartDetect is a crucial addition to our portfolio of precision construction technology solutions, designed to help operators confidently navigate and maximize productivity on busy construction sites,” says Katie Voelliger, product marketing manager John Deere. “Safety is a shared responsibility, and we’re excited to continue developing solutions that empower operators to work more safely and effectively.”

Addressing the Need for Job Site Awareness

Recognizing that operator awareness is critical in reducing accidents, John Deere designed SmartDetect to function as an additional set of eyes for loaders. “With upwards of 40% of wheel loader applications being conducted in reverse, additional visibility to job site surroundings can significantly boost awareness and make for safer operations,” Voelliger says.

SmartDetect achieves this awareness through strategically positioned cameras. The system includes stereo cameras that work in pairs, delivering a 3D perception view that can identify bystanders and obstacles behind the loader. The technology is complemented by a secondary G5 display, which provides operators with a live digital feed, along with visual and audible alerts.

“The camera positioning is tailored to increase and enhance a wider field of view,” Voelliger says. “In addition, automotive-style dynamic travel path lines during reverse operations and object classification notifications help keep the operator alert and informed.”

SmartDetect also incorporates machine learning to for increased visbility. “We had to develop an AI/CVML (computer vision machine learning) model specifically for the construction environment,” Voelliger says. “This solution relies on images taken from job sites to create real-life learnings. No two job sites are the same, and developing a dataset that performs to our customers’ expectations in various conditions was a significant challenge.”

Another component of SmartDetect is its bystander alarm, designed to grab attention quickly, even in the noisy environment of a job site. “The alarm is unique and distinct, allowing it to cut through the common sounds of construction and alert crew members in real time,” says Voelliger.

Future Plans for SmartDetect