Sense Aeronautics has shared how its Automatic Target Recognition (ATR) solution integrates with DJI drones, enabling real-time video streaming and analysis for applications such as border control, surveillance, and search and rescue missions.
The company leverages cutting-edge artificial intelligence (AI) to convert drone footage into actionable insights, delivering real-time video analysis for drone technology.
Leveraging DJI’s Livestream Capability
DJI drones are equipped with a Livestream feature that allows for the extraction and streaming of live video feeds to various devices. This functionality is key for operations requiring immediate access to aerial footage by multiple stakeholders, especially when automated processing is needed to extract critical information.
By utilizing DJI’s Livestream feature, Sense Aeronautics integrates real-time video feed ingestion with its ATR solution, ensuring immediate and actionable insights.
Sense Aeronautics’ ATR Solution
Sense Aeronautics’ ATR solution is engineered to automatically detect and classify objects, providing instant alerts and facilitating quick decision-making. Using advanced AI algorithms, the company’s system processes drone video feeds with high accuracy. This capability is crucial for:
- Border Control: Enhancing perimeter security by detecting unauthorized crossings and potential threats.
- Surveillance Patrols: Efficiently monitoring and securing large areas.
- Search and Rescue Operations: Rapidly identifying persons in distress and other critical targets in emergency situations.
Flexible Integration Options
Sense Aeronautics offers multiple integration options for its ATR solution with DJI drones:
- Cloud Version: Video analysis runs in the cloud.
- Edge Version: Processing occurs onboard the drone.
- Local Version: Analysis is performed on a separate device at or near the ground control station. This version is particularly useful in scenarios with limited or no internet connectivity, requiring minimal configuration on the DJI drone.
Step-by-Step Integration Process
1. LAN Setup
Establish a Wi-Fi LAN connecting the DJI drone remote controller, ATR Processing Unit, and a visualization device. This can be done using the remote controller as an access point, or by using a separate Wi-Fi router or hotspot.
2. Video Transmission
Switch on the drone. The video feed will be available on the remote controller as usual via the native datalink (Lightbridge, OcuSync, etc).
3. Generating a Video Stream
Use DJI’s Livestream feature to make the video feed available on the LAN. Configure the livestream settings in the DJI Pilot App using RTSP protocol for optimal performance.
- Go to the main menu of the DJI Pilot App and click on “Cloud Service”.
- Navigate to the “General Settings” and then to “Live Broadcast Platform”.
- Select the RTSP protocol and setup. Set a name for your account and a numeric password. The image below illustrates an example configuration used to feed video into Sense Aeronautics ATR system on the device.
- Press Save button and go back to the main menu of the DJI Pilot App.
- Enter “Camera View” on the App, and ensure that the streaming is Live by clicking on the Cloud symbol. At this point, you can select the quality of your stream. In order to fully exploit the benefits of Sense Aeronautics ATR system, we recommend you use the full HD (1080×1920) mode.
4. Accessing the Video Stream
The live stream can be accessed by devices on the LAN using a specific URI (rtsp://<account>:<password>@<dji.rc.ip.address>:8554/streaming/live/1).
5. Real-Time Processing
Deploy Sense Aeronautics’ ATR on compatible hardware (e.g., Nvidia devices) to process the video stream in real-time. This involves setting up the ATR system via a web interface (https://<processing.device.ip.address>/product-atr/) and utilizing a REST API for integration with other systems. This can be found at https://<processing.device.ip.address>/docs.
Performance and Latency
Tests show that the ATR pipeline introduces an additional latency of approximately 343 ms on top of the existing 229 ms delay from the drone’s data link, resulting in a total latency of around 572 ms. This includes RTSP transmission, video processing, and transmission of results.
Transforming Drone Operations
The integration of Sense Aeronautics’ ATR solution with DJI drones highlights the modern advancements, achieved by combining AI with drone technology. By enabling real-time video streaming and analysis, operators gain powerful tools to enhance operational efficiency and effectiveness.
