How to Do Real Time Object Detection on Drones

  • Title seems a little (maybe a lot?) misleading. It's not "on drones" it's actually on a video stream coming from a drone. There's a huge difference: you're doing all of the processing on a desktop/laptop PC.

    There's some mention at the end of the article on how to attach a PC to the drone, but basically it would be the same thing: just run the processing on a PC.

    Just by the title, I was expecting a clever way to run a pre-trained model directly on a drone.

  • Wow. Combine this with the ability to drop some of the latest nano-sensors (atoms strung together to build dust-sized sensors and batteries and power at scale), and we should be able to monitor absolutely everything everywhere. Let's see anyone even try to object to my rules or procure a weapon!

    And given some on-board weapons, we would never have to worry about civil unrest again. Only people grateful for the food and job they are allowed to be in our society. Utopia!

  • I tried this on my i7 macbook pro, but my CPU usage went to 700% and basically i never got any moving image. Is this normal? What kind of computer you need to at least run this kind of real time?

  • Using the MobileSDK (https://developer.dji.com/mobile-sdk/) you can build this straight on a mobile app. With the OnboardSDK (https://developer.dji.com/onboard-sdk/) you can run it on the drone directly.

  • Has anyone attempted to do anything like this for SAR (Search and Resuce)? Iā€m not sure where one would gather a good dataset for training a model.

  • We at Nanonets have been building a lot of Machine Learning models for drone based image analysis. A frequent request from our customers is how do they use our models to do real time analysis. So we decided to create a how to on building real time object detection using a DJI drone.

    Also useful if you're just looking to get the video stream to your laptop/computer.

  • Very interesting! I really liked the result. Would you mind if I linked to this tutorial in WeeklyRobotics[1]?

    [1] https://weeklyrobotics.com/

  • Skynet ist thanking you ;)

  • Does this work on parrot drones also?