html - Camera object detection in JavaScript - Stack Overflow

admin管理员组

文章数量:1279113

Suppose the user has a modern browser like Chrome and enables necessary HTML5 camera settings (so that getUserMedia works), how would one detect specific predefined objects shown in webcam sight, using JavaScript?

For instance, there's HTML5/ JS-based face detection which works great, and I saw another hand detection demo (which didn't work well here; I might be doing something wrong). What are the necessary steps to train the camera to detect given other objects of (developer) choice? Say, I want the cam to recognize the location of a red pen; or perhaps the darkest object in sight; or perhaps a black iPhone waved into the camera etc.

Thanks!

Suppose the user has a modern browser like Chrome and enables necessary HTML5 camera settings (so that getUserMedia works), how would one detect specific predefined objects shown in webcam sight, using JavaScript?

For instance, there's HTML5/ JS-based face detection which works great, and I saw another hand detection demo (which didn't work well here; I might be doing something wrong). What are the necessary steps to train the camera to detect given other objects of (developer) choice? Say, I want the cam to recognize the location of a red pen; or perhaps the darkest object in sight; or perhaps a black iPhone waved into the camera etc.

Thanks!

• javascript
• html

Share Improve this question Follow asked Jul 2, 2012 at 13:02 Philipp LenssenPhilipp Lenssen 9,2281313 gold badges6161 silver badges7979 bronze badges 4

• 13 You write a tremendous amount of software, that's how you do it. – Pointy Commented Jul 2, 2012 at 13:25
• I share Pointy's answer, but also offer a starting point. In short, it will require A LOT of software. ee.columbia.edu/ln/mmsp/papers/thesis-hluo.pdf – Jason Palmer Commented Jul 4, 2012 at 13:53
• I linked to do existing open source projects above, so I thought there may be a chance these can be trained with other visuals -- or do you think that is out of question? – Philipp Lenssen Commented Jul 5, 2012 at 6:38
• I linked to do existing open source projects above, so I thought there may be a chance these can be used and then trained with other visuals. – Philipp Lenssen Commented Jul 5, 2012 at 6:38

Add a ment  | 

2 Answers 2

Sorted by: Reset to default 5

Object detection in itself is a very tricky business. You have to know what your object is, whether it is smooth, flexible, has a lot of color contrast, moves quickly, and a lot of other questions before you can determine the best method.

Also, it depends on whether you only want to detect an object, or if you want to track it during its movement in front of the camera.

I'll be only naming a few methods here, because I don't have time to elaborate a lot. You can probably find a lot of documentation on Google once you know the names, but be aware that you might need some mathematical skills if you have to implement them yourself. So, this usually involves :

• Computing descriptors at interesting points. Look at the SIFT or HoG (Histograms of Gradients) descriptors on Google, these are the most used ones.
• Building some kind a recognition structure, which, again, can change greatly, depending upon your object and your descriptors. Popular methods include Neural networks, Support Vector Machines. For moving objects, you can usually add graph-related techniques such as Graph Cuts into the mix.

Again, depending on the object, these might not even be close to the right method.

As far as I know, there's very little software available for all that in JavaScript, but I'd be happy to know it if you do find something. Again, here are a few pointers :

• Your Face Detection sample is using something very popular called a Cascade Classifier, which is available in the even more popular library OpenCV, and is considered by most to be the method of choice for face detection.
• If you can consider moving part of the processing to a server, you could use OpenCV which has tons of available algorithms.

I hope I was able to help you start a little bit ;)

In addition to F.X.'s answer, once you have trained a classifier or choosen a freely available one from the web, you could use an OpenCV port such as js-objectdetect or HAAR.js for the actual detection.

本文标签： htmlCamera object detection in JavaScriptStack Overflow