{"id":595,"date":"2023-02-07T16:07:20","date_gmt":"2023-02-07T05:07:20","guid":{"rendered":"https:\/\/www.samontab.com\/web\/?p=595"},"modified":"2025-02-05T02:35:05","modified_gmt":"2025-02-04T15:35:05","slug":"overview-of-current-luxonis-oak-cameras-or-which-one-you-should-get-for-your-next-computer-vision-application","status":"publish","type":"post","link":"https:\/\/www.samontab.com\/web\/2023\/02\/overview-of-current-luxonis-oak-cameras-or-which-one-you-should-get-for-your-next-computer-vision-application\/","title":{"rendered":"Overview of current Luxonis Oak cameras, or which one you should get for your next computer vision application"},"content":{"rendered":"\n<p>Microsoft stopped manufacturing the Kinect in 2017. Google stopped manufacturing Project Tango in 2018 in favour of ARCore. Intel started winding down their RealSense cameras in 2021 to focus on their main business. Thankfully, we have Luxonis stepping up and producing the next generation of perceptual cameras for robotics and computer vision applications.<\/p>\n\n\n\n<p>Luxonis offers perceptual cameras for basically three types of applications: visible spectrum inference(VSI), VSI plus passive infrared stereo, and VSI plus active infrared stereo. Let&#8217;s see each one in detail. Note: I&#8217;m using referral links in this post, so if you buy something I might receive a commission.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Visible spectrum inference (VSI) cameras<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img data-dominant-color=\"578080\" data-has-transparency=\"false\" style=\"--dominant-color: #578080;\" loading=\"lazy\" decoding=\"async\" width=\"226\" height=\"400\" src=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/b.avif\" alt=\"\" class=\"wp-image-727 not-transparent\" srcset=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/b.avif 226w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/b-170x300.avif 170w\" sizes=\"auto, (max-width: 226px) 100vw, 226px\" \/><\/figure>\n\n\n\n<p>These cameras have a single RGB sensor, just like a normal camera, but have the ability to perform optimised neural network inference inside the camera with a specialised chip such as the Myriad X VPU. For example if your application is to detect or classify objects, visual tracking, or anything related to doing inference in the visual spectrum, then this type of cameras should be enough for you. They have the least amount of power consumption, smallest size, and they&#8217;re also the cheapest ones.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"300\" src=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/vsi.png\" alt=\"\" class=\"wp-image-596\" srcset=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/vsi.png 300w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/vsi-150x150.png 150w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><figcaption class=\"wp-element-caption\">An example of VSI, the object was classified as a Potted Plant with 99.51% certainty.<\/figcaption><\/figure>\n\n\n\n<p>For this section the standard camera would be the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-1-Camera-Detection-Inference\/dp\/B09B36FV6N?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=5d6ceadec46fc09c59cdb694dc0ea6e6&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-1<\/a>. If you don&#8217;t have any special requirements, this should be the one you get. There are some variants that you might want to consider in case you need something special: If you want to have a wider field of view, you can get the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-1-Robotics-Camera-Detection\/dp\/B0BNDZMZGM?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=38b4e1e5f1a6637bcc412c8dd87ed7af&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-1 W<\/a>. If you&#8217;re looking for higher resolution, then you should get the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-1-MAX-Robotics-Camera\/dp\/B0BP89H9V7?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=51811f1c0204210eb45f7f1ac5d234aa&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-1 Max<\/a>. If you&#8217;re on a budget, you can get the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-OAK-1-Lite-Auto-Focus-Robotics-Camera\/dp\/B0BKLHN6LV?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=ee0a025e67f26d6f218de31dbe37b9fa&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">OAK-1-Lite Auto-Focus<\/a> which is basically the same but with a cheaper sensor, and if you&#8217;re putting this on a vibrating environment, such as a drone for example, grab the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-OAK-1-Lite-Fixed-Focus-Robotics-Camera\/dp\/B0BR7WS519?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=b131678cb2eae39c689b312d25f65863&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">OAK-1-Lite Fixed-Focus<\/a>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">VSI plus passive infrared stereo cameras<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img data-dominant-color=\"507f80\" data-has-transparency=\"false\" style=\"--dominant-color: #507f80;\" loading=\"lazy\" decoding=\"async\" width=\"400\" height=\"175\" src=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/d.avif\" alt=\"\" class=\"wp-image-729 not-transparent\" srcset=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/d.avif 400w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/d-300x131.avif 300w\" sizes=\"auto, (max-width: 400px) 100vw, 400px\" \/><\/figure>\n\n\n\n<p>These cameras can do everything that the VSI cameras can do but also come with two additional fast infrared sensors with global shutter that are used to estimate depth through disparity matching inside the camera. The nice thing about this is that your host device can simply use the depth information, all the heavy computation is done inside the camera itself. And of course you can also use those additional infrared sensors however you like, not only for depth estimation, but for example for applications where doing inference in the near-infrared spectrum would be more effective than VSI.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"640\" height=\"400\" src=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/depth.png\" alt=\"\" class=\"wp-image-597\" srcset=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/depth.png 640w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/depth-300x188.png 300w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><figcaption class=\"wp-element-caption\">An example of depth estimation using passive infrared stereo. Whiter pixels are closer to the camera.<\/figcaption><\/figure>\n\n\n\n<p>For this section the standard camera would be the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-D-Auto-Focus-Robotics-Camera\/dp\/B0B5TV1G9R?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=1728a631dc542cf66add2be98d5f348a&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-D S2 Auto-Focus<\/a>. If you don&#8217;t have any special requirements, this should be the one you get. There are some variants that you might want to consider in case you need something special. If you&#8217;re planning to use this on a small device like a Raspberry Pi, then you should either get the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-D-Spatial-Camera-Detection\/dp\/B09B316YZS?crid=2WS2XCP65TWI3&amp;keywords=Luxonis+OAK-D&amp;qid=1675734208&amp;sprefix=luxonis+oak-d+%2Caps%2C299&amp;sr=8-2&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=8d15c428704c6c89c8cb87445dd1ee0c&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-D<\/a>(this was the original camera from the Kickstarter project) as it comes with a built-in barrel jack connector for external power(some devices like the Raspberry Pi cannot deliver the required power over USB only), or buy a separate <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-Y-Adapter\/dp\/B0B5TYDBC7?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=18cd6c4618461b9a0bc42b7271e84dd8&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Y-Adapter<\/a> for your camera. If you&#8217;re putting the camera in a vibrating environment, such as a car for example, then you might want to get the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-D-Fixed-Focus-Robotics-Camera\/dp\/B0B5TY8RTP?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=1164942a73166277af2a33fd78919b70&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-D S2 Fixed-Focus<\/a>, although note that this only affects the RGB camera. If you&#8217;re on a budget, or want to have a lighter camera by sacrificing some infrared resolution, you can get either the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-D-Lite-Auto-Focus-Robotics-Camera\/dp\/B09T5FY68V?crid=FRWGNJWDDBML&amp;keywords=Luxonis+Oak-D-Lite&amp;qid=1675733136&amp;sprefix=luxonis+oak-d-lite%2Caps%2C310&amp;sr=8-1&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=76500bb57d9df6762f143db16be4e7c4&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-D Lite Auto-Focus<\/a>, or the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-D-Lite-Fixed-Focus-Robotics-Camera\/dp\/B09T5BKGCH\/ref=sr_1_2?crid=FRWGNJWDDBML&amp;keywords=Luxonis+Oak-D-Lite&amp;qid=1675733136&amp;sprefix=luxonis+oak-d-lite%2Caps%2C310&amp;sr=8-2\" target=\"_blank\">Oak-D Lite Fixed-Focus<\/a>. Again, the auto or fixed focus only applies to the RGB camera.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">VSI plus active infrared stereo cameras<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img data-dominant-color=\"707f80\" data-has-transparency=\"false\" style=\"--dominant-color: #707f80;\" loading=\"lazy\" decoding=\"async\" width=\"400\" height=\"308\" src=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/f.avif\" alt=\"\" class=\"wp-image-730 not-transparent\" srcset=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/f.avif 400w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/f-300x231.avif 300w\" sizes=\"auto, (max-width: 400px) 100vw, 400px\" \/><\/figure>\n\n\n\n<p>These cameras can do everything that the VSI plus passive infrared stereo cameras can do but also come with an infrared laser dot projector for active stereo and an infrared illumination LED for night vision. This means that you will get a much better depth estimation for uniform areas such as walls for example, as passive stereo relies on matching the features of the scene only, but blank walls have very few distinctive features. By projecting a known pattern in infrared (invisible to the human eye and the RGB camera), the extra features in the infrared frames help the camera to get a better depth estimation in those cases. <\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"649\" src=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/active-stereo-1024x649.png\" alt=\"\" class=\"wp-image-598\" srcset=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/active-stereo-1024x649.png 1024w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/active-stereo-300x190.png 300w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/active-stereo-768x487.png 768w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/active-stereo.png 1271w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Active stereo can produce better depth maps in certain cases. Image by luxonis<\/figcaption><\/figure>\n\n\n\n<p>Another thing you can do with this camera is to use the infrared illumination LED to be able to &#8220;see in the dark&#8221; as the RGB camera(or your eyes) would not be able to see anything, but both infrared cameras would be completely illuminated. This is useful for applications that need to do inference in the near-infrared spectrum with no natural light.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"320\" src=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/night-vision-1024x320.png\" alt=\"\" class=\"wp-image-599\" srcset=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/night-vision-1024x320.png 1024w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/night-vision-300x94.png 300w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/night-vision-768x240.png 768w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/night-vision-1536x480.png 1536w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/night-vision.png 1760w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">When there&#8217;s no natural light, the infrared illumination LED makes IR images clear. Image by luxonis<\/figcaption><\/figure>\n\n\n\n<p>For this section the standard camera would be the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-D-Pro-Auto-Focus-Robotics-Camera\/dp\/B0BJKKWZNT?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=6a7da599b3eb8752f615422e6f305dac&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-D Pro Auto-Focus<\/a>. If you don&#8217;t have any special requirements, this should be the one you get. There are some variants that you might want to consider in case you need something special. If you&#8217;re planning to use the camera in a vibrating environment (such as a car for example), then you might want to grab the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-D-Pro-Fixed-Focus-Robotics-Camera\/dp\/B0BQ5N681J?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=646a89bb9e8717e10b907318aa586b32&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-D Pro Fixed-Focus<\/a> (note that the fixed focus only applies to the RGB camera). If you&#8217;re interested in a wider field of view, then you should get the <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/Luxonis-Oak-D-Pro-Wide-Robotics-Camera\/dp\/B0BMM63T5Z?&amp;linkCode=ll1&amp;tag=sebmonmypasan-20&amp;linkId=2397235c6b041a3888ab25a7b88f56a2&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">Oak-D-Pro Wide<\/a>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Industrial usage<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img data-dominant-color=\"aa8180\" data-has-transparency=\"false\" style=\"--dominant-color: #aa8180;\" loading=\"lazy\" decoding=\"async\" width=\"400\" height=\"366\" src=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/h.avif\" alt=\"\" class=\"wp-image-731 not-transparent\" srcset=\"https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/h.avif 400w, https:\/\/www.samontab.com\/web\/wp-content\/uploads\/2023\/02\/h-300x275.avif 300w\" sizes=\"auto, (max-width: 400px) 100vw, 400px\" \/><\/figure>\n\n\n\n<p>Finally, if you&#8217;re going to use these cameras in industrial applications, Luxonis offers them in a more ruggedised version and with a Power over Ethernet (PoE) connection. The features of the cameras are otherwise the same as already discussed. You can check the industrial version of these cameras <a rel=\"noreferrer noopener\" href=\"https:\/\/www.amazon.com\/stores\/page\/08ACFCDE-92E5-444A-AC69-BD832455E3ED?ingress=2&amp;visitId=9eafd267-06e1-4bc5-8261-ea6fca205dde&amp;linkCode=ll2&amp;tag=sebmonmypasan-20&amp;linkId=848431bc7b5ccd59c70d555ee9f344c8&amp;language=en_US&amp;ref_=as_li_ss_tl\" target=\"_blank\">here<\/a>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p>And that&#8217;s it, you should now be able to decide which Oak camera is best for your particular application. If you want some help starting out with the installation of the software, check out <a rel=\"noreferrer noopener\" href=\"https:\/\/www.samontab.com\/web\/2023\/02\/how-to-use-the-oak-d-spatial-camera-c-interface-with-opencv-in-ubuntu-22-04-lts\/\" target=\"_blank\">this post<\/a>.<\/p>\n\n\n\n<p>Enjoyed the article?<\/p>\n\n\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Microsoft stopped manufacturing the Kinect in 2017. Google stopped manufacturing Project Tango in 2018 in favour of ARCore. Intel started winding down their RealSense cameras in 2021 to focus on their main business. Thankfully, we have Luxonis stepping up and producing the next generation of perceptual cameras for robotics and computer vision applications. Luxonis offers [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[29,22,21,30],"tags":[],"class_list":["post-595","post","type-post","status-publish","format-standard","hentry","category-computer-vision","category-iot","category-open-source","category-opencv"],"_links":{"self":[{"href":"https:\/\/www.samontab.com\/web\/wp-json\/wp\/v2\/posts\/595","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.samontab.com\/web\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.samontab.com\/web\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.samontab.com\/web\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.samontab.com\/web\/wp-json\/wp\/v2\/comments?post=595"}],"version-history":[{"count":0,"href":"https:\/\/www.samontab.com\/web\/wp-json\/wp\/v2\/posts\/595\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.samontab.com\/web\/wp-json\/wp\/v2\/media?parent=595"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.samontab.com\/web\/wp-json\/wp\/v2\/categories?post=595"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.samontab.com\/web\/wp-json\/wp\/v2\/tags?post=595"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}