Live demonstration: Depth from focus on a focal plane processor using a focus tunable liquid lens

We demonstrate a 3D imaging system that produces sparse depth maps. It consists in a liquid focus-tunable lens whose focal power can be changed at high speed, placed in front of a SCAMP5 vision-chip embedding processing capabilities in each pixel. The focus-tunable lens performs focal sweeps with shallow depth of fields. These are sampled by the vision chip taking multiple images at different focus and analyzed on-chip to produce a single depth frame. The combination of the focus tunable-lens with the vision-chip, enabling near-focal plane processing, allows us to present a compact passive system that is static, monocular, real-time (> 25FPS) and low-power (< 1.6W).

[1]  Bin Wang,et al.  A 100,000 fps vision sensor with embedded 535GOPS/W 256×256 SIMD processor array , 2013, 2013 Symposium on VLSI Circuits.

[2]  Piotr Dudek,et al.  High-speed depth from focus on a programmable vision chip using a focus tunable lens , 2017, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[3]  M. Blum,et al.  Compact optical design solutions using focus tunable lenses , 2011, Optical Systems Design.