This paper presents the VLSI architecture to achieve high-throughput and improved-quality stereo vision for real applications. The stereo vision processor generates gray-scale output images with depth information from input images taken by two CMOS Image Sensors (CIS).
The depth estimator using the sum of absolute differences (SAD) algorithm as stereo matching technique is implemented on hardware by exploiting pipelining and parallelism. To produce depth maps with improved-quality at real-time, pre- and post-processing units are adopted, and to enhance the adaptability of the system to real environments, special function registers (SFRs) are assigned to vision parameters.
The design using 0.18um standard CMOS technology can operate at 120MHz clock, achieving over 140 frames/sec depth maps with 320 by 240 image size and 64 disparity levels. Experimental results based on images taken in real world and the Middlebury data set will be presented. Comparison data with existing hardware systems and hardware specifications of the proposed processor will be given.
Source: University of Maryland
Author: Han, Sang-Kyo
- Micro-Network Processor – A Processor Architecture for Implementing NoC Routers (EEE/ECE Project)
- Development of Vision System for a Humanoid Robot
- Computer Vision and Image Processing Techniques for Mobile Applications (Computer Project)
- Study, Design and Implementation of an Application Specific Instruction Set Processor for a Specific DSP Task (Electronics Project)
- Design and program multi-processor platform for high-performance embedded processing
- Adaptation in Standard CMOS Processes with Floating Gate Structures and Techniques (Electronics Project)
- Vision-Based Eye-Gaze Tracking for Human Computer Interface (Electronics Project)