Computer vision is the branch of computer science that helps machines interpret images and videos. It matters because many systems now depend on visual data, including phone cameras, self-driving cars, medical scanners, factory robots, and security tools. A computer does not see objects the way humans do, so it must turn pixels into patterns, features, and predictions.
The goal is to convert raw visual input into useful information such as labels, locations, measurements, or actions.
A typical AI vision pipeline begins by capturing an image, resizing it, and cleaning the data so a model can process it consistently. Neural networks, especially convolutional neural networks, learn filters that detect edges, textures, shapes, and more complex object parts across many layers. The model then produces outputs such as a class label, a bounding box, a segmentation mask, or a confidence score.
Performance depends on good training data, careful evaluation, and awareness of errors caused by lighting, viewpoint, blur, bias, or confusing backgrounds.
Key Facts
- A digital image is a grid of pixels, often stored as height x width x channels, such as 1080 x 1920 x 3 for RGB color.
- Pixel intensity values are often normalized with x' = x / 255 so inputs fall between 0 and 1.
- A convolution applies a learned filter to small image regions: feature map = image * kernel.
- A neural network prediction often uses probabilities, where sum of class probabilities = 1.
- Object detection usually outputs class label, confidence score, and bounding box coordinates such as x, y, width, height.
- Accuracy = correct predictions / total predictions, but precision and recall are often better for evaluating detection tasks.
Vocabulary
- Pixel
- A pixel is the smallest addressable unit of a digital image and stores brightness or color information.
- Convolutional Neural Network
- A convolutional neural network is a deep learning model that uses learned filters to detect visual patterns in images.
- Feature Map
- A feature map is the output produced when a filter highlights where a particular visual pattern appears in an image.
- Bounding Box
- A bounding box is a rectangle used to mark the location and size of an object in an image.
- Confidence Score
- A confidence score is a model's estimated probability or certainty that a prediction is correct.
Common Mistakes to Avoid
- Assuming the computer understands the whole scene immediately, which is wrong because it first processes numerical pixel values and gradually builds patterns through learned features.
- Ignoring preprocessing, which is wrong because different image sizes, brightness levels, and color scales can cause the same model to behave inconsistently.
- Treating a high confidence score as proof of correctness, which is wrong because a model can be confidently wrong when the image is unusual, biased, blurry, or outside its training data.
- Using accuracy alone for object detection, which is wrong because a model may have high overall accuracy while still missing rare objects or producing poorly placed bounding boxes.
Practice Questions
- 1 An RGB image is 640 pixels wide and 480 pixels tall. How many total pixel values are stored if each pixel has 3 color channels?
- 2 A vision model correctly classifies 184 images out of 200 test images. What is its accuracy as a decimal and as a percent?
- 3 A computer vision system works well on clear daytime street images but performs poorly at night in the rain. Explain two reasons this could happen and one way engineers could improve the system.