Computer task is to predict the binary label of an image. 

For example, is this an image of cat or not (y=0 or y=1)

Image Recognition (Classification) in Computer Vision

In this task, there are multiple objects in an image. The computer should detect objects classes and their locations.



Object Detection in Computer Vision

Neural style transfer generates a new image by combining the content of one image with the style of another image. 

Neural Style Transfer in Computer Vision

In this task, the computer should detect the location of the object as well and draw a bounding box around it.

Image Localization in Computer Vision

In autonomous applications such as robotics or vehicles using a camera to track where the camera are is in space can be a good localization estimate. The idea is to analyze sequential frames in a video and compare the movement of certain features in the image between them. Once the correlations are found either a Kalman filter or a 3D mapping can be found depending on the type of data available. Visual odometry can be a highly accurate measure of position but it's often used in sync with other localization and mapping techniques.


Visual Odometry

Camera's are a projection of the 3D world onto 2D a image but once you have the image how can you go back to 3D? This problem is know as reconstructing a 3D image and the most popular method is using stereo vision which is acquiring multiple angles of similar images. By aligning similar features in each image in 2D, 3D geometric information can be extracted in the form of depth maps.

3D Reconstruction

Facial landmarks are used to localize eyes, nose, mouth, jaw, eyebrows, and the face as a whole. They are an important input to many computer vision problems such as facial recognition, driver attention tracking, gaze tracking, etc. The most accurate methods are generally using neural networks trained on datasets such as 300-W, AFLW, WFLW, etc.

Facial Landmark Detection

Optical Flow is the tracking of the motion of objects between two consecutive frames of a video. It relies on pixel intensities between frames being similar and neighboring pixels having similar motion. This allows it to be a fast implementation and useful for applications such as structure from motion, video stabilization, and video compression.

Optical Flow

Image segmentation is a computer vision task that divides an image into multiple constituent regions by utilizing the correlation between pixels. This approach does not require pixel-level label information during the training phase. Consequently, it cannot guarantee that the resulting segmented regions will map to specific, predefined semantic categories during prediction. For example, it might divide an image of a dog into a dark region covering the face and a light region covering the body, rather than identifying the entire object as a single semantic entity.

Image Segmentation

Instance segmentation, also known as simultaneous detection and segmentation, is a computer vision task focused on recognizing the pixel-level regions of each individual object instance within an image. It differs from semantic segmentation by requiring the model to distinguish not only between different semantic classes but also between distinct occurrences of the same class. For example, if an image contains multiple dogs, the task requires determining exactly which pixels belong to each individual dog.

Instance Segmentation

Semantic segmentation is a computer vision task focused on recognizing and understanding the contents of an image at a granular, pixel level. It operates by dividing the entire input image into distinct regions, assigning every individual pixel to a specific, predefined semantic class (such as a car, pedestrian, or background).

Semantic Segmentation

1- Image classification

2- Image localization

3- Object detection

4- Neural style transfer

University of Michigan - Ann Arbor

Computer Vision

1- Rapid advances in computer vision is enabling brand new applications the were not possible a few years ago.

2- Since the community is creative, it can inspire applications in other areas.

Why computer vision is interesting?

What is the problem of using deep learning on images?

Types of Computer Vision Problems

Acquired data is usually messy and can come from different sources, angles, color scales, etc. In order to use machine and deep learning techniques they need to be standardized. Usually the goal is to increase the accuracy while reducing the complexity of the model used. There is no single answer to preprocessing but there are a group of techniques commonly chosen from.

Computer Vision Pre-Processing

In computer vision there is many established datasets used for training and benchmarking different algorithms. Unlike other machine learning areas, computer vision datasets are much more standardized because it takes significantly more effort to create them.

Computer Vision Datasets

Computer vision has tons of applications but the methods used have become relatively standardized so it's often useful to use established libraries/tools. Some examples are:
- OpenCV
- Scipy ndimage
- TensorFlow
- PyTorch Vision
- MATLAB Computer Vision Toolbox

Computer Vision Libraries

- Human computer interaction (HCI)
- Interaction design
- Collaborative and social computing
- Ubiquitous and mobile computing
- Data Visualization
- Accessibility

Learn Before

Related

Learn After