AI Camera

Redefining mobile photography

Thanks to the emergence of smart cameras, professional-grade photographs can now be captured with pocket-sized devices. From portraits to landscapes, AI-powered smart features enable mobile devices to optimize photographs with precision and create stunning images. Embedded with powerful AI capabilities, Samsung Exynos processors empower everyone to capture their vision perfectly anytime, anywhere with ease.

An illustrative image of AI and smartphone with multiple cameras.
Smart vision, flawless images

Background

Equipped with AI capabilities, smartphones can now capture spectacular images that rival cameras. Due to the compact form factor of mobile devices, smartphone cameras are unable to carry large image sensors or lenses. This challenge compels manufacturers to leverage computational photography techniques to boost the quality of images, and the arrival of AI has pushed the capabilities of computational photography to the next level. From image recognition to computational imaging processing technologies, AI provides the foundation for a plethora of smart photography features.

An illustrative image of human eye with abstract pattern in the iris.

Computer vision

Giving sight to devices

Giving computers visual sight is the first stage in building AI-powered image enhancing techniques. Powered by Deep Neural Network (DNN), a system of neurons similar to the ones in the human brain, computer vision enables devices to recognize the objects and scenery users are trying to capture. Aside from processing mobile photography, computer vision also enables our smartphones to search for information with images, verify faces for enhanced security, recognize objects in the real world for immersive AR experiences and much more.

An Illustrative image of various lines tangled together like a web.

NPU

AI specialist

Image analysis and recognition involve complex computational operations which can exceed the capacity of traditional processing units. Designed to complete Deep Neural Network operations efficiently, the Neural Processing Unit (NPU) is the hub that delivers the powerful performance required for smart cameras. In mobile devices, the NPU is built into the processor to support smart features and take smartphone capabilities to the next level. In addition to accelerating machine learning tasks, the component is also designed to consume reduce power consumption without sacrificing performance. Compared to GPUs and CPUs, NPUs offer higher performance and efficiency for AI processing.

An Illustrative image of butterfly against an image of close up of a human eye.

ISP

Capturing the perfect image

Smartphone cameras do so much more than capturing the scene. Every time the camera takes a photo, the Image Signal Processor (ISP) delivers enhancements by processing electric signal sent from the optical lens and rebuilds the image to ensure the final photograph is as flawless as possible. Combined with the image recognition capability of the NPU, ISPs can deliver even more precise photo optimization based on the objects in the frame. If the NPU detects a face, for example, the ISP ensures all the components in an image are perfectly captured by calling up settings tailored for portrait photography.

Customized settings for every occasion
An Illustrative image of photos with various scenes stacked over a smartphone.

AI in action: Scene detection

Scene optimization combines the NPU’s machine learning capability with ISP’s optimization function. Machine learning gives the NPU the ability to automatically detect and distinguish different objects in the frame. This enables the ISP to generate and apply specific camera settings tailored to the subject matter. The red tones of a sunset, for example, are enhanced to create more life-like colors, while the edges of texts are straightened for greater clarity. These individual enhancements are combined to create vibrant, beautiful photos.

An Illustrative image of a woman formed with various particles.

AI in action: Face detection

Powerful portraits

AI-powered object recognition capabilities make capture stunning selfies and portraits with a smartphone simple and intuitive. When the NPU detects a face in the frame, it enables the ISP to automatically provide the best settings, such as white balance and exposure, for the lighting condition and the person’s skin tone. The NPU allows the camera to differentiate faces from the background, giving smart cameras the ability to create mesmerizing bokeh effects.

An Illustrative image of semantic segmentation over the photo of two women and a dog sitting in the forest.

AI in action: Next evolution

Next generation photography

Computational image optimization typically applies a single set of settings to enhance photographs based on the main subject in the frame. Through the semantic segmentation process, Exynos processors are able to recognize different objects in a photo, apply tailored settings to multiple areas for superior optimization, and bring greater balance and harmony to the overall composition. Furthermore, the process also enables smart cameras to accurately adjust the focus and produce photographs with distinguishable foreground and background.

Pro-grade camera with intelligence
An Illustrative image of Exynos processor against an image of smartphone with multiple cameras.

Exynos Mobile Processor

Featuring NPU and vision processing unit with advanced algorithms, Samsung’s Exynos processors provide superior performance to help mobile devices deliver powerful intelligent camera features. The processors feature patented face detection technologies, including face detection-assisted auto white balance and auto exposure, which were developed by analyzing the features and characteristics of over 300,000 face for enhanced precision. With advanced object recognition functionalities as well as superior image processing capabilities, the processors can help users capture their vision flawlessly and take mobile photography to the next level.