Posted on 28 Comments

The Story Behind DeNoise AI

Why did we introduce Topaz DeNoise AI?

As photographers, we all have situations where we end up with noisy photos, like when we’re shooting in low lighting or shooting fast actions.  Even for more traditional photography, we sometimes find noise in shadow areas when adjusted in post editing. Over the last decade, Topaz Labs has been dedicated to developing the best possible tools to address this problem, along with other common editing hardships.  Topaz Denoise AI is our latest effort.

As many of our users know, our existing products “Topaz DeNoise” and “AI Clear” are commonly considered the best in photo noise reduction.  So why did we produce another one? The short answer is that the new DeNoise AI is even better, both in image quality and ease of integration with your photo editing workflow. Since we’re constantly looking to provide a better customer experience, this was the logical next step in noise reduction software.

Topaz DeNoise is one of our old plugins. This program used traditional image processing techniques and has many fail cases when the noise amount and types of images vary. Later in AI Clear, we saw that AI technology based in machine learning was very effective at removing noise and  blur, while also giving us crisp and detailed images for different types of noises. AI Clear exists as an adjustment within the framework of our editing software Topaz Studio.After a time, we found we were not quite happy that we could not put our best AI network in AI Clear because of this limitation. This was for two reasons. One, the AI technology demands a lot of resources and we were limiting the resources available by using the software within Topaz Studio. Two, AI Clear had to be interactive and work seamlessly with other studio adjustments. These reasons prevented us from using the most powerful AI networks at our disposal. Therefore, we decided that we would come up with a standalone and plugin version of this software where we would not compromise on the AI itself.

In DeNoise AI, we utilized a new software architecture to accommodate our best AI network. Albert, our CTO, dedicated all of our training machines to train different network variations. Our developer Bowen implemented all network variations in the Topaz AI inference engine and validated the quality and performance of the networks. After months of training and testing, we are now able to use a bigger network that handles more varieties of noise. DeNoise AI is trained to remove high ISO noise, sensor noise, thermal noise, banding noise, and noise from some scanned images. You can also provide hints about the type of noise through two sliders if not satisfied with the default output to improve the processing. Let’s look at some examples below,

The original image on the left has very strong noise and banding artifacts. The DeNoise output is clean and some details are generated in the very dark noise area.

This image has very strong banding artifacts in different levels. The AI removed those banding artifacts and generated some convincing details.  

Finally, check out two more examples of high ISO noise and the output from DeNoise AI in default settings.

Now the question is, in terms of noise and artifact removal, how can you get the most out of DeNoise AI? To do that, I’ll explain what is going on behind the scenes. In order to train DeNoise AI effectively, we used a lot of clean and noisy image pairs as examples to train an AI network. This is so that later when the AI sees a noisy image, it can predict the clean version of it. Mathematically, we mimic the way that real-world noise is added to the image, during capture or digitization. Our noise model generated millions of noisy-clean image pairs, which were used to train the network. The DeNoise AI network is also able to receive “hints” about the noise level and type from outside as a help.

There are three sliders you can also control from the interface if you don’t like the automated detection. Pushing the sliders to the extreme level will not give you the best output all the time. If your noise level is low then keeping the slider in the lower range should give the best output. With DeNoise AI, you now you have more fine control on the output through the slider rather than just a few steps.

So, is DeNoise AI better than AI Clear? What we can tell you is that they are totally different types of AI network. Personally, I like to play with the Remove Noise and Enhance Sharpness sliders and see the outcome in different images. In our experience, DeNoise AI will typically provide a far better output than AI Clear. But you never know! We encourage you to give both a try.

If you have already played with the trial version or purchased your own copy, let us know what you think. We’re eager to hear how DeNoise AI works for you!

Posted on 105 Comments

Let AI Sharpen Your Photos

As photographers, we want to shoot sharp photos, period!  Our goal of getting sharp images is one of the major factors in the thousands of dollars we spend on good cameras and lenses with features like optical stabilization.  We’ve also invested time in learning techniques, tips, and tools for shooting sharp photos, like lugging around a sturdy but heavy tripod, setting proper shutter speed, learning about depths of field, proper focus, and so on and so forth.

Even with the best equipment and expert techniques, we sometimes still end up with images that could be sharper. That is why almost every photo editing software provides a “Sharpen” feature.  For example, Photoshop has no less than 6 different “sharpen” filters on my last count.

While we hope that getting a sharp picture will not be a problem when using a sharpening software, we know that’s not always the case.  Unless your image has a very small blur, existing software “Sharpen” functions do not work well.

Now let’s go into a technical explanation about how a given software sharpens your images. Up until now, the photo sharpening tools in software typically use one of two type methods: image filtering or deconvolution.

The first type of sharpening is Image Filtering. The basic idea is simple: blurry images lack spatial high-frequency components.  Therefore, applying a filter that boosts high-frequency will make the photo look sharper. Generally, this technique will works for photos with just a little blur.  Since this method is fast, most software sharpen tools use this method. In Photoshop, “Sharpen”, “Sharpen More”, “Sharpen Edge” and “Unsharp Mask” all use this type.  

Figure 1 (click to view details at 100%)

The Image Filtering method works well if you just need to sharpen the photo slightly, but if your photo has a bigger blur, it does not work well.  The problem is that when boosting high-frequency photo components, the tool will also also boost noise and artifacts in photos. Over using a sharpening filter that uses this method will create images with artifacts such as “fat edges”, “halo”, and noise amplification.

The second type of sharpening method is called Deconvolution.   Imagine you are looking through a camera at a star at night.  You will see, instead of a single bright point, a small blurry disk.  This disk represents the so-called point spread function. This function summarizes the blurring process as a mathematical operation called Convolution. Thus, removing blur is modeled mathematically as Deconvolution. This type of method was first developed primarily for astronomy and later for spy satellites. At its creation, normal photographers did not have access to this tech due to the computer speed and the stability of the algorithms.

The situation changed around 2010. There was a break-through in the deconvolution algorithm to make it feasible to use on a PC.  We were the first company to bring this tech to photographers when we released a Photoshop plugin, Topaz InFocus. This method works much better for small and moderate blurs.  It also works, to a certain degree, on blur due to camera shake or from a moving object. To this day, Topaz InFocus is still be considered to be one of the best sharpening tools on the market. Later, Photoshop also added “Smart Sharpen” and “Shake Reduction” based on deconvolution.

Figure 2. Large motion blur (click to view at 100%)

In addition to being much slower than the image filtering method, deconvolution needs to know the point spread function, which is very hard to estimate. It is also very sensitive to image noise and jpeg compression.  Therefore, it fails most of the time for large and complex blurs, such as one in Figure 2 (a). Since Hollywood’s crime dramas had (incorrectly) shown that they could usually turn very blurry photos into sharp ones to catch the bad guys, Topaz InFocus fell short of some of our customers expectations.  I took this quite personally and have been on the lookout for a silver-bullet ever since.

For eight years we did not find one…. not until recently. I felt we might finally have a shot to redeem ourselves thanks to the rapid development of Deep Learning in Artificial Intelligence (AI).

AI approaches the problem very differently. Instead of studying the mathematical model of the blur process and how to solve the inverse problem, we train an Artificial Neural Network with millions of blur-sharp image pairs.  The neural network will eventually “remember” what the sharp image should look like if it sees a blurry image. After months of training, the neural network could produce a sharper when image given an image it had not seen before. Figure 1 (c) and Figure 2 (c) are examples from our latest product, Topaz Sharpen AI.   Here is another example to sharpen an out-of-focus photo.

Figure 3. Out-of-focus blur (click for 100%)

Looking at Figures 1, 2, and 3 more carefully, you will find that Topaz Sharpen AI seems be able to create images with very fine details rather than simply sharpening the edges.  This is what makes Topaz Sharpen AI truly unique – it actually synthesizes convincing details even if the blurred image does not have any through the power of AI.

There is a reason that nobody has released an deep-learning sharpen AI tool for photographers so far.  It is quite an engineering challenge. For example, the neural network requires extremely high computation that makes regular PC pretty much unusable.  I am so proud that our team was able to overcome many challenges to bring Topaz Sharpen AI to you, from Dr. Acharjee’s  ingenious neural network architecture, to Image Processing Lead Bowen Wang’s efficient GPU neural engine development, to our whole product team’s application design.

You can try it yourself by downloading the 30-day free trial.  For anyone who owns Topaz InFocus or the complete bundle, it’s a free upgrade!

Does AI finally make blurry images a thing of the past? Not at all.  The example images I used are pretty much the best case scenarios to impress you with the AI.  You will find it is still a hit or miss situation sometimes. However, it is a huge step forward when comparing with any existing solution, including our Topaz InFocus. And best of all, we are just at the beginning of the Artificial Intelligence (AI) revolution.  You can be assured that there will be many more amazing things to come.

About the Author

Albert Yang founded Topaz Labs over 10 years ago, to form a company that adopts and implements the latest technology to introduce cutting-edge tools to the Photo market. With over 30 years of programming experience, he’s proud to offer his technical expertise to our users as the primary developer of our latest tools.

Posted on 29 Comments

The A.I. Evolution behind Topaz A.I. Clear

[vc_row][vc_column][vc_column_text]

After a lot of effort from our team,  I am excited to share the latest version of A.I. Clear with you.  Topaz A.I. Clear is a software to remove photo noise and enhance sharpness. The update of A.I. Clear in Topaz Studio v1.12.5 is a completely new development. Not only does the new A.I. Clear do a better job of suppressing the noise, but further utilizes A.I. technology to transform noisy and blurry images into crisp and detailed images.

[/vc_column_text][vc_row_inner][vc_column_inner][vc_empty_space][vc_single_image image=”577643″ img_size=”large” onclick=”link_image”][vc_empty_space][/vc_column_inner][/vc_row_inner][vc_column_text]

As a researcher in image processing for over 30 years, I cannot help but feel a little giddy about what our team has done.  Just take a look at the image above. Look at the clean removal of the noise. More importantly, look at the details in the output image!

It was a long journey to get here. Topaz Labs has always been at the forefront of image noise reduction. In 2010, Topaz Denoise had been already considered the best high-iso noise removal software in the market, a position it has maintained to this day.  The reason is that Topaz Denoise employed an algorithm that approached a theoretical upper-bound in terms of SNR (signal to noise ratio) increase. Therefore there were no much room for us, or anyone else for this matter, to improve it substantially. That is, until deep-learning in Artificial Intelligence (A.I.) emerged.

[/vc_column_text][vc_empty_space][vc_column_text]

Hover over the blue plus signs to see more information.

[/vc_column_text][mpc_interactive_image content_preset=”_preset_0″ background_image=”608262″][mpc_hotspot preset=”mpc_preset_5″ position=”80||43.631″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwUkVEVUNFJTIwTk9JU0UlMjAlM0MlMkZoNCUzRSUwQSUwQSUzQ3AlMjBzdHlsZSUzRCUyMmxpbmUtaGVpZ2h0JTNBMS4zZW0lM0IlMjIlM0VUb3BheiUyMFN0dWRpbyUyMEFpJTIwQ2xlYXIlMjBjb21lcyUyMHdpdGglMjB0aHJlZSUyMGRpc3RpbmN0JTIwbmV1cmFsJTIwbmV0d29ya3MlMkMlMjBlYWNoJTIwdHJhaW5lZCUyMHNwZWNpZmljYWxseSUyMG9uJTIwYSUyMHNldCUyMG9mJTIwaW1hZ2VzJTIwd2l0aCUyMHNwZWNpZmljJTIwbm9pc2UlMjBhbmQlMjBkZXRhaWwlMjByZXF1aXJlbWVudHMuJTNDJTJGcCUzRSUwQQ==” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”82.190||49″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwQVVUTyUyMFNFVFRJTkclMjAlM0MlMkZoNCUzRSUwQSUwQSUzQ3AlMjBzdHlsZSUzRCUyMmxpbmUtaGVpZ2h0JTNBMS4zZW0lM0IlMjIlM0VXaXRoJTIwb25lJTIwY2xpY2slMkMlMjBBSSUyMENsZWFyJTIwYXV0b21hdGljYWxseSUyMHNldHMlMjB0aGUlMjBub2lzZSUyMHJlZHVjdGlvbiUyMGxldmVsJTIwdXNpbmclMjBhcnRpZmljaWFsJTIwaW50ZWxsaWdlbmNlJTIwdG8lMjBkZXRlcm1pbmUlMjB3aGF0JTIwc2V0dGluZyUyMGlzJTIwYmVzdCUyMGZvciUyMHlvdXIlMjBpbWFnZS4lM0MlMkZwJTNFJTBB” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”85.458||49″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwTE9XJTIwU1RSRU5HVEglMjAlM0MlMkZoNCUzRSUwQSUwQSUzQ3AlMjBzdHlsZSUzRCUyMmxpbmUtaGVpZ2h0JTNBMS4zZW0lM0IlMjIlM0VUaGUlMjBGYXN0ZXN0JTIwb2YlMjB0aGUlMjB0aHJlZSUyMG1vZGVscyUyQyUyMHRoZSUyMExvdyUyMHNldHRpbmclMjBpcyUyMGJlc3QlMjBmb3IlMjBpbWFnZXMlMjB3aXRoJTIwYSUyMHJhbmdlJTIwb2YlMjBzdWJqZWN0cyUyMGFuZCUyMGElMjBsb3clMjB0byUyMG1vZGVyYXRlJTIwYW1vdW50JTIwb2YlMjBjb2xvciUyMG5vaXNlLiUyMENpdHlzY2FwZXMlMkMlMjBsYW5kc2NhcGVzJTJDJTIwYW5kJTIwYXJjaGl0ZWN0dXJlJTIwYXJlJTIwZ3JlYXQlMjB1c2UlMjBjYXNlcyUyMGZvciUyMHRoaXMlMjBtb2RlbC4lM0MlMkZwJTNFJTBB” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”88.725||49″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwTUVESVVNJTIwU1RSRU5HVEglMjAlM0MlMkZoNCUzRSUwQSUwQSUzQ3AlMjBzdHlsZSUzRCUyMmxpbmUtaGVpZ2h0JTNBMS4zZW0lM0IlMjIlM0VXaXRoJTIwRG91YmxlJTIwdGhlJTIwY29tcGxleGl0eSUyMG9mJTIwdGhlJTIwTG93JTIwbW9kZWwlMkMlMjB0aGUlMjBNZWRpdW0lMjBzZXR0aW5nJTIwaXMlMjBiZXN0JTIwZm9yJTIwaW1hZ2VzJTIwd2l0aCUyMGElMjBkZWZpbmVkJTIwc3ViamVjdCUyMGFuZCUyMGElMjBtb2RlcmF0ZSUyMGFtb3VudCUyMG9mJTIwbm9pc2UlMjBhbmQlMjBhcnRpZmFjdHMuJTIwVGhpcyUyMHNldHRpbmclMjBpcyUyMHBhcnRpY3VsYXJseSUyMGdvb2QlMjBvbiUyMHBvcnRyYWl0cyUyMGFuZCUyMHNraW4uJTNDJTJGcCUzRSUwQQ==” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”91.993||49″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwSElHSCUyMFNUUkVOR1RIJTIwJTNDJTJGaDQlM0UlMEElMEElM0NwJTIwc3R5bGUlM0QlMjJsaW5lLWhlaWdodCUzQTEuM2VtJTNCJTIyJTNFV2l0aCUyMGRvdWJsZSUyMHRoZSUyMGNvbXBsZXhpdHklMjBvZiUyMHRoZSUyMExvdyUyMG1vZGVsJTJDJTIwdGhlJTIwSGlnaCUyMHNldHRpbmclMjBpcyUyMGJlc3QlMjBmb3IlMjBpbWFnZXMlMjB3aXRoJTIwYSUyMGhpZ2glMjBhbW91bnQlMjBvZiUyMG5vaXNlJTIwYW5kJTIwYXJ0aWZhY3RzLiUyMEV2ZW5pbmclMjBzaG90cyUyQyUyMExvbmclMjBFeHBvc3VyZXMlMjBhbmQlMjBNaWQlMjB0byUyMEhpZ2glMjBJU08lMjBpbWFnZXMlMjBhcmUlMjBjbGVhbmVkJTIwYW5kJTIwc2hhcnBlbmVkJTIwd2l0aCUyMHRoaXMlMjBzZXR0aW5nLiUzQyUyRnAlM0UlMEE=” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”80||51.220″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwRU5IQU5DRSUyMFNIQVJQTkVTUyUyMCUzQyUyRmg0JTNFJTBBJTBBJTNDcCUyMHN0eWxlJTNEJTIybGluZS1oZWlnaHQlM0ExLjNlbSUzQiUyMiUzRVRoZSUyMG5ldyUyMEVuaGFuY2UlMjBTaGFycG5lc3MlMjBmZWF0dXJlJTIwYWxsb3dzJTIweW91JTIwdG8lMjBtYW5pcHVsYXRlJTIwdGhlJTIwZGV0YWlsJTIwaW4lMjB5b3VyJTIwaW1hZ2UlMjB0byUyMGJyaW5nJTIwZHVsbCUyMGZlYXR1cmVzJTIwYmFjayUyMHRvJTIwbGlmZS4lM0MlMkZwJTNFJTBB” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”82.190||55″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwTE9XJTIwU1RSRU5HVEglMjAlM0MlMkZoNCUzRSUwQSUwQSUzQ3AlMjBzdHlsZSUzRCUyMmxpbmUtaGVpZ2h0JTNBMS4zZW0lM0IlMjIlM0VUaGUlMjBMb3clMjBzZXR0aW5nJTIwaXMlMjBiZXN0JTIwZm9yJTIwaW1hZ2VzJTIwd2l0aCUyMGElMjBzbWFsbGVyJTIwZ3JvdXAlMjBvZiUyMHN1YmplY3RzLiUyMFdvcmtzJTIwd2VsbCUyMG9uJTIwcG9ydHJhaXRzJTJDJTIwdGVsZXBob3RvJTIwaW1hZ2VzJTJDJTIwYW5kJTIwYXN0cm9waG90b2dyYXBoeS4lMjAlM0MlMkZwJTNFJTBB” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”85.458||55″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwSElHSCUyMFNUUkVOR1RIJTIwJTNDJTJGaDQlM0UlMEElMEElM0NwJTIwc3R5bGUlM0QlMjJsaW5lLWhlaWdodCUzQTEuM2VtJTNCJTIyJTNFVGhlJTIwSGlnaCUyMHNldHRpbmclMjBpcyUyMGJlc3QlMjB3aXRoJTIwYSUyMGxvdCUyMG9mJTIwc21hbGwlMjBkZXRhaWwuJTIwVGhpcyUyMG1vZGVsJTIwd29ya3MlMjBlc3BlY2lhbGx5JTIwd2VsbCUyMHdpdGglMjBsYW5kc2NhcGUlMjBwaG90b2dyYXBoeS4lM0MlMkZwJTNFJTBB” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”80||58.537″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwUkVDT1ZFUiUyMERFVEFJTFMlMjAlM0MlMkZoNCUzRSUwQSUwQSUzQ3AlMjBzdHlsZSUzRCUyMmxpbmUtaGVpZ2h0JTNBMS4zZW0lM0IlMjIlM0VJZiUyMHlvdSUyMGZpbmQlMjBBSSUyMENsZWFyJTIwdG8lMjBiZSUyMHJlbW92aW5nJTIwYSUyMGJpdCUyMHRvbyUyMG11Y2glMjBkZXRhaWwlMkMlMjBpbmNyZWFzaW5nJTIwdGhlJTIwdmFsdWUlMjBvZiUyMHRoaXMlMjBzbGlkZXIlMjB3aWxsJTIwYnJpbmclMjBiYWNrJTIwZGV0YWlscyUyMHRoYXQlMjBhcmUlMjByZW1vdmVkJTIwYnklMjB0aGUlMjBhZGp1c3RtZW50LiUzQyUyRnAlM0UlMEE=” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”80||64.499″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwRVhQT1NVUkUlMjAlM0MlMkZoNCUzRSUwQSUwQSUzQ3AlMjBzdHlsZSUzRCUyMmxpbmUtaGVpZ2h0JTNBMS4zZW0lM0IlMjIlM0VVc2UlMjB0aGlzJTIwc2xpZGVyJTIwdG8lMjBpbmNyZWFzZSUyMG9yJTIwZGVjcmVhc2UlMjB0aGUlMjBleHBvc3VyZSUyMG9mJTIweW91ciUyMHJlc3VsdCUyQyUyMGhpZ2hlciUyMHZhbHVlcyUyMGluY3JlYXNlJTIwZXhwb3N1cmUlMkMlMjBsb3dlciUyMHZhbHVlcyUyMGRlY3JlYXNlJTIwZXhwb3N1cmUuJTNDJTJGcCUzRSUwQQ==” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][mpc_hotspot preset=”mpc_preset_5″ position=”80||69.648″ icon=”eti eti_plus_alt” icon_color=”#188ee5″ icon_size=”12″ border_divider=”true” border_css=”border-radius:50px;” padding_divider=”true” padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” margin_divider=”true” hover_border_divider=”true” mpc_tooltip__show_effect=”slide” mpc_tooltip__font_color=”#f7f7f7″ mpc_tooltip__font_size=”14″ mpc_tooltip__font_line_height=”1.2″ mpc_tooltip__font_transform=”none” mpc_tooltip__font_align=”center” mpc_tooltip__text=”JTNDaDQlMjBzdHlsZSUzRCUyMnRleHQtYWxpZ24lM0ElMjBjZW50ZXIlM0IlMjBmb250LXNpemUlM0ElMjAyM3B4JTNCJTIwbGluZS1oZWlnaHQlM0ElMjAxZW0lM0IlMjBjb2xvciUzQSUyM2Y3ZjdmNyUzQiUyMG1hcmdpbi1ib3R0b20lM0EtMC4xNWVtJTNCJTIyJTNFJTIwQ0xBUklUWSUyMCUzQyUyRmg0JTNFJTBBJTBBJTNDcCUyMHN0eWxlJTNEJTIybGluZS1oZWlnaHQlM0ExLjNlbSUzQiUyMiUzRVVzZSUyMHRoaXMlMjBzbGlkZXIlMjB0byUyMGluY3JlYXNlJTIwb3IlMjBkZWNyZWFzZSUyMHRoZSUyMGVkZ2UlMjBjb250cmFzdCUyMG9mJTIweW91ciUyMGltYWdlLiUyMEhpZ2hlciUyMHZhbHVlcyUyMGluY3JlYXNlJTIwZWRnZSUyMHZpc2liaWxpdHklMkMlMjBsb3dlciUyMHZhbHVlcyUyMGJsZW5kJTIwZWRnZXMlMjBpbnRvJTIwc3Vycm91bmRpbmclMjBkZXRhaWwlMjAuJTNDJTJGcCUzRSUwQQ==” mpc_tooltip__background_color=”#188ee5″ mpc_tooltip__border_divider=”true” mpc_tooltip__padding_divider=”true” mpc_tooltip__padding_css=”padding-top:10px;padding-right:20px;padding-bottom:15px;padding-left:20px;” mpc_tooltip__margin_divider=”true”][/mpc_interactive_image][vc_empty_space][vc_column_text]

A few years ago, the deep-learning based photo noise reduction in research started to produce a more promising result. A.I. Clear is the first commercial software that took advantage of this development.  It uses a “feedforward” neural network trained to suppress input image noise as much as possible. This type of method had proven itself to beat all known traditional methods in a research environment. Since Topaz Studio is an interactive app, the challenge was to discover a neural network architecture that could produce a good result at an interactive speed.  Through some pretty hardcore development work, we managed to deliver the first version of A.I. Clear, which produced better noise suppression than traditional methods without the need to manually fine tune every parameter. The reception from our customers was exceptional.

[/vc_column_text][vc_row_inner][vc_column_inner][vc_empty_space][rev_slider_vc alias=”ai-clear-blog”][vc_empty_space][/vc_column_inner][/vc_row_inner][vc_column_text]

Then we began working on A.I. Gigapixel, the first deep learning desktop tool to enlarge photos. This long and detailed process vastly increased our understanding of A.I. based image enhancement. A.I. Gigapixel is based on a revolutionary concept in deep-learning called GAN (Generative Adversarial Network). It uses a “generative” neural network to synthesize plausible details that are non-existent in the input images. This process produces an unprecedented image enlargement result. The feedback for A.I. Gigapixel was so beyond our expectations and we knew we needed to use this technology for other purposes.

[/vc_column_text][vc_row_inner][vc_column_inner width=”1/2″][vc_empty_space height=”16px”][vc_column_text]

After the A.I. Gigapixel release, it was natural for us to try the same “generative” neural network idea on noise reduction and detail enhancement. So we did.  As expected, the “generative network” did not disappoint us.

But there was a catch. To produce the best result, this “generative” neural network needed a few orders of magnitude more “neurons and synapses” than the original one.  This much more complex network led to a very slow processing speed – an obvious no-go in an interactive app like A.I. Clear.  

[/vc_column_text][vc_empty_space height=”16px”][/vc_column_inner][vc_column_inner width=”1/2″][vc_empty_space height=”16px”][mpc_callout preset=”mpc_preset_5″ layout=”style_2″ title_font_preset=”mpc_preset_17″ title_font_color=”#f7f7f7″ title_font_size=”20″ title_font_line_height=”2″ title_font_transform=”uppercase” title_font_align=”center” title=”Wanna Learn More?” title_margin_divider=”true” title_margin_css=”margin-top:-1px;” content_width=”100″ content_font_preset=”mpc_preset_44″ content_font_color=”#f7f7f7″ content_font_size=”17″ content_font_line_height=”1.75″ content_font_align=”center” icon=”etl etl-lightbulb” icon_color=”#ffffff” icon_size=”44″ icon_border_css=”border-width:3px;border-color:#ffffff;border-style:dashed;border-radius:100px;” icon_padding_css=”padding:10px;” icon_margin_divider=”true” icon_margin_css=”margin-bottom:0.4em;” background_color=”#75cdde” padding_css=”padding:30px;” mpc_button__preset=”mpc_preset_35″ mpc_button__url=”url:https%3A%2F%2Ftopazlabs.com%2Fai-clear%2F|||” mpc_button__font_preset=”mpc_preset_20″ mpc_button__font_color=”#ffffff” mpc_button__font_size=”16″ mpc_button__font_transform=”uppercase” mpc_button__title=”Visit the AI Clear Page” mpc_button__border_css=”border-width:2px;border-color:#ffffff;border-style:solid;border-radius:5px;” mpc_button__padding_divider=”true” mpc_button__padding_css=”padding-top:12px;padding-right:30px;padding-bottom:12px;padding-left:30px;” mpc_button__margin_divider=”true” mpc_button__margin_css=”margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;” mpc_button__hover_font_color=”#75cdde” mpc_button__hover_background_color=”#ffffff” mpc_button__hover_background_effect=”slide-left” mpc_button__hover_border_css=”border-radius:0px;” mpc_divider__preset=”mpc_preset_2″ mpc_divider__width=”10″ mpc_divider__lines_color=”#f7f7f7″ mpc_divider__lines_weight=”2″ mpc_divider__margin_divider=”true” mpc_divider__margin_css=”margin-bottom:0px;”]

Check out the AI Clear product page to learn more about AI Clear including pricing and to see more examples.

[/mpc_callout][vc_empty_space height=”16px”][/vc_column_inner][/vc_row_inner][vc_column_text]

Eventually, our research scientist Dr. Acharjee found a pretty good compromise.  Through the work of our incredible development team, we managed to create a process that uses one-tenth the number of “neurons” than what we had started with. Not only did we match our previous speed – we exceeded it. Now, the speed is 2 to 3 times faster than the previous version of A.I. Clear, and we’ve improved image quality in most of our tests.  Still, for high noisy or blurry images it tends to synthesize unnatural-looking patterns (see image below) due to lack of enough “neurons” to remember the proper patterns.

[/vc_column_text][vc_row_inner][vc_column_inner][vc_empty_space][vc_single_image image=”577642″ img_size=”large” onclick=”link_image”][vc_empty_space][/vc_column_inner][/vc_row_inner][vc_column_text]

While it was a pity that we could not put our best but admittedly slow neural network into A.I. Clear, we’re working on using this neural network in other ways. We’ve got a batch process image enhancer in the works that will use the no-compromise large neural network for those who want the very best possible result that A.I. technology can offer – regardless of how long it takes. A.I. Clear is impressive in what it can do, and even more capable technology is coming.

For now, I am excited to share the new A.I Clear with you. What do you think?

[/vc_column_text][/vc_column][/vc_row][vc_row][vc_column][vc_empty_space][vc_text_separator title=”About the Author” border_width=”2″][vc_empty_space][/vc_column][/vc_row][vc_row content_width=”grid”][vc_column][vc_empty_space][vc_empty_space][/vc_column][/vc_row][vc_row][vc_column width=”1/3″][vc_single_image image=”369676″ img_size=”medium”][/vc_column][vc_column width=”2/3″][vc_column_text]

About Albert Yang

Albert Yang founded Topaz Labs over 10 years ago, to form a company that adopts and implements the latest technology to introduce cutting-edge tools to the Photo market. With over 30 years of programming experience, he’s proud to offer his technical expertise to our users as the primary developer of our latest tools.

[/vc_column_text][/vc_column][/vc_row][vc_row][vc_column][vc_empty_space][vc_empty_space][/vc_column][/vc_row][vc_row css=”.vc_custom_1534441729460{background-color: #333333 !important;}”][vc_column][mpc_icon_column preset=”mpc_preset_40″ layout=”style_2″ url=”url:https%3A%2F%2Ftopazlabs.com%2Fdownloads%23studio|||” background_color=”#333333″ border_css=”border-color:#333333;border-style:solid;border-radius:0px;” padding_css=”padding:30px;” title_font_preset=”mpc_preset_1″ title_font_color=”#ffffff” title_font_size=”17″ title_font_line_height=”1.4″ title_font_transform=”uppercase” title_font_align=”center” title=”Try A.I. Clear Free” title_margin_divider=”true” title_margin_css=”margin-bottom:8px;” content_font_preset=”mpc_preset_1″ content_font_color=”#ffffff” content_font_size=”14″ content_font_line_height=”1.5″ content_font_align=”center” hover_border_css=”border-color:#ffffff;border-radius:0px;” mpc_icon__transition=”slide-up” mpc_icon__icon_type=”image” mpc_icon__icon_image_size=”80×80″ mpc_icon__icon_image=”351319″ mpc_icon__background_color=”#ffffff” mpc_icon__border_css=”border-width:0px;border-color:#0a0505;border-style:solid;border-radius:20px;” mpc_icon__padding_css=”padding:10px;” mpc_icon__margin_divider=”true” mpc_icon__margin_css=”margin-bottom:20px;” mpc_icon__hover_icon_color=”#ffffff” mpc_icon__hover_background_color=”#0071e2″ mpc_icon__hover_border_css=”border-color:#ffffff;” mpc_divider__disable=”true” mpc_divider__width=”10″ mpc_divider__align=”left” mpc_divider__content_padding_divider=”true” mpc_divider__content_padding_css=”padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;” mpc_divider__lines_color=”#dddddd” mpc_divider__padding_divider=”true” mpc_divider__padding_css=”padding-top:3px;padding-bottom:3px;”]

Get started with a 30 day trial of this amazing Pro Adjustment, when you download Topaz Studio for free.  You’ve got nothing to lose.

[/mpc_icon_column][mpc_textblock content_width=”100″ font_preset=”preset_4″ font_align=”center”]

[qodef_icon icon_pack=”font_awesome” fa_icon=”fa-gears” size=”qodef-icon-medium” custom_size=”” type=”normal” border_radius=”” shape_size=”” icon_color=”” border_color=”” border_width=”” background_color=”” hover_icon_color=”” hover_border_color=”” hover_background_color=”” margin=”” icon_animation=”” icon_animation_delay=”” link=”” anchor_icon=”” target=”_self”]System Requirements

 

[/mpc_textblock][vc_empty_space][/vc_column][/vc_row]