david_linthicum
Contributor

Why SaaS-based AI training will be a game changer

analysis
Nov 22, 20193 mins
AnalyticsArtificial IntelligenceCloud Computing

As machine learning engines multiply, we see the benefits of having them train each other, versus using limited training data we may or may not have

robots toy robot ai machine learning automation pair team teamwork
Credit: Getty Images

If you deal with machine learning-based systems, you know all about training data. Data must be formatted correctly and be accurate before it’s loaded into an AI model for the purpose of training the model.

Say you’re creating a fraud detection engine using a popular machine learning system in a public cloud. First you create the data set used to train the model: in this case, millions of transactional records with the fraudulent transactions labeled. This allows the model to learn what’s likely fraudulent and what isn’t. Of course, there are different types of training data, some labeled, some not.

Once trained, the model may indeed continue training by learning what’s likely fraudulent and not through experience learning. Indeed, if you had the time, the model could train itself over time by monitoring transactions that humans or other systems mark fraudulent.

What strikes me about this approach to AI training is that you need a sound training data set. In some cases, it can be obtained from open or proprietary training data brokers. In most instances, you format your own data to train the machine learning model. However, what if other trained machine learning models could train models, anywhere and any time?

The idea is not new. Since the advent of AI we’ve toyed with the idea of having one AI engine teach another, either by sharing training data or, better yet, sharing knowledge and experience through direct, automatic interaction. Having one AI engine mentor yours provides outside experience and thus makes the AI model more valuable and effective.

This is easier said than done. Machine learning engines typically don’t talk to each other, even if they are the same software. They are designed from the ground up to be stand-alone learners and interact with non-AI systems or humans. However, inter-AI engine training is on most vendor radar screens.

Lately I’m seeing a few key trends that could change the game:

  • First, is the use of on-demand or SaaS-based AI engines that can interact with other AI engines within a public cloud or on-premises. You can think of these as SaaS clouds that specialize in teaching other AI engines about a specific set of skills, everything from spotting fraudulent transactions, to medical diagnostics, to machine maintenance, and more.
  • Second, AI engines are able to combine with your taught models, creating an AI superbrain of sorts, not only providing global experiences outside of your domain but combining with your own training data to provide local and global experiences.

I’m bringing this up now because most enterprises need to be aware of these trends if they want to get more value out of AI, including machine learning and deep learning. Moreover, many enterprises are running into a wall of not having enough training data to make machine learning functional. This could be a good way to solve both problems.

david_linthicum
Contributor

David S. Linthicum is an internationally recognized industry expert and thought leader. Dave has authored 13 books on computing, the latest of which is An Insider’s Guide to Cloud Computing. Dave’s industry experience includes tenures as CTO and CEO of several successful software companies, and upper-level management positions in Fortune 100 companies. He keynotes leading technology conferences on cloud computing, SOA, enterprise application integration, and enterprise architecture. Dave writes the Cloud Computing blog for InfoWorld. His views are his own.

More from this author