Virtualization Technology News and Information
Chaos Sumo 2018 Predictions: Feeding the Artificial Intelligence Dragon in 2018

VMblog Predictions 2018

Industry executives and experts share their predictions for 2018.  Read them in this 10th annual series exclusive.

Contributed by Thomas Hazel, Founder, CTO, and Chief Scientist of Chaos Sumo

Feeding the Artificial Intelligence Dragon in 2018

By now you should have heard or read many of the 2018 predictions. And more often than not, Artificial Intelligence (AI) driven "something" tops those lists. Even if a prediction does not have AI in its description, surely some internal aspect of it does. Now, the term AI as an idea or as a concept has been around for a long time and has broad connotations. But with today's significant computational power and the capacity to generate and store mountains of data, AI has had a resurgence over the last several years. This is particularly the case for its underlying disciplines such as Machine Learning and Deep Learning computer algorithms.

In a way, the continued growth in network, storage, and computational speed and capacity has reached such a level, that the ability to produce and process such diverse data has reignited AI potential. So much potential, that in 2018 Artificial Intelligence will beget additional information, requiring additional network, storage, and computational resources. In other words, information is what feeds this proverbial dragon. As more information is consumed, the more critical AI will become and be infused into our 2018 lives.

Prediction Axiom of 2018 - Intelligence needs Information needs Storage needs Intelligence

Intelligence Needs Information

The phrase "knowledge is power" is as true to AI algorithms as it is for humans. The mind is like a computer that can be programmed. As one goes through life and is educated, one learns new concepts and instructions to consume and process information. The more one learns, the more potential one has. This is identical to AI systems.

The computer is like the mind and algorithms are the concepts and instructions to consume and process information to ultimately make decisions. Today, computers are everywhere and in everything, connected and always getting smarter. Think of the products labeled smart today - TVs, Phones, Devices and Applications for the home, etc. Many of these products are connected to the major internet companies - Google, Amazon, Facebook etc. All of which are sharing and processing this information to either make products better or make the experience more unique to the individual consumer.

For instance, it has been suggested that Facebook knows you better than anyone. With just 10 likes, Facebook knows you better than a work colleague. With 70 likes, it knows you better than a college roommate. With 150, better than your family, and with 300+, better than your spouse. And all this understanding is driven by AI algorithms and the data we provide or the devices we use.

Information Needs Storage

Much of what makes AI possible is the "amount" of data used to teach or train the algorithms. In other words, Artificial Intelligence is as good as the data it can consume. There are times where an algorithm does not have access or time to consume all of the information it could use to make intelligent decisions. As a result, storage is key to the future of AI systems.

International Data Corporation (IDC) has suggest that by 2020 each person on earth will create roughly 2MB of data per second, reaching upward of 44 zettabyte. And as AI systems take hold and start creating their own data, I imagine that these numbers will easily be surpassed. Gartner has even suggested there will be more than 20 billion IoT devices in existence by 2020. And if they are all AI enabled, just imagine the amount of information generated.

The answer to this tsunami of data is storage. Storage that is simple to use; elastic; scalable in nature; and extremely cost efficient. Increasingly, object storage is considered the answer to this deluge of information. Whether in the cloud, on-premise, or inside devices, object storage has all the requirements to take AI into 2018.

Storage Needs Intelligence

As with all things in 2018, storage is moving into this brave new world of Artificial Intelligence. AI has the unique ability to organize, prepare, model, and analyze its content such that services can more easily consume this all-important data. Today, generated data is more disjointed and diverse than ever before. Whether it is structured, semi-structured, or unstructured, all of it is creating a chaotic mess.

With billions of people and even more billions of devices, the ability to manually keep storage, whether object storage or not, healthy and secure, is frankly unachievable. But the notion of storage using AI to perform such task is not only an amazing concept, but in 2018, a complete necessity.

It has been suggested that data scientists spend 60 to 80 percent of their time organizing, cleaning, and preparing data to be analyzed. AI systems are similar to data scientists; to use such data, it needs to be normalized. The idea that "Smart Storage" automatically does this normalization is the catalyst for next generation products and will feed the Artificial Intelligence Dragon in 2018.


About the Author 

Thomas Hazel 

Thomas Hazel is Founder, CTO, and Chief Scientist of Chaos Sumo, a cloud service providing Data Lake Unification and Analytics Services on Amazon's S3. He is a serial entrepreneur at the forefront of communication, virtualization, and database science and technology. Thomas is the author of several popular open source projects and has patented many inventions in the areas of distributed algorithms, virtualization and database science. He holds a Bachelor of Science in Computer Science from University of New Hampshire, and founded both student & professional chapters of the Association for Computing Machinery (ACM).

Published Wednesday, January 17, 2018 7:45 AM by David Marshall
There are no comments for this post.
To post a comment, you must be a registered user. Registration is free and easy! Sign up now!
<January 2018>