Industry executives and experts share their predictions for 2024. Read them in this 16th annual VMblog.com series exclusive.
Dremio Executives Predict Top Data Lakehouse and AI Trends for 2024
The year 2023 was dominated by the advancement
and mainstream acceptance of AI, from industry to culture. The exponential rise
of generative AI has shown that there are applications that can help every
single industry thrive. One technology category we saw that flew under the
radar was the rise of data lakehouses.
The rise will continue once again into the new
year and beyond. 70% of IT professionals think that more than
half of all analytics will be on the data lakehouse within three years, and 86%
believe that their organization plans to unify its analytics data. This can
lead to cost efficiency and ease of use for its users.
The combination of artificial intelligence and
data lakehouses empowers organizations to achieve their potential beyond
traditional approaches to querying data. The ability to use natural
language-to-SQL generative interfaces can help easily interact with data,
eliminate manual repetitive tasks and take action to build a domain-specific AI
application in a timely and efficient manner, giving time and power back to the
people, allowing time and space for innovation.
Dremio CEO Sendur Sellakumar, CMO Read Maloney
and Data & Analytics Product, Strategy, & Enterprise Architecture
Leader Nik Acheson offer their predictions for the upcoming year and what
trends they expect to emerge in AI, data lakehouses and more.
Practice
makes perfect
"In 2024, we're going to see development best
practices, in terms of code, make their way into data. The concepts of data
uptime and data downtime, which are related to data observability and part of
data operations, will come in.
Users have different ways to ensure the
quality, and that if something goes wrong, you can pinpoint where it went
wrong, saving you precious time. The increased complexity and costs are taking
engineers away from the more important things and what they want to do, which
is much higher value projects than shoveling data all day long." - Read
Maloney
Generative
AI hype train will continue to grow exponentially
"I think we're still in a GenAI hype cycle,
and I tend to be very practical. Things around GenAI have been very compelling.
We hardly talked about GenAI a year ago; now we do, which is excellent. The
things we're doing now are going to be vastly different from what we're doing
today. You have lots of models that will change a year from now dramatically,
one will become more popular than another and it will evolve.
Generative AI will be the future of user
interfaces. All applications will embed generative AI to drive user
interaction, which guides user productivity. Companies are embedding GenAI to
do semantic searching to solve some of those old data problems - discovery
becomes easier, creating pipelines becomes more accessible." - Sendur
Sellakumar
A new
sheriff in town
"The adoption of Apache Iceberg will be huge
in 2024 - it's going to be the open format for interoperability and the
customer choice for flexibility. For us, it comes back to the customer and they
want to own their own data, and we think Apache Iceberg is the format for that.
It's going to take over as the open standard in 2024.
Data
contracts pick up
"We talk a lot about data products, fabric and
mesh, but the thing we continue to ignore is what does it look like to continue
to mature these assets in the enterprise? That moves into things like data
governance and stewardship. I think a big trend is going to be how you make it
real for the enterprise." - Nick Acheson
##