Red
Hat
announced new capabilities for Red Hat OpenShift AI. Building and
expanding upon the proven capabilities of Red Hat OpenShift and Red Hat
OpenShift Data Science, Red Hat OpenShift AI provides a consistent,
scalable foundation based on open source technology for IT operations
leaders while bringing a specialized partner ecosystem to data
scientists and developers to capture innovation in AI. To that end, Red
Hat OpenShift AI underpins the generative AI services of IBM watsonx.ai,
IBM's artificial intelligence platform designed to scale intelligent
applications and services across all aspects of the enterprise, fueling
the next generation of foundation models.
As
Large Language Models (LLMs) like GPT-4 and LLaMA become mainstream,
researchers and application developers across all domains and industries
are exploring ways to benefit from these, and other foundation models.
Customers can fine tune commercial or open source models with
domain-specific data to make them more accurate to their specific use
cases. The initial training of AI models is incredibly infrastructure
intensive, requiring specialized platforms and tools even before
serving, tuning and model management are taken into consideration.
Without a platform that can meet these demands, organizations are often
limited in how they can actually use AI/ML.
OpenShift
AI addresses these challenges by providing the infrastructure
consistency across training, deployment and inference to unlock the
potential of AI.
AI for the open hybrid cloud
Red
Hat OpenShift AI helps remove many of these barriers by providing a
standardized foundation for creating production AI/ML models, as well as
running the resulting applications. OpenShift AI delivers the
consistency, ease-of-use and cloud-to-edge deployment options of Red Hat
OpenShift. Platform engineers can create scalable configurations,
specific to the needs of their data scientists and developers. OpenShift
AI can be used to fine-tune existing models, saving on initial model
training costs, increasing time to value and expanding AI usage beyond
specialized data scientists.
Red
Hat OpenShift AI provides several optional technology partner offerings
including Anaconda, IBM Watson Studio, Intel OpenVINO and AI Analytics
Toolkit, NVIDIA AI Enterprise and Starburst. It also provides access to
30 additional AI/ML certified partners as part of the OpenShift
ecosystem.
Customers
with specific regulatory and compliance requirements, including
air-gapped and disconnected environments, can prepare data, and develop,
train and deploy models on-premises using OpenShift AI. Customers can
also develop models in the public cloud, and deploy them on-premises or
at the edge using the same consistent tooling and interfaces, providing a
unique, hybrid MLOps environment that enables collaboration between IT
operations, data science and application developers.
The
proven foundation of OpenShift AI enables customers to more reliably
scale to train foundation models using OpenShift's native GPU
acceleration features on-premises or via a cloud service.
Recent enhancements to Red Hat OpenShift AI include:
- Deployment pipelines for
AI/ML experiment tracking and automated ML workflows, which helps data
scientists and intelligent application developers to more quickly
iterate on machine learning projects and build automation into
application deployment and updates.
- Model serving now
includes GPU support for inference, and custom model serving runtimes
that improve inference performance and improved deployment of foundation
models.
- Model monitoring enables organizations to manage performance and operational metrics from a centralized dashboard.
OpenShift AI powers IBM watsonx and Ansible Lightspeed
Red
Hat OpenShift AI provides the base for IBM's latest AI advancements,
including IBM Watson Code Assistant, to deliver domain-specific AI to
your IT organization and developer teams.
Ansible
Lightspeed brings the power of IBM Watson Code Assistant to Ansible,
empowering users of all skill levels to write Ansible Playbooks with
AI-generated recommendations. Ansible Lightspeed enables a productivity
boost for Ansible users, enabling them to use English language commands
to create an Ansible Playbook, regardless of their proficiency level in
automation.
Across industries, enterprises are already using Red Hat OpenShift AI to fuel AI/ML innovation, including:
- Atruvia,
a German provider of IT services, including AI, to financial
institutions worldwide, has based its organization-wide data science
platform on Red Hat OpenShift AI.
- Clalit Health Care Services,
Israel's largest health service organization, selected Red Hat
OpenShift AI as the foundation for building clinical research AI models.
- Guidehouse,
a global provider of consulting and managed services, tapped Red Hat
OpenShift AI as part of a comprehensive platform to help address the
suicide rates of U.S. veterans.
- Tirando X Colombia,
a Colombia-based reproductive health-focused nonprofit, deployed Red
Hat OpenShift AI to optimize its AI/ML workflow for creating a teenage
pregnancy prevention application.
- Veripark,
a global solutions provider to financial services organizations, built
its global AI/ML solution using Red Hat OpenShift Data Science in order
to run the solution across cloud and on-premises platforms.