Check out all the on-demand sessions from the Intelligent Security Summit here<\/a><\/em>.<\/p>\n

\n<\/div>\n
Ray<\/a>, the popular open-source machine learning (ML)<\/a> framework, has released its 2.2 version with improved performance and observability capabilities, as well as features that can help to enable reproducibility.<\/p>\n
The Ray technology is widely used by organizations to scale ML models across clusters of hardware, for both training and inference. Among Ray\u2019s many users is generative AI<\/a> pioneer OpenAI<\/a>, which uses Ray to scale and enable a variety of workloads, including supporting ChatGPT<\/a>. The lead commercial sponsor behind the Ray open-source technology is San Francisco-based Anyscale<\/a>, which has raised $259 million in funding to date.<\/p>\n
The new Ray 2.2 release continues to build out a series of capabilities first introduced in the Ray 2.0 update<\/a> in August 2022, including Ray AI Runtime (AIR) that is designed to serve as a runtime layer for executing ML services. With the new release, the Ray Jobs feature is moving from being a beta feature to general availability, providing users with the ability to more easily schedule and repeat ML workloads.\u00a0<\/p>\n
>>Don\u2019t miss our special issue:\u00a0 The CIO agenda: The 2023 roadmap for IT leaders<\/a>.<<<\/p>\n
<\/p>\n
\n
Event<\/h3>\n
\n
Intelligent Security Summit On-Demand<\/span><\/p>\n
Learn the critical role of AI & ML in cybersecurity and industry specific case studies. Watch on-demand sessions today.<\/span><\/p>\n<\/div>\n

\n Watch Here <\/a>\n <\/p>\n<\/div>\n
<\/body><\/p>\n
Ray 2.2 also provides a series of capabilities intended to help improve observability of ML workloads, helping data scientists ensure efficient use of hardware computing resources.<\/p>\n
\u201cOne of the most common and challenging things about scaling machine learning applications is debugging, which is basically figuring out what went wrong,\u201d Robert Nishihara, cofounder and CEO of Anyscale, told VentureBeat. \u201cOne of the most important things we can do with Ray is to improve the tooling around observability.\u201d<\/p>\n
Where observability matters for scaling AI\/ML workloads<\/h2>\n
Ray fits into a number of common use cases for helping organizations scale artificial intelligence (AI) and ML workloads.<\/p>\n
Nishihara explained that Ray is commonly used to help scale up and run training workloads for ML models. He noted that Ray is also used for AI inference workloads, including computer vision and natural language processing (NLP), where lots of images or text are being identified. <\/p>\n
Increasingly, organizations are using Ray for multiple workloads at the same time, which is where the Ray AIR fits in, providing a common layer for ML services. With Ray 2.2, Nishihara said that AIR benefits from performance improvements that will help accelerate training and inference.<\/p>\n
Ray 2.2 also has a strong focus on helping improve observability for all types running workloads. The observability enhancements in Ray 2.2 are all about making sure that all types of workloads have the right amount of resources to run. Nishihara said that one of the biggest classes of errors that ML workloads encounter is running out of resources, such as CPU or GPU memory. Among the ways that Ray 2.2 improves observability into resource-related issues is with new visualization on the Ray Dashboard that help operators better understand resource utilization and capacity limits.<\/p>\n
How Ray Jobs will give AI reproducibility and explainability a boost<\/h2>\n
The Ray 2.2 release also includes the general availability for the Ray Jobs feature that helps users deploy workloads in a consistent and repeatable approach.<\/p>\n
Nishihara explained that Ray Jobs includes both the actual application code for the workload as well as a manifest file that describes the required environment. The manifest lists all the details needed to run a workload, such as application code and dependencies needed in an environment to execute the training or inference operation.<\/p>\n
The ability to easily define the requirements for how an AI\/ML workload should run is a key part of enabling reproducibility, which is what Ray Jobs is supporting. Reproducibility is also a foundational element of enabling explainability, according to Nishihara.<\/p>\n
\u201cYou need reproducibility to be able to do anything meaningful with explainability,\u201d Nishihara said.<\/p>\n
He noted that generally, when people talk about explainability, they\u2019re talking about being able to interpret what an ML model is actually doing. For example, why a model reached a certain decision.<\/p>\n
\u201cYou need a strong experimental setup to be able to start to ask these questions, and that includes reproducibility,\u201d he said.<\/p>\n
VentureBeat’s mission<\/strong> is to be a digital town square for technical decision-makers to gain knowledge about transformative enterprise technology and transact. Discover our Briefings.<\/a><\/p>\n
\t\t\t\t<\/html><\/div>\n<\/p><\/div>\n
Read More<\/a>
\n Sean Michael Kerner<\/p>\n","protected":false},"excerpt":{"rendered":"
January 31, 2023 6:00 AM Image Credit: peterhowell \/ Getty Images Check out all the on-demand sessions from the Intelligent Security Summit here. Ray, the popular open-source machine learning (ML) framework, has released its 2.2 version with improved performance and observability capabilities, as well as features that can help to enable reproducibility. The Ray technology<\/p>\n","protected":false},"author":1,"featured_media":603482,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[24646,4889,46],"tags":[],"class_list":{"0":"post-603481","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-boosts","8":"category-machine","9":"category-technology"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/603481","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=603481"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/603481\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/603482"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=603481"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=603481"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=603481"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}

Event<\/h3>\n\nIntelligent Security Summit On-Demand<\/span><\/p>\nLearn the critical role of AI & ML in cybersecurity and industry specific case studies. Watch on-demand sessions today.<\/span><\/p>\n<\/div>\n