{"id":8235,"date":"2024-04-29T10:18:46","date_gmt":"2024-04-29T10:18:46","guid":{"rendered":"https:\/\/news.asbis.com\/news\/?p=8235"},"modified":"2024-04-29T10:39:52","modified_gmt":"2024-04-29T10:39:52","slug":"intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads","status":"publish","type":"post","link":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/","title":{"rendered":"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads"},"content":{"rendered":"\n<p>Intel has validated its AI product portfolio for the first Meta Llama 3 8B and 70B models across Intel\u00ae Gaudi\u00ae accelerators, Intel\u00ae Xeon\u00ae processors, Intel\u00ae Core\u2122 Ultra processors and Intel\u00ae Arc\u2122 graphics.<br><br>As part of its mission to bring AI everywhere, Intel invests in the software and AI ecosystem to ensure that its products are ready for the latest innovations in the dynamic AI space. In the data center, Intel Gaudi and Intel Xeon processors with Intel\u00ae Advanced Matrix Extension (Intel\u00ae AMX) acceleration give customers options to meet dynamic and wide-ranging requirements.<br><br>\u0399ntel Core Ultra processors and Intel Arc graphics products provide both a local development vehicle and deployment across millions of devices with support for comprehensive software frameworks and tools, including PyTorch and Intel\u00ae Extension for PyTorch\u00ae used for local research and development and OpenVINO\u2122 toolkit for model development and inference.<br><br>Intel\u2019s initial testing and performance results for Llama 3 8B and 70B models use open source software, including PyTorch, DeepSpeed, Intel Optimum Habana library and Intel Extension for PyTorch to provide the latest software optimizations.<br><br><strong>Intel Xeon<\/strong> processors address demanding end-to-end AI workloads, and Intel invests in optimizing LLM results to reduce latency. Intel\u00ae Xeon\u00ae 6 processors with Performance-cores (code-named Granite Rapids) show a 2x improvement on Llama 3 8B inference latency compared with 4th Gen Intel\u00ae Xeon\u00ae processors and the ability to run larger language models, like Llama 3 70B, under 100ms per generated token.<strong>Intel Core Ultra<\/strong> and<strong> Intel Arc Graphics <\/strong>deliver impressive performance for Llama 3. In an initial round of testing, Intel Core Ultra processors already generate faster than typical human reading speeds. Further, the Intel\u00ae Arc\u2122 A770 GPU has Xe Matrix eXtensions (XMX) AI acceleration and 16GB of dedicated memory to provide exceptional performance for LLM workloads.\u00a0<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link has-background wp-element-button\" href=\"https:\/\/www.asbis.com\/vendors\/intel\" style=\"background-color:#a4b8cf\">More about Intel<\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Intel has validated its AI product portfolio for the first Meta Llama 3 8B and 70B models across Intel\u00ae Gaudi\u00ae accelerators, Intel\u00ae Xeon\u00ae processors, Intel\u00ae Core\u2122 Ultra processors and Intel\u00ae Arc\u2122 graphics. As part of its mission to bring AI everywhere, Intel invests in the software and AI ecosystem to ensure that its products are&#8230;<\/p>\n","protected":false},"author":4,"featured_media":8236,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[142],"tags":[33],"class_list":["post-8235","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-suppliers","tag-intel"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v24.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads - ASBIS<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads - ASBIS\" \/>\n<meta property=\"og:description\" content=\"Intel has validated its AI product portfolio for the first Meta Llama 3 8B and 70B models across Intel\u00ae Gaudi\u00ae accelerators, Intel\u00ae Xeon\u00ae processors, Intel\u00ae Core\u2122 Ultra processors and Intel\u00ae Arc\u2122 graphics. As part of its mission to bring AI everywhere, Intel invests in the software and AI ecosystem to ensure that its products are...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/\" \/>\n<meta property=\"og:site_name\" content=\"ASBIS\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-29T10:18:46+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-29T10:39:52+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"750\" \/>\n\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Victor Krasnov\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Victor Krasnov\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/\"},\"author\":{\"name\":\"Victor Krasnov\",\"@id\":\"https:\/\/news.asbis.com\/news\/#\/schema\/person\/830235e38b9b627087e48529e022480c\"},\"headline\":\"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads\",\"datePublished\":\"2024-04-29T10:18:46+00:00\",\"dateModified\":\"2024-04-29T10:39:52+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/\"},\"wordCount\":302,\"publisher\":{\"@id\":\"https:\/\/news.asbis.com\/news\/#organization\"},\"image\":{\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg\",\"keywords\":[\"Intel\"],\"articleSection\":[\"Suppliers News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/\",\"url\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/\",\"name\":\"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads - ASBIS\",\"isPartOf\":{\"@id\":\"https:\/\/news.asbis.com\/news\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg\",\"datePublished\":\"2024-04-29T10:18:46+00:00\",\"dateModified\":\"2024-04-29T10:39:52+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#primaryimage\",\"url\":\"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg\",\"contentUrl\":\"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg\",\"width\":750,\"height\":350,\"caption\":\"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/news.asbis.com\/news\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/news.asbis.com\/news\/#website\",\"url\":\"https:\/\/news.asbis.com\/news\/\",\"name\":\"ASBIS\",\"description\":\"Newsroom\",\"publisher\":{\"@id\":\"https:\/\/news.asbis.com\/news\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/news.asbis.com\/news\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/news.asbis.com\/news\/#organization\",\"name\":\"ASBIS\",\"url\":\"https:\/\/news.asbis.com\/news\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/news.asbis.com\/news\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2025\/03\/Logo-Newsroom-2-1.png\",\"contentUrl\":\"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2025\/03\/Logo-Newsroom-2-1.png\",\"width\":2560,\"height\":553,\"caption\":\"ASBIS\"},\"image\":{\"@id\":\"https:\/\/news.asbis.com\/news\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/news.asbis.com\/news\/#\/schema\/person\/830235e38b9b627087e48529e022480c\",\"name\":\"Victor Krasnov\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/news.asbis.com\/news\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/ed22c68ea213fd2fb889074a1cb029a442d9ebc9100fabccd6863e11f9bd633d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/ed22c68ea213fd2fb889074a1cb029a442d9ebc9100fabccd6863e11f9bd633d?s=96&d=mm&r=g\",\"caption\":\"Victor Krasnov\"},\"sameAs\":[\"http:\/\/www.asbis.com\"],\"url\":\"https:\/\/news.asbis.com\/news\/author\/v-krasnovasbis-com\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads - ASBIS","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/","og_locale":"en_US","og_type":"article","og_title":"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads - ASBIS","og_description":"Intel has validated its AI product portfolio for the first Meta Llama 3 8B and 70B models across Intel\u00ae Gaudi\u00ae accelerators, Intel\u00ae Xeon\u00ae processors, Intel\u00ae Core\u2122 Ultra processors and Intel\u00ae Arc\u2122 graphics. As part of its mission to bring AI everywhere, Intel invests in the software and AI ecosystem to ensure that its products are...","og_url":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/","og_site_name":"ASBIS","article_published_time":"2024-04-29T10:18:46+00:00","article_modified_time":"2024-04-29T10:39:52+00:00","og_image":[{"width":750,"height":350,"url":"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg","type":"image\/jpeg"}],"author":"Victor Krasnov","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Victor Krasnov","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#article","isPartOf":{"@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/"},"author":{"name":"Victor Krasnov","@id":"https:\/\/news.asbis.com\/news\/#\/schema\/person\/830235e38b9b627087e48529e022480c"},"headline":"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads","datePublished":"2024-04-29T10:18:46+00:00","dateModified":"2024-04-29T10:39:52+00:00","mainEntityOfPage":{"@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/"},"wordCount":302,"publisher":{"@id":"https:\/\/news.asbis.com\/news\/#organization"},"image":{"@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#primaryimage"},"thumbnailUrl":"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg","keywords":["Intel"],"articleSection":["Suppliers News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/","url":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/","name":"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads - ASBIS","isPartOf":{"@id":"https:\/\/news.asbis.com\/news\/#website"},"primaryImageOfPage":{"@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#primaryimage"},"image":{"@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#primaryimage"},"thumbnailUrl":"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg","datePublished":"2024-04-29T10:18:46+00:00","dateModified":"2024-04-29T10:39:52+00:00","breadcrumb":{"@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#primaryimage","url":"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg","contentUrl":"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2024\/04\/Intel_news_29_02_2024_750x350.jpg","width":750,"height":350,"caption":"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads"},{"@type":"BreadcrumbList","@id":"https:\/\/news.asbis.com\/news\/suppliers\/intel-xeon-core-ultra-and-ai-pc-accelerate-genai-workloads\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/news.asbis.com\/news\/"},{"@type":"ListItem","position":2,"name":"Intel Xeon, Core\u2122 Ultra and AI PC Accelerate GenAI Workloads"}]},{"@type":"WebSite","@id":"https:\/\/news.asbis.com\/news\/#website","url":"https:\/\/news.asbis.com\/news\/","name":"ASBIS","description":"Newsroom","publisher":{"@id":"https:\/\/news.asbis.com\/news\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/news.asbis.com\/news\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/news.asbis.com\/news\/#organization","name":"ASBIS","url":"https:\/\/news.asbis.com\/news\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/news.asbis.com\/news\/#\/schema\/logo\/image\/","url":"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2025\/03\/Logo-Newsroom-2-1.png","contentUrl":"https:\/\/news.asbis.com\/news\/wp-content\/uploads\/2025\/03\/Logo-Newsroom-2-1.png","width":2560,"height":553,"caption":"ASBIS"},"image":{"@id":"https:\/\/news.asbis.com\/news\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/news.asbis.com\/news\/#\/schema\/person\/830235e38b9b627087e48529e022480c","name":"Victor Krasnov","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/news.asbis.com\/news\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/ed22c68ea213fd2fb889074a1cb029a442d9ebc9100fabccd6863e11f9bd633d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ed22c68ea213fd2fb889074a1cb029a442d9ebc9100fabccd6863e11f9bd633d?s=96&d=mm&r=g","caption":"Victor Krasnov"},"sameAs":["http:\/\/www.asbis.com"],"url":"https:\/\/news.asbis.com\/news\/author\/v-krasnovasbis-com\/"}]}},"_links":{"self":[{"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/posts\/8235","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/comments?post=8235"}],"version-history":[{"count":3,"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/posts\/8235\/revisions"}],"predecessor-version":[{"id":8239,"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/posts\/8235\/revisions\/8239"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/media\/8236"}],"wp:attachment":[{"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/media?parent=8235"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/categories?post=8235"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.asbis.com\/news\/wp-json\/wp\/v2\/tags?post=8235"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}