HPC News Bytes – 20240909
– Copyright law, Fair Use doctrine, and AI’s appetite for data
– TSMC’s CoWoS capacity
– Intel’s 18A fab
– DOE’s $23 million RFP re future of HPC
The OrionX editorial team manages the content on this website.
– Copyright law, Fair Use doctrine, and AI’s appetite for data
– TSMC’s CoWoS capacity
– Intel’s 18A fab
– DOE’s $23 million RFP re future of HPC
The OrionX editorial team manages the content on this website.
– Nvidia Blackwell delays
– Inference champions
– AI regulations
– Supercomputing in Russia
The OrionX editorial team manages the content on this website.
– Hot Chips 2024 conference
– LANL electricity needs enter the senate race
– A small modular nuclear reactor in a 30-inch borehole a mile under?
– AMD in $4.9B deal to buy ZT Systems
The OrionX editorial team manages the content on this website.
We are delighted to have Dr. Mike Heroux as special guest to discuss HPC software in general and the Exascale Computing Project (ECP) software efforts in particular. Topics include performance vs. portability and maintainability, heterogeneous hardware, the impact of AI on workloads and tools, the emergence of Research Software Engineer as a needed role and a career path, the convergence of commercial and HPC software stacks, and what’s on the horizon.
Dr. Heroux is a senior scientist at Sandia National Laboratories and scientist-in-residence at St. John’s University in Minnesota. He’s been with both of those organizations for more than 25 years. Mike was also the ECP’s Director of Software Technologies. While that project has been completed, Mike’s software work has continued to receive funding. Earlier in his career, Mike was with SGI, and Cray. His focus is on all aspects of scalable scientific and engineering software for parallel computing architectures.
The OrionX editorial team manages the content on this website.
– AI-centric servers form new market segment
– NIST announcement heralds Post Quantum Cryptography (PQC) milestone
– English Professors win NSF grant to study supercomputing’s impact on society, geopolitics
The OrionX editorial team manages the content on this website.
– UK Govt. cuts funding to exascale and AI projects
– Investment in AI inference rises
– AI models: open source vs. guardrails
– Will SC24 be the largest supercomputing event ever?
The OrionX editorial team manages the content on this website.
– Intel financial results
– Nvidia Blackwell delays
– Which programming language is most energy efficient?
– Discoveries led by exascale software
The OrionX editorial team manages the content on this website.
– Nvidia to build GPUs specially for the Chinese market to comply with export control
– Morgan Stanley report projects 60,000 to 70,000 Nvidia AI racks in 2025
– China and TOP500, no new news
– NTT and U. Tokyo use Graphene Plasmon in pursuit of faster opto-electronics
The OrionX editorial team manages the content on this website.
– ORNL’s RFP for post-exascale “Discovery” system
– Forced mate in 12 moves? New chess puzzle challenges engines
– Solid oxide fuel cell (SOFC) to power GPU Datacenter
– Keep your data for 5,000 years, anyone?
The OrionX editorial team manages the content on this website.
– AI survey by S&P Global Market Intelligence commissioned by Vultr
– OpenAI proposes 5 levels of AI based on capability
– SoftBank acquires Graphcore
The OrionX editorial team manages the content on this website.
The @HPCpodcasts Industry View feature takes on major issues in the world of HPC, AI, and other advanced technologies through the lens of industry leaders. Today, we discuss the design and deployment of large scale AI infrastructure: why AI at scale is such a critical need, where the challenges lie, and what it takes to do it right. We are joined by Jonathan Ha who is Senior Director of Product Management for AI at Penguin Solutions. Jonathan has been in the industry for more than 25 years has previously held senior positions in product management at Microsoft, AMD, and AWS.
The OrionX editorial team manages the content on this website.
– SMIC Wafer Yields for Huawei Ascend 910B AI Chip
– Goldman Sachs Report on Gen AI ROI, Readiness
– New Startup Fuels Special-Purpose Chip Trend
The OrionX editorial team manages the content on this website.
– Intel’s Silicon Photonics Milestone
– Intel’s 144-core-now-288-core-next-year Xeon Sierra Forrest CPU
– Quantum Advantage: Time vs. Space
– Microsoft Concludes Undersea Datacenter Project
The OrionX editorial team manages the content on this website.
We are delighted to be joined by Christine Chalk, physical scientist at U.S. Department of Energy and federal program manager for the Exascale Computing Project (ECP) and the Oak Ridge Leadership Computing Facility. Christine is also responsible for budget formulation for Advanced Scientific Computing Research (ASCR) and management of the Advanced Scientific Computing Advisory Committee and the Computational Science Graduate Fellowship. Topics include the ECP project and what made it so successful, how policy turns into a budget, and the growing importance of the role of women in HPC.
The OrionX editorial team manages the content on this website.
– GPU price wars?
– Rectangular wafers for more/bigger chips
– AI assistant for science
– AI Supercomputer in Japan, New exascale in the EU
The OrionX editorial team manages the content on this website.
– New paper on “Managing extreme AI risks amid rapid progress” with an all-star author list
– Investments in Taiwan, Chip War
– AI Chip Landscape, Specialty AI Chips gain traction
– Where would AI datacenters fin energy? Fusion, Geothermal, Hydrogen Fuel Cells
– Apple Silicon in Datacenter?
The OrionX editorial team manages the content on this website.
– Clinical trials for cancer fighting drug discovered by LLNL and BridgeBio
– Sandia and Submer say immersing the whole rack can get big power savings
– In defense of the CHIPS Act
– New paper “Scalable MatMul-free Language Modeling” promises low memory low power AI
The OrionX editorial team manages the content on this website.
Shahin and Doug are joined by Nestor Maslej of the Stanford Institute for Human-Centered Artificial Intelligence (HAI) at Stanford University. He tracks the advancement of AI in his role as Research Manager and Editor in Chief of the annual Stanford AI Index and Stanford Global AI Vibrancy Tool. Nestor has degrees from Harvard and Oxford and is also a fellow at the Center for International Governance Innovation.
A 502 page report, the AI Index covers a wide range of topics in nine chapters:
1) Research and Development
2)Technical Performance
3) Responsible AI
4) Economy
5) Science and Medicine
6) Education
7) Policy and Governance
8) Diversity
9) Public Opinion
The OrionX editorial team manages the content on this website.
– Computex-24, Nvidia Rubin, Nvidia Vera, AMD MI325X, AMD Turin
– Ultra Accelerator Link (UAlink)
– EU’s 2nd Exascale System at CEA France
– Is AI getting ahead of itself?
The OrionX editorial team manages the content on this website.
– Techno-politics, China, TSMC, and ASML remote disablement
– CryptoSuper500 report on Bitcoin as Specialized Supercomputing
– X-ai says it will build AI supercomputer with 100,000 H100 GPUs
– AI regulations in EU go into effect next month
– Nvidia GPUs continue strong in earnings season
The OrionX editorial team manages the content on this website.
– Who will join the Exascale club next?
– Nvidia “paints it green”
– Other AI chips impress
– Student Cluster Competition winners
The OrionX editorial team manages the content on this website.
The new TOP500 at ISC24 conference is here with a new addition to the Exaflop Club, a new HPL-MxP (AI) champion, new top three in Green500, and also a look at HPCG, the difficult benchmark that usually sets the lower bound of system performance. Tune in as Shahin and Doug go through the list with their commentary and analysis.
The OrionX editorial team manages the content on this website.
– ISC24 conference begins today
– Substantial investments in Quantum Tech continue
– Geopolitics of chips and scenario planning around TSMC, again
– Electricity shortage and grid capacity for AI datacenters
The OrionX editorial team manages the content on this website.
Reminiscent of the so-called “Attack of Killer Micros” which heralded the arrival of microprocessors in the early 1990s, the “Attack of Killer Chiplets” and similar technologies like Coarse-Grain Reconfigurable Arrays (CGRA) are coming to enable specialized architectures, re-define computing, and provide new avenues for advancing supercomputing speed and energy efficiency.
Special guest and last year’s ISC-2023 program chair John Shalf joins Shahin and Doug to discuss the rise of specialized architectures in the Post Moore’a Law era. This is a topic John will discuss at Wednesday night’s keynote at the ISC conference in Hamburg, Germany next week. John is department head for computer science research at Lawrence Berkeley National Laboratory (LBNL). He formerly was CTO at the National Energy Research Supercomputing Center (NERSC).
John is a coauthor of over 60 publications in the field of parallel computing software and HPC technology, including three best papers and the widely cited report “The Landscape of Parallel Computing Research: A View from Berkeley” (with David Patterson and others). He also coauthored “ExaScale Software Study: Software Challenges in Extreme Scale Systems,” which sets the Defense Advanced Research Project Agency’s (DARPA’s) information technology research investment strategy for the next decade. He was a member of the Berkeley Lab/NERSC team that won a 2002 R&D 100 Award for the RAGE robot.
The OrionX editorial team manages the content on this website.
– ASML and US-China Trade Wars
– Tik Tok Ban Bill in the US
– Intersect360 HPC-AI Market Size in 2023
– Women in HPC at ISC24
The OrionX editorial team manages the content on this website.
Cristin Merritt joins Shahin and Doug to discuss Women in HPC (WHPC), its goals and mission, six lessons learned about “moving the needle” on the organizational transformation that is needed to address lack of diversity, equity, and inclusion (DEI), and the activities planned by International Supercomputing Conference (ISC) and WHPC for the ISC24 conference to be held in Hamburg, Germany next week from May 12–16.
Cristin is Chief Marketing Officer (CMO) at Alaces Flight, a UK-based advanced computing and HPC class systems integrator and service provider. She is also the a leader of the Women in HPC organization where her official title is business manager. WHPC operates 28 chapters and affiliates around the world.
The OrionX editorial team manages the content on this website.
– Infra-Tech, Datacenter Shortage of Parts, Property, and Power
– AI winter, AI bubble, dot-AI bust
– Trade bans, Chain of Custody
– Sandia National Lab’s Hala Point Neuromorphic Supercomputer
The OrionX editorial team manages the content on this website.
– New supercomputers at Los Alamos and France-CEA
– Stanford AI Index Report
– Bitcoin Halving
– Argonne-UIC Crabtree Institute for Discovery and Sustainability
The OrionX editorial team manages the content on this website.
– Intel Vision 2024 Event, Intel Gaudi 3, Xeon 6
– Meta MTIA accelerator chip
– Nvidia GPU shortage easing
– Category Theory, Categorical Deep Learning, Geometric Deep Learning
– China economic growth plans, high end manufacturing industrial policy
The OrionX editorial team manages the content on this website.
– TSMC Arizona back on schedule
– Dutch government support for ASML
– Intel Foundry profitability
– TSMC expands CoWoS capacity
– SK Hynix $3.9B for Indiana HBM fab and R&D with Purdue
– Quantinuum and Microsoft show major improvement for qubit fidelity
The OrionX editorial team manages the content on this website.
– Microsoft OpenAI $100B Stargate supercomputer
– Eviden winning deals, growing and hiring
– Alibaba RISC-V datacenter chip
– Linear Pluggable Optics Multi-Source Agreement, LPO-MSA
– Nvidia banning CUDA translation software like ZLUDA
The OrionX editorial team manages the content on this website.
What does a supercomputer center do when it’s operating two systems on the TOP-10 most powerful computers? Well, it starts planning for what’s next. The center is Oak Ridge National Lab (ORNL), and that’s exactly what it is doing. We caught up with Matt Sieger, Project Director for the 6th iteration of the Oak Ridge Leadership Computing Facility (OLCF-6) to get a glimpse of the project, its objectives, status, and timelines.
Meet Discovery, the supercomputer that is being planned to succeed Frontier (the current #1 at 1.19 exaflops in 64 bits) while Summit (the current #7 at 148.8 64-bit petaflops) continues to work alongside it.
With a Ph.D. in Physics from the University of Illinois at Urbana-Champaign and stints at the Pacific Northwest National Laboratory (PNNL), Intel’s fabrication facilities in Portland, Oregon, and a Knoxville-based startup as Chief Software Architect, Matt joined ORNL in 2009. He moved to OLCF as Deputy Project Director for the Frontier project in 2018, and was selected to lead the effort to procure the successor to Frontier in 2021.
The OrionX editorial team manages the content on this website.
– Nvidia GTC24
– Intel fab and US CHIPS Act
– Who isn’t in the Ultra Ethernet Consortium?
– Samsung HBM-or-GPU blend
The OrionX editorial team manages the content on this website.
Live from Nvidia GTC24 AI-everywhere show, Doug and Shahin get together in the usual coffee-shop-chat style of the @HPCpodcast. They cover the wide range of announcements made by Nvidia, discuss the contrast between the Nvidia model and some other players, and share some color on the event itself.
The OrionX editorial team manages the content on this website.
– European AI Act
– 5nm Cerebras Wafer Scale Engine 3
– A faster matrix-multiply algorithm?
– Meta’s GenAI Infrastructure
The OrionX editorial team manages the content on this website.
– IndiaAI Mission, including a 10,000-GPU supercomputer
– Countries court chip manufacturers for local fabs
– AI value-chain consolidation from fabs to apps to clouds
– Atos spinout of Eviden caught in financial complexity
The OrionX editorial team manages the content on this website.
– GPU Shortage, HPE, Dell Financial Results
– GPU allocation: CSP, On-prem, AI PCs, Embedded AI
– Chip Capacity, Intel Fabs in Germany, Japan Advanced Semiconductor Manufacturing
– Singapore AI program, Mid-career Training
– AI business justification, AI talent shortage
The OrionX editorial team manages the content on this website.
– Intel Foundry Event, “Systems Foundry” Era
– Nvidia Earnings,Valuation, AI Learning vs AI Inference, In-Memory Computing for AI
– HPC in Space, Data Centers on the Moon
– ISC-24 Conference
The OrionX editorial team manages the content on this website.
– AI Security, Safety, Containment, Governance
– U.S. AI Safety Institute Consortium (AISIC)
– Running CUDA Apps On ROCm
– Exascale software linear algebra software library
– Chinese chipmaker Loongson tapes out 16-core DragonChain-powered CPU
– Photonic computing chip at University of Pennsylvania
The OrionX editorial team manages the content on this website.
– Honda taps Cadence Design System digital twin supercomputer for CFD, air taxi R&D
– Chip news: Nvidia, TSMC, SKHynix, IBM AIU, OpenAI
– Kathy Yelick to Deliver ISC 2024 Keynote on Post-Exascale Computing
– Google settles with Singular Computing over claims of stolen AI chip tech
The OrionX editorial team manages the content on this website.
– Argonne National Lab’s Nexus Integrated Research Infrastructure (IRI)
– Delays in Intel’s Fab in Ohio, CHIPS Act
– Mitchel Institute report on Quantum Information Science and Technologies
– Controlling Emergent AI, High Calory Data
The OrionX editorial team manages the content on this website.
– Italy’s Eni Acquiring 600 PFLOPS System
– Intel’s Advanced Fab in New Mexico, UMC partnership
– NSF’s Advanced Computing National AI Research Resource Pilot
– D-Wave’s 1,200+ Qubit Advantage2 Prototype
– IonQ’s 35 algorithmic qubit system
The OrionX editorial team manages the content on this website.
We discuss the state of Quantum Information Science with our special guest Dr. Travis Humble, a global authority on the subject, director of the Quantum Science Center, a Distinguished Scientist at Oak Ridge National Laboratory, and director of the lab’s Quantum Computing Institute. QSC is a partnership funded by Department of Energy comprised of leading academic institutions, National Labs, and corporations. Dr. Humble is editor-in-chief of ACM Transactions on Quantum Computing, Associate Editor for Quantum Information Processing, and co-chair of the IEEE Quantum Initiative. He also holds a joint faculty appointment with the University of Tennessee Bredesen Center for Interdisciplinary Research and Graduate Education. Please join us for an insightful discussion of quantum technologies and their impact on supercomputing and scientific discovery.
The OrionX editorial team manages the content on this website.
– Synopsys to Acquire Ansys
– Meta is spending billions on Nvidia chips
– OpenAI CEO raising billions to build new chips and new chip factories
– Pawesey selects QuEra, US Geological Survey selects Q-CTRL, Quantinuum Raises $300M
The OrionX editorial team manages the content on this website.
– RIKEN Hybrid Quantum-HPC Platform with Quantinuum
– Google in $1.67B AI Chip Patent Infringement Trial
– Crack in Cloud Egress Fees
– ORNL Post-Exascale RFP for next generation OLCF-6 to be delivered in the 2027 time frame
– HPE Acquires Juniper Networks
The OrionX editorial team manages the content on this website.
– Intel 4 fab, IDM 2.0, Ericsson
– CXL, Samsung, Red Hat
– AI startup funding
– Quantum Key Distribution (QKD) landscape
The OrionX editorial team manages the content on this website.
– Moore’s Law slows down, Intel, TSMC
– TSMC 1nm Chips, Arizona plant
– Huawei results, Mate 60 Pro smartphone, Kirin 9000S chip
– DARPA US2QC, PsiQuantum, Microsoft
The OrionX editorial team manages the content on this website.
2023 Year in Review is our annual special edition as we look back at one of the more eventful years in recent history for HPC, AI, Quantum Computing, and other advanced technologies. The list below includes time stamps (in minutes and seconds) and the associated topic in the podcast.
02:00 – HPC
03:45 – AI
08:03 – Metaverse
12:01 – Chips, GPUs, Accelerators
14:00 – GPU Competition
14:00 – GPU Competition
15:46 – Open Source
17:54 – Aurora Supercomputer
20:21 – TOP500
20:55 – Cloud in TOP10
21:53 – China
24:15 – Europe
25:55 – Quantum Computing
30:12 – Photonics
31:35 – Cryptocurrencies
The OrionX editorial team manages the content on this website.
– EU Exascale, HLRS, MareNostrum Inauguration
– Neuromorphic AI gets active
– ASML’s 1st High-NA EUV system goes to Intel
– Argonne’s Bimetallic All-optical Switch
The OrionX editorial team manages the content on this website.
– Intel launches Gen-5 Emerald Rapids
– New York State’s own “Chips Act”: $10B for NanoTech Complex with IBM, Micron, others
– Quantum Computing market size from Hyperion Research
– AI “Benchmarketing”: Nvidia takes AMD’s bait
The OrionX editorial team manages the content on this website.
– AMD MI300 availability as AI Chip Party heats up
– Q2B Silicon Valley quantum conference update
– Linux foundation’s High-Performance Software Foundation and DAOS Foundation
– Int’l consortium for trustworthy and reliable generative AI models for science
– EU agrees landmark deal on regulation of AI
– ISC Submission Deadlines extended
The OrionX editorial team manages the content on this website.
– Why would The New Yorker cover HPC technologies?
– Open Benchmark Council’s TOP100 lists
– Intel as one of the largest customers of TSMC’s high-end fab?
– Digital Twins for hyropower at ORNL and PNNL
The OrionX editorial team manages the content on this website.
Adrian Cockcroft joins us again after SC23 to discuss TOP500 trends, the AI-HPC crossover, liquid cooling, chiplets, and the emergence of UCIe and CXL advancements. Be sure to listen to previous episodes with Adrian; Episode 36 on HPC in cloud and sustainability data and Episode 55 on decarbonization and ESG.
The OrionX editorial team manages the content on this website.
– NVIDIA Ethernet push with Dell, HPE, Lenovo
– Research and Engineering Studio on AWS
– Latest on Chinese exascale
– HPC-Quantum integration: Riken’s Fugaku + NTT Ei and Simulated systems
The OrionX editorial team manages the content on this website.
– SC23 stats
– Exascale update and future
– Raft of new chips
– Quantum Village at SC23
– UCIe, PCIe, Ultra Ethernet
The OrionX editorial team manages the content on this website.
We provide details and our analysis of the latest TOP500 list of the most powerful supercomputers in the world. This round sees quite a shake-up in the top 10 and reveals interesting changes in the market.
The OrionX editorial team manages the content on this website.
– SC23 Starts, TOP500 later today
– Storage at Scale, DAOS, Aurora, Linux Foundation
– Sandia National Lab and DDN
– TSMC 1.4nm, SMIC financials
The OrionX editorial team manages the content on this website.
As SC23 approaches, we were fortunate to catch up with Rick Stevens and Mike Papka of Argonne National Lab for a wide ranging discussion. In addition to an update on the Aurora supercomputer and TOP500, we also discuss the need and challenged of building a national exascale capability, developing teams and bench strength, the risks and opportunities of AI for science and society, the trend towards integrated research infrastructure (IRI), and what’s next for the exascale initiative. We’d like to encourage you to also listen to episodes 15 and 16 of this podcast where we discuss AI in science with prof. Stevens.
Rick Stevens is Argonne’s Associate Laboratory Director for the Computing, Environment and Life Sciences (CELS) Directorate and an Argonne Distinguished Fellow. He is also a Professor of Computer Science at the University of Chicago. He was previously leader of Exascale Computing Initiative at Argonne.
Michael Papka is a senior scientist at Argonne National Laboratory where he is also deputy associate laboratory director for Computing, Environment and Life Sciences (CELS) and division director of the Argonne Leadership Computing Facility (ALCF).
The OrionX editorial team manages the content on this website.
Karl Freund, founder and principal analyst at Cambrian-AI Research joins us to discuss the, well, “Cambrian explosion” that we are witnessing in AI chips, the general state of the AI semiconductor market, and the competitive landscape in deep learning, inference, and software infrastructure in support of AI. Karl has a deep background in HPC and AI, having served in executive roles at Cray, IBM, AMD, and Calxeda, a pioneer of Arm-based system-on-chip (SoC) for servers. Karl is a frequent contributor to Forbes.
The OrionX editorial team manages the content on this website.
– UK Summit on AI, AI Supercomputers in the UK
– US Presidential Executive Order on AI
– Peter Ungaro on full episode of @HPCpodcast
– Intersect360 Market Update
The OrionX editorial team manages the content on this website.
In this episode of Industry View, we are delighted to have a rare opportunity to catch up with none other than Pete Ungaro, long time luminary and admired leader in HPC/AI. Mr. Ungaro is a globally recognized technology executive, among the “40 under 40” by Corporate Leader Magazine in 2008, and CEO of the year by Seattle Business Monthly for the year 2006. He was most recently SVP/GM of High Performance Computing (HPC), Mission Critical Systems (MCS), and HPE Labs at HPE. Previously, he was president and CEO of Cray Inc. until its acquisition by HPE. Prior to joining Cray in 2003, Mr. Ungaro served as Vice President of Worldwide Deep Computing Sales for IBM.
In this episode of Industry View, we cover the Cray journey as it became the clear winner in exascale systems, the HPE acquisition, the challenges of delivering a new extreme-scale system during COVID, a look at HPC software, storage, power and cooling, and quantum computing, the opportunities and challenges of AI, and the geopolitics of high tech.
The OrionX editorial team manages the content on this website.
– SC23 Conference “all in” with Streaming
– Intel Financials, On-track with Fab, Progress in AI
– Quantum Computing Round-up, Still Early Days
– Oxide Computer All-Custom Cloud Computer
The OrionX editorial team manages the content on this website.
Vanessa Sochat and Alan Sill ,the creators of the HPC.social project join us as we discuss the broad HPC/AI community and their efforts to enable it digitally through a broad multi-channel platform that includs Slack, Discord, Mastodon, GitHub, a jobs board, a community map, and the effort’s main site HPC.social.
The HPC community has grown but continues to have a very special tight-knit feel to it, as if everyone knows everyone else. While ISC, SC, and other conferences physically bring HPC (and increasingly AI) practitioners together, the digital community has been scattered and evolving. The work led by Vanessa and Alan puts a welcome focus on this digital aspect of the HPC community.
Vanessa is a computer scientist at Lawrence Livermore National Lab. She is a software engineer working with the converged computing team mapping out the space between cloud and HPC, both technologically and culturally. Previously, she worked in research computing at Stanford where she earned a PhD in biomedical informatics, and she was a researcher at Duke University where she earned a degree in psychology and neuroscience. Alan is managing director of the High Performance Computing Center at Texas Tech where he has also been a professor of physics and where he has been for 31 years. He is also co-director of The National Science Foundation’s Cloud and Autonomic Computing Center and is president of the Open Grid Forum. Alan has an extensive background in distributed and grid computing.
The OrionX editorial team manages the content on this website.
We are starting a new feature, looking at HPC, AI, and other advanced technologies through the lens of industry leaders. In this episode, we have the pleasure of a very lively conversation with Alain Andreoli, a longtime luminary of HPC and IT. Mr. Andreoli was with HPE for more than 7 year where he served as group president and EVP of the Hybrid IT Group, helping shape HPE’s strategy for HPC including the acquisition of SGI in 2017. Earlier he was at Sun Microsystems where he was president of the European operations. He was also a senior executive at Ntt, Oracle, and Texas Instruments.
The OrionX editorial team manages the content on this website.
– HPE Cray at Crusoe Flared Gas Data Centers
– IBM NorthPole AI Chip
– TSMC financials: AI, 3nm, Inventory
– AI Frenzy, AGI, Brain Waves as Input
– Exascale, Aurora, TOP500
The OrionX editorial team manages the content on this website.
From the early days of supercomputing through the stellar success of the Exascale Project, few HPC luminaries have played such an integral and leadership role in supercomputing as Dr. Paul Messina. So as we look at the annual observance of the Exascale Day on October eighteenth, we were delighted to get a chance to discuss the journey to Exascale with someone who has led and overseen 10 orders of magnitude in performance improvement. Dr. Messina’s distinguished career dates back to the early 70s. After earning his PhD at the University Of Cincinnati, Paul joined Argonne National Lab in 1973. He was involved in building programming language for the original Cray 1. At CalTech, he was the director of the Center for Advanced Computing Research. In 1998 to 2000 he led the DOE-NNSA Accelerated Strategic Computing Initiative (ASCI) program which was at the heart of DOE’s Science Based Stockpile Stewardship strategy and a significant catalyst for supercomputing innovation. Dr. Messina was also the first director of the Exascale Computing Project (ECP) starting from 2015 until late 2017.
The OrionX editorial team manages the content on this website.
– China Exascale Investment
– Samsung 3nm, Intel, TSMC
– Exascale Day
– Women in HPC, Why Women Stopped Coding
– GPU Shortage and Competition, Nvidia H100, AMD MI300, Intel Gaudi-2
The OrionX editorial team manages the content on this website.
– 1st Exascale Supercomputer in Europe
– Hyperion Rseaech Survey on the use of LLMs in HPC
– AD Little report on Quantum Computing myths and opportunities
– Human Immortality in 2030
The OrionX editorial team manages the content on this website.
– AMD’s Lisa Su at the Code Conference Discusses Generative AI, MI300, Open Strategy
– EUV armed Intel-4 Fab in Ireland Starts Volume Production
– AI Impact on Jobs, Case in the Legal Field
– Supercomputing Conference coming: SC23, Denver, Nov 12-17
The OrionX editorial team manages the content on this website.
– Intel Gaudi2, Collaboration with Dell, Satability AI
– Samba Nova SN40L, LLMs
– Air Force Research Lab 12 PFlop System
– Small Modular nuclear Reactors (SMRs)
– CHIPS Act: DOD $238m award for Microelectronics Commons Regional Innovation Hubs
The OrionX editorial team manages the content on this website.
– Intel Innovation Event, FPGA, Open Source
– AI-Oriented Papers in Science
– Arm IPO and Strategic Shift
– AMD EPYC 8004
The OrionX editorial team manages the content on this website.
Special guest David Barkai discusses his new book, Unmatched: 50 Years of Supercomputing. Dr. Barkai is a 50 year veteran of the HPC community whose new book chronicles the extraordinary progress of supercomputing over the past half century, and how HPC emerged as a “powerful demonstration of our relentless drive to understand and shape the world around us.” David entered HPC shortly after receiving a PhD in theoretical physics and has focused on relationships between applications and architectures. He served at several technology companies during their heydays such as Control Data, Floating Point Systems, Cray Research, SGI, and others along with stints at NASA Ames and Intel. Unmatched the book is broken up into five decade-long epochs defined by the system architectural themes of “big iron” vector processors, multiprocessors, microprocessor, clusters, and accelerators and cloud computing. The final part of the book examines key issues of HPC and discusses where it might all be headed. We were delighted to host David and have the excellent conversation that ensued. Join us.
The OrionX editorial team manages the content on this website.
– NVIDIA TensorRT-LLM
– Honeywell Leverages Quantum Computing Encryption Keys
– TSMC Silicon Photonics
– Microsoft Copilot AI Indemnification
– HPC Forum Tuscon
The OrionX editorial team manages the content on this website.
A change in distribution policy by Red Hat started the biggest open source controversy in years. We continue our coverage of this topic with Mike McGrath, whose two blogs from Red Hat in late June announced the company’s new policy. Mike is Vice President of Core Platforms at Red Hat where he leads the development of Red Hat Enterprise Linux (RHEL) and related platforms. He has been at Red Hat for nearly seventeen years and in the IT industry since 2004.
Our coverage started with special guest Joe Landman, and then with Greg Kurtzer of CIQ. Be sure to listen to all three episodes to get a full perspective on the various issues and nuances, and there are a few, including how the Open Source community has changed, how the software supply chain in Open Source has worked and why it is now a point of contention, and in what happened to Free Open Source Software (FOSS).
The OrionX editorial team manages the content on this website.
– Google Cloud with TPU v5e and Nvidia H100
– Arm Neoverse Compute Subsystem
– ETH’s Torsten Hoefler now also CSCS Chief Architect for Machine Learning
– @HPCpodcast: Greg Kurtzer on Red Hat and the RHEL Source Code Controversy
The OrionX editorial team manages the content on this website.
The Linux open source controversy was kicked off about two months ago when Red Hat announced it was changing access to Red Hat Enterprise Linux source code. This has thrown the open source community into a major disruption. We discussed this in a previous episode with our special guest Joe Landman. We also spoke with Greg Kurtzer of CIQ and Mike McGrath of Red Hat to get their perspectives.
This episode is our conversation with Greg Kurtzer, founder and chief executive officer of CIQ. He’s a 20+ year veteran in Linux open source and HPC. His focus has been on designing scalable architectures for performance-intensive computing while working for the US Department of Energy and holding a joint appointment to UC Berkeley. Greg has led several large open source projects such as CENTOS Linux and its successor Rocky Linux. Related to this conversation is a new industry alliance led by CIQ, Oracle, and SUSE called the Open Enterprise Linux Association. Stay tuned for an in-depth discussion with Mike McGrath of Red Hat.
The OrionX editorial team manages the content on this website.
– Gartner predicts accelerated growth for CDI
– MPI ABI to simplify parallel apps
– AMD buys AI software Mipsology, pointing to where chip companies will seek use cases and growth
– HPC in the Cloud gets “recycled”
The OrionX editorial team manages the content on this website.
– Intel calls off Tower Deal
– HotChips Conference Preview
– GPU Shortage as AI Leadership Grows in Importance Globally
– Samsung 4nm Chip Factory in Texas with Groq as 1st customer Projected for 2nd Half of 2024
The OrionX editorial team manages the content on this website.
– Linux Wars continue: Oracle, SUSE, and CIQ form Open Enterprise Linux Association
– China’s tech companies place $5 billion of orders on US chips
– Intel improves hardware for on-chip AVX (or APX) vector instructions
– 2023 Gordon Bell Prize Finalists also point to TOP500
The OrionX editorial team manages the content on this website.
– Domain Specific Architecture (DSA) – McKinsey Report
– Intel Expands in Oregon, its biggest site
– Photons are coming: PCIe over optical
– Oak Ridge QC Hat Trick: Singlet Fusion simulation of linear H4 molecule w Quantinuum
The OrionX editorial team manages the content on this website.
The Cambrian explosion of AI chips has made it hard to tell what chip is good for what. Venkat Vishwanath, Data Science Team Lead at the Argonne Leadership Computing Facility (ALCF), and a Gordon Bell finalist, joins us to discuss the ALCF AI Testbed. Currently working with systems such as Cerebras, Graphcore, SambaNova, Habana, Groq, Untether, Tenstorrent, Esperanto, and others, the Testbed evaluates accelerators from a usability and performance standpoint.
The OrionX editorial team manages the content on this website.
– AWS p5 instance with Nvidia H100 and AMD Milan
– TACC Stampede-3 mini Aurora plus Omni-Path
– Micron 8-high 24GB HBM3
– Cineca’s “White Space” building infrastructure
The OrionX editorial team manages the content on this website.
– Ultra Ethernet Consortium (UEC)
– Meta Microsoft Llama 2 Open Source AI
– NTT Tokyo Tech 300 GHz 6G
– 64-way Cerebras CG-1 system with G42 Group
– NREL grid optimization with quantum tech and Atom Computing
The OrionX editorial team manages the content on this website.
– SC23 registrations open
– Export control
– Linux wars continue
– Chiplet scale-out, or is it cloud?
– Quantum Computing calculates tackles the hydrogen molecule (H2), it’s a start
The OrionX editorial team manages the content on this website.
Dr. Joe Landman joins us to discuss how the open source OS community has found itself in the middle of the kind of Linux wars that can change the industry. The recent firestorm in the Linux world erupted when Red Hat changed the access mechanism and distribution rights of the Red Hat Enterprise Linux. We unpack what happened, who it affects, and how the landscape might change. Joe has been a business and technology leader, a hands-on engineer and architect, and a data analyst and researcher. A computational physicist by training he has was one of the early pioneers of custom and accelerated systems. Read his blog on this and other HPC software here.
The OrionX editorial team manages the content on this website.
New in the @HPCpodcast, a weekly news show, 3-5 min, on important industry news.
– LLNL El Capitan
– LLNL Director Kim Budil named as one of the Most Creative People in Business for 2023 by Fast Company
– Inflection AI’s 22k GPU system
– NYS DFS AI
– Intel & Nvidia collaborate on Confidential Computing
– Photonics News
– Linux Wars
The OrionX editorial team manages the content on this website.
Mark Himelstein, CTO of RISC-V joins us to discuss the latest developments with the RISC-V instruction set architecture (ISA) and its growing community and footprint. Topics include HPC type use cases from sensor to supercomputer, achieving customization without loss of compatibility, AI and its impact on chips and systems, and the question on everyone’s mind: when do we see RISC-V in servers and supercomputers!
You may also be interested in Shahin’s conversation with Mark in August 2020 and see how things have evolved.
The OrionX editorial team manages the content on this website.
What’s the latest in quantum computing? Special guest Bob Sorensen of Hyperion Research joins us again to discuss market growth, customer sentiment, recent advances in noise management, applications, and the geopolitics of quantum computing.
The OrionX editorial team manages the content on this website.
University of Delaware Professor Sunita Chandrasekaran joins us to discuss exascale software, directive based parallel programming, the emergence of research software engineering as a career, what AI will mean for the industry, and the importance of communication and community among teams.
This episode is sponsored by Lenovo.
The OrionX editorial team manages the content on this website.
A look back at ISC23 including quantum computing, EuroHPC, the future of Supercomputing with a backdrop of Integrated Research Infrastructure (IRI), AI, and Cloud, and whether we are living in times when “everybody” is a systems company.
This episode is sponsored by Lenovo.
The OrionX editorial team manages the content on this website.
Doug is in Hamburg, Germany for the ISC23 conference where the 61st edition of the TOP500 list has just been published. 30+ years of systematic data on the highest performing computer architecture and configurations is a treasure trove and we look at the top line insights from this installment, including the GREEN500, HPCG, and the AI-inspired mixed precision benchmark HPL-MxP.
This episode is sponsored by Lenovo.
The OrionX editorial team manages the content on this website.
This episode starts to look at HPC software and its convergence with traditional enterprise IT software. We cover the evolution of software through phases of IT, the roster of relevant HPC software from development environment to system administration, and end-user requirements, and traditional and emerging applications. Future episodes and guests will focus on various aspects of HPC software.
This episode is sponsored by Lenovo.
The OrionX editorial team manages the content on this website.
Liquid cooling in supercomputing came up in our last episode on decarbonization and environment, sustainability, and governance (ESG). We cover liquid cooling in this episode: everything from chilled doors to direct-to-chip, immersion cooling, vapor chambers, and even under-water data centers.
This episode is sponsored by Lenovo.
The OrionX editorial team manages the content on this website.
We caught up with Adrian Cockcroft again, this time to discuss the growing importance of, and the HPC market’s efforts towards, decarbonization, the use of renewable energy, and meeting environment, sustainability, and governance (ESG) objectives.
This episode is sponsored by Lenovo.
The OrionX editorial team manages the content on this website.
Tim Crawford, CIO Strategic Advisor and founder of research and advisory firm AVOA, joins us in a discussion of generative AI, data sources, emerging uses of AI in the enterprises, and the complexities of managing and regulating AI.
The OrionX editorial team manages the content on this website.
Post-Exascale Computing for the NNSA (National Nuclear Security Administration) is the subject of a new report by a distinguished working and review committes comprised of notable supercomputing experts. The report examines the trajectory of high-end supercomputing to date, future needs, emerging technologies, advances in scientific disciplines and computational methods, and the workforce, industry partnerships, and roadmap necessary for successful deployment. We bring you a summary of the report’s key findings and recommendations. @HPCpodcast is delighted that two of the panelists were guests of this show in recent months.
The OrionX editorial team manages the content on this website.
We discuss Silicon Photonics with Keren Bergman, the Charles Batchelor Professor of Electrical Engineering, Faculty Director of the Columbia Nano Initiative, and Principal Investigator of Lightwave Research Laboratory at Columbia University. Prof. Bergman is the recipient of the 2016 IEEE Photonics Engineering Award and is a Fellow of Optica (Optical Society of America) and IEEE.
The wide range of topics includes: Silicon Photonics vs. Fiber Optics used in telecommunications, the use of photonics c0mmunication vs. computation, what aspects of light are used to achieve efficiencies, packet switching vs circuit switching, current advances and speeds, economic considerations and likely first uses, supply chain, fabrication, assembly, and packaging technologies for photonics.
The OrionX editorial team manages the content on this website.
When soldiers are software engineers a new warfare emerges. Modern warfare is similar to, and needs, high tech product development with fast cycles and incremental improvement. The new Technopolitics section starts with the role of software engineers enlisted in the Ukrain war. Next is the House Committee on Science Space and Technology hearing on “US, China, and the Fight for Global Leadership: Building a U.S. National Science and Technology Strategy”. New and substantial funding (£800m) for the UK Exascale program promises to bring the UK into the exascale world by 2046. (This was subsequently complemented by another £2.5B for quantum technologies.) Under the HPC-AI section of the podcast, we discuss the recent changes to the Intel high-end GPU roadmap and lament the lost opportunity to communicate that better.
The OrionX editorial team manages the content on this website.
In what might become a regular segment, we cover important advances in tech that signal changes in markets and policies. This time, we discuss the iPhone moment in AI and the ensuing AI gold rush, virtual quantum computers, and how silicon photonics can change the chip industry.
The OrionX editorial team manages the content on this website.
In the The Messenger Lectures in 1964 at MIT, Richard Feynman said “On the other hand, I think I can safely say that nobody understands quantum mechanics. … Do not keep saying to yourself, if you can possibly avoid it, ‘But how can it be like that?’ because you will get ‘down the drain’, into a blind alley from which nobody has escaped. Nobody knows how it can be like that.”
Why is that? And can the teaching and understanding of Quantum Mechanics be simplified without loss of accuracy or mathematical rigor? For the answer, you have come to the right podcast!
Bob Coecke, co-author with Stefano Gogioso of the recently-released book Quantum in Pictures: A New Way to Understand the Quantum World joins us to discuss why quantum mechanics is so hard, the inspirations behind the book, and how he’s working to make quantum computing more accessible through his work.
Bob is Chief Scientist at Quantinuum, Distinguished Visiting Research Chair at the Perimeter Institute for Theoretical Physics, Emeritus Fellow at Wolfson College Oxford. For the previous two decades, he was Professor of Quantum Foundations, Logics and Structures at the Department of Computer Science at Oxford University, where he co-founded and led a multi-disciplinary Quantum Group that grew to 50 members and supervised close to 70 PhD students. He pioneered Categorical Quantum Mechanics, ZX-calculus, DisCoCat natural language meaning, mathematical foundations for resource theories, Quantum Natural Language Processing, and DisCoCirc natural language meaning. His work has been headlined by various media outlets, including Forbes, New Scientist, PhysicsWorld, ComputerWeekly. He’s also a musician and painter.
The OrionX editorial team manages the content on this website.