Close

See How Your Peers Are Moving Forward in the Cloud

New research from CDW can help you build on your success and take the next step.

Nov 21 2024
Artificial Intelligence

Universities Invest in High Performance Computing to Support AI Education

Artificial intelligence supercomputers give students access to emerging technologies.

As a top research university, the Georgia Institute of Technology invests in high-performance computing (HPC) systems to ensure researchers have the computing resources they need to innovate and make discoveries. But when the university recently launched a new supercomputer, it was for a different set of users. It was built for classroom instruction and for students to learn about artificial intelligence (AI).

The university’s College of Engineering built the supercomputer, called the AI Makerspace, for its own students but also for the university’s five other colleges, including business, design and computing, says Matthieu Bloch, a professor and associate dean for academic affairs at Georgia Tech’s College of Engineering.

The goal is to democratize access to HPC resources and provide students with hands-on AI experience to help them develop expertise for their careers.

Click the banner to learn how artificial intelligence can improve the student experience.

 

“The AI Makerspace is open to any instructor on campus. We’re definitely targeting a broad audience,” Bloch says. “We have this amazing infrastructure that enables all sorts of AI applications at scale, and it will allow students to do things that only somebody in a research center could do.”

Because of AI’s emergence, an increasing number of universities and colleges are designing AI into their curriculum to prepare students for the workforce and meet the booming demand for employees with AI skills.

“Universities are looking at the marketplace as it’s evolving and saying, ‘We do need to equip our students with AI expertise so they can succeed in the business world,’” says Bradley Shimmin, chief analyst for AI and data analytics at Omdia.

To provide the training, whether it’s within a degree program or in research, higher education institutions must have the proper hardware and software in place. Increasingly, colleges and universities are partnering with vendors to offer dedicated HPC systems to support AI education.

But it’s not just technology skills. Higher education is also teaching students about responsible AI and making sure AI is trustworthy and safe, Shimmin says.

Georgia Tech’s AI Makerspace Offers an Accessible Environment

Georgia Tech’s AI Makerspace, built in partnership with NVIDIA, is powered by 20 NVIDIA HGX servers, featuring a total of 160 NVIDIA H100 GPUs and 1,280 Intel CPU cores.

The Atlanta-based university uses NVIDIA networking to connect the compute cluster together and has installed NVIDIA AI Enterprise software, a suite of AI tools, frameworks and pretrained models that makes it easier for users to develop and deploy AI workloads.

The College of Engineering went live with the HPC system in April, piloting it in two undergraduate courses led by Ghassan AlRegib, a professor in the School of Electrical and Computer Engineering: a machine learning (ML) class and a Foundations of AI class open to all second-year students. In that class, one assignment is to build an AI application that can tell users their location on campus from a photograph of their surroundings, Bloch says.

“The goal with that class is to make AI accessible — and to some extent, understandable — to students who do not have a specialized computer science background,” he says.

This school year, about 10 courses will make use of the AI Makerspace, including College of Computing classes. The university is also encouraging faculty in Georgia Tech’s other colleges to take advantage of the supercomputer.

Previously, faculty in about 60 courses universitywide have provided students access to an existing on-campus HPC system. However, using the AI supercomputer requires more technical expertise, says Eric Coulter, research computing facilitation lead with Georgia Tech’s Partnership of Advanced Computing Environment (PACE), which manages the AI Makerspace and provides HPC technical support.

To simplify use, the College of Engineering is developing interfaces and software packages, including some automation tools, to make it more user-friendly, Bloch says. “We want to lower the bar of entry by making it easier to deploy resources.”

Security is baked into the system. PACE uses access control policies and the university’s centralized authentication system to ensure that only authorized users log in to the supercomputer, Coulter says. PACE also uses several dashboards to monitor logs, node performance and network load and troubleshoots problems when they arise.

RELATED: Are your AI chatbots giving away more information than they should?

The university will ramp up usage of the AI Makerspace over time.

In the future, university seniors will be able to use the HPC system for their capstone projects, while students in the university’s CREATE-X entrepreneur program will be allowed to use it for early stage prototyping, Bloch says.

“We learn a few things every time we ask students to use it, be it from the technical side or the instructional side. We want to present projects to students in a way that’s doable and not daunting,” he says.

UAlbany’s AI Plus Initiative Brings Machine Learning to Academia

Two years ago, the University at Albany launched its AI Plus initiative, a campuswide effort to integrate AI education throughout its academic and research programs. And now, the university has new HPC systems to power research and students’ studies using AI.

First, in August 2023, NVIDIA partnered with the university and made its DGX Cloud AI supercomputing service available to the campus community. This September, the university launched an on-premises, NVIDIA-powered AI supercomputer that provides the latest state-of-the-art technology to researchers and faculty who incorporate AI into their curriculum.

“We’re planning for research and academic coursework — large jobs and small jobs,” says UAlbany CIO Brian Heaton. “Whether faculty is experienced with AI or they’re just introducing it into their curriculum, we’re making the right systems available and providing the right kind of support to help them navigate those systems.”

58%

The percentage of university students who do not feel they have sufficient knowledge and skills regarding artificial intelligence

Source: Digital Education Council, Digital Education Council Global AI Student Survey 2024, August 2024

UAlbany’s new in-house AI supercomputer features 24 NVIDIA DGX A100 servers and more than 5 petabytes of NetApp storage. It was paid for in part by $75 million that New York state gave the university for its AI initiatives.

The installation includes laying more than a mile of fiber within the data center to connect the racks of NVIDIA hardware and installing high-speed networking equipment between the data center at the uptown campus and the newly renovated College of Nanotechnology, Science and Engineering building at the downtown campus, Heaton says. The university also plans to increase power capacity at its data center in the future.

In addition to the NVIDIA systems, IBM this year has also provided UAlbany an experimental HPC system for research that runs on IBM’s prototype Artificial Intelligence Unit chips.

UAlbany isn’t just investing in technology. The university is hiring 27 faculty members to teach AI skills. The university offers foundational AI classes, such as AI ethics, but also discipline-specific courses, says Thenkurussi “Kesh” Kesavadas, UAlbany’s vice president for research and economic development.

“There is no field that AI doesn’t touch, so the goal is to make AI intertwined with everything we do,” he says. “It’s important for students to learn the good and bad of AI. But we also wanted to make sure we have the capacity to do big things with AI, and that’s why we’ve made the investment in the computing space.”

The IT department also has hired new IT staff to manage the HPC systems and provide technical support for users of the on-premises and cloud-based HPC systems, Heaton says.

Overall, Kesavadas says, the new HPC systems eliminates the hardware constraints the campus faced with AI/ML projects in the past. Now, faculty and students can train and run ML models and complete tasks much faster.

“With this new infrastructure, we now have a platform where university faculty members can do everything they are interested in,” he says.

UP NEXT: Prepare higher ed networks for the AI future with a next generation assessment.

Photography by Ben Rollins