A Multi-GPU-Accelerated Sharp-Interface Immersed-Boundary Solver for Extreme-Scale Flow Simulation with Moving Boundary
Speaker: Sushrut Kumar, Johns Hopkins University
Presentation
Seminar Slide Deck (PDF-6.1MB)
Abstract
Direct numerical simulation of flows with moving and deforming boundaries remains one of the most computationally demanding problems in CFD, and the irregular data structures, dynamic sparsity, and time-varying operators inherent to immersed boundary methods have historically made them resistant to efficient GPU acceleration. In this talk, I will describe the development of a fully GPU-resident, multi-GPU version of the sharp-interface immersed boundary solver ViCar3D and the algorithmic innovations that make extreme-scale fluid–structure interaction (FSI) simulations practical. The solver couples a hybrid OpenACC/CUDA programming model with GPU-optimized geometric kernels, a matrix decomposition to isolate the dynamically evolving immersed-boundary operators, an asynchronous dual-stream sparse linear solver, and a sparse communication layer built on GPU-aware MPI, NCCL, and NVSHMEM. I will present verification and performance results demonstrating speedups exceeding 20× relative to CPU implementations, along with weak scaling up to 12 billion grid points on the NVIDIA GB200 NVL72 platform. Finally, I will show how this capability enables high-Reynolds-number simulations of moving-boundary and FSI problems at previously impractical resolutions, with applications ranging from biological and bioinspired locomotion to incompressible aerodynamics.
Biography