Skip to content
Machine Learning Daily, home

NVIDIA Vera CPU Reveals Linux Scheduler Vulnerabilities in Asymmetric SMT

Custom Arm silicon exposes critical gaps in Linux kernel task management, prompting upstream scheduler patches to stabilize AI workload performance.

DERRICKCOMPUTE & SILICON615 WORDS

NVIDIA’s entry into custom Arm server silicon via the Vera CPU has highlighted a significant friction point between modern hardware architecture and the Linux kernel’s task management logic. The Vera processor, which utilizes 88 Olympus cores and a proprietary spatial multithreading implementation, encountered a performance bottleneck where CPU-intensive workloads suffered a 2x throughput reduction due to misaligned scheduling decisions.

The root of the issue lies in how the Linux kernel interprets firmware-reported capacity data. When simultaneous multithreading is active, the Vera firmware exposes minor frequency variations—roughly plus or minus 5%—as distinct differences in CPU capacity. This triggers the kernel’s SD_ASYM_CPUCAPACITY scheduling domain, which is typically reserved for architectures with heterogeneous core types.

Andrea Righi, a Linux engineer at NVIDIA, identified that the existing idle selection policy failed to account for busy SMT siblings when these capacity variations were present. The scheduler frequently prioritized placing new tasks on partially occupied cores rather than fully idle ones, leading to resource contention. This behavior directly undermined the performance targets of the Olympus architecture, which relies on consistent latency for agentic AI workloads.

Engineers evaluated several potential workarounds, including firmware-level capacity normalization and ACPI/CPPC adjustments, before settling on a kernel-level solution. The chosen patch set introduces SMT awareness into the asymmetric capacity logic, effectively forcing the scheduler to prefer fully idle cores. This modification ensures that the kernel does not treat a partially utilized SMT sibling as a high-capacity target for incoming threads.

By late August 2026, subsequent patches further refined this behavior by introducing SD_ASYM_PACKING domain creation. These updates prioritize the primary execution unit, often designated as PE0, during task placement. Benchmarks conducted on an 88-thread GEMM workload demonstrated a throughput increase from approximately 9.4 TFLOP/s to 10.1 TFLOP/s, alongside a marked reduction in run-to-run performance variance.

The Olympus architecture itself features a 10-wide decode front-end and a neural branch predictor, which are designed to maximize throughput for agentic AI. Because the spatial multithreading implementation allows users to choose between maximum per-thread performance and higher thread counts at runtime, the scheduling logic must be exceptionally precise. When one thread idles, the sibling does not immediately reclaim all resources, creating a timing gap that the original scheduler failed to manage effectively.

The broader implications of these changes extend beyond the Vera platform, as noted by Righi in his technical documentation. As other server-grade Arm processors adopt SMT alongside asymmetric topologies, the need for a more nuanced scheduling approach becomes critical. The kernel’s historical reliance on big.LITTLE logic is proving insufficient for modern designs where frequency scaling and resource sharing create complex, dynamic capacity environments.

The technical community has observed these improvements through various channels, including Ubuntu bug reports and upstream Linux kernel commits. One specific report, identified as Launchpad Bug #2158811, documented a 23% throughput gain on an NVPL SGEMM workload after the scheduler patches were applied. These results underscore the necessity of deep software-hardware co-design in high-performance computing environments.

For data center operators, the stability of these patches is essential for the deployment of Vera Rubin NVL72 systems. The CPU acts as the primary orchestrator for GPU-heavy AI factories, meaning any bottleneck in task scheduling propagates to the entire NVLink-C2C fabric. Predictable execution is a prerequisite for the deterministic performance required by modern agentic AI models.

Future Linux kernel releases, specifically the 7.3 and 7.4 merge windows, are expected to incorporate additional refinements to these SMT-aware scheduling policies. NVIDIA continues to upstream its platform software, including compiler support for Olympus scheduling models in LLVM 22. The ongoing evolution of these patches suggests that the industry is moving toward a more sophisticated understanding of how hardware-level spatial partitioning interacts with operating system task management.

REFERENCED

  1. lkml.rescloud.iu.eduSD_ASYM_CPUCAPACITY scheduling domain
  2. patchew.orgAndrea Righi
  3. developer.nvidia.comneural branch predictor
  4. nvidia.comVera Rubin NVL72 systems
  5. thesoftwarefrontier.comLLVM 22

FILED TO COMPUTE & SILICON

MORE IN COMPUTE & SILICON

ALL

THE DISPATCH

Applied machine learning, filed daily.

Model releases, silicon, clinical deployment, and the policy shaping them. No digest padding.