What is a device graph?
A device graph describes a sequence of accelerator operations and dependencies that can be prepared and replayed with less repeated host-side launch work. CUDA and HIP provide graph APIs for this pattern.
Answered in
Compiler-Built Device Graphs Target the Cost of Recording GPU WorkModular says compiling a known execution graph can avoid runtime capture overhead. Here is what its claim means, where graph replay helps, and what to measure.
Read the full analysisOther questions this article answers
More ai infrastructure questions
- Does compiler-built graph synthesis guarantee 40 percent faster inference?
- When should a team consider graph replay?
- What is TLX?
- Why did Meta build TLX instead of writing all kernels in CUDA?
- Are TLX's performance figures independent benchmarks?
- Why did OpenAI choose Apache Flink over traditional batch compute for AI research data?
- How did OpenAI bridge the gap between Python AI researchers and Java-first Flink?
- How does the stream processing platform survive a complete cloud outage?
Every answer on Crashtech is written by the editor of the article it comes from — never auto-summarised. Browse all answers or the Ai Infrastructure beat.