Expand description
The owner-scoped raw session an extension crate runs its vendor calls in.
The session exposes exactly what a vendor library needs — the runtime’s stream, device addresses, and scratch — and nothing that would re-enter the runtime’s admission: transfers run on the runtime before the scope opens, because their admission is the lock the scope holds.
A caller’s tensor is safe to borrow for as long as the vendor work runs: dropping a buffer
releases it with cuMemFreeAsync on the same stream, so the free is ordered after any call the
session enqueued. retain_tensor therefore only proves the tensor belongs to this runtime.
Structs§
- Cuda
Resource Guard - A vendor resource lent from the engine’s extension caches for the session’s life.