Expand description
Traced reverse- and forward-mode AD on the semantic program of a trace context.
A differentiated output is snapshotted out of its
TraceContext, the
program-level transform runs on that snapshot, and the derivative program is
imported back into the same context, so gradients compose with further traced
operations and with higher-order transforms.