the.bay.news

Torch.compile dependancy on system architecture / environment

PyTorch Forums
Torch.compile dependancy on system architecture / environment
TLDR: Does the PyTorch-TensorRT compiler depend on the (a) underlying system architecture and/or (b) available system resources? More details: I want to evaluate the performance of a compiled PyTorch model, for the TensorRT framework on the Jetson Orin Nano in Jetpack 6.2. A minimal working example is avaliable in the README.md for pytorch/TensorRT: import torch import torch_tensorrt model = MyModel().eval().cuda() # define your model here x = torch.randn((1, 3, 224, 224)).cuda() # define w...

TLDR: Does the PyTorch-TensorRT compiler depend on the (a) underlying system architecture and/or (b) available system resources? More details: I want to evaluate the performance…

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.