Can an 8 GB Edge Device Run a 2 GB Model? Budget Memory at Peak Concurrency
DEV Community
Can an 8 GB Edge Device Run a 2 GB Model? Budget Memory at Peak Concurrency
Eight gigabytes of RAM minus a 2 GB model file is not 6 GB of usable inference memory. Calculate the...
0 comments
No comments yet.