Discussion about this post

User's avatar
Daniel Popescu / ⧉ Pluralisk's avatar

Regarding the Nvidia DGX Spark, it's intriguing how the RTX 5070-equivalent GPU, with its vast memory, handles 200 billion paramter models. Is it mainly optimised for local inference, or does it also offer practical capacity for effective fine-tuning and training? This has major implications for local AI devellopment.

Expand full comment

No posts

Ready for more?