Anyone have any experience setting up and using torch to run a LLM from c++ code? Was hoping someone knew how to do this, and could give me a quick rundown on how to set this up?
Anyone have any experience setting up and using torch to run a LLM from c++ code? Was hoping someone knew how to do this, and could give me a quick rundown on how to set this up?