Project 'jrwallace/swiftnlp' was moved to 'jrwallace/curio'. Please update any links and bookmarks that may still have the old path.
Add interface for using generic CoreML LLMs
Compare changes
Files
3@@ -39,9 +39,19 @@ public macro MODEL_VALIDATE_NAME_AND_SET_INPUT_SIZE() = #externalMacro(
@@ -39,9 +39,19 @@ public macro MODEL_VALIDATE_NAME_AND_SET_INPUT_SIZE() = #externalMacro(
let tokenization = LLMEmbeddings(model_type: self.model).tokenizer.tokenizeToIds(text: token) as! [Scalar]