Access to metadata of the underlying model #953
              
                Unanswered
              
          
                  
                    
                      shadowfaxproject
                    
                  
                
                  asked this question in
                Q&A
              
            Replies: 1 comment 1 reply
-
| 
         I'd be interested to know if this is possible as well. That way, we can have a program that changes our preset prompt formats based on the type of model, since some models use whereas others use [INST].  | 
  
Beta Was this translation helpful? Give feedback.
                  
                    1 reply
                  
                
            
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
Uh oh!
There was an error while loading. Please reload this page.
-
Is there a way to access (print) metadata such as
general.nameormodel typefrom the python code when using llama-cpp-python. I am able to access the standard params provided by the user but not the core metadata of the model.Beta Was this translation helpful? Give feedback.
All reactions