Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Reiterate3680
/
MN-12B-Lyra-v1-GGUF

Text Generation
GGUF
English
imatrix
Model card Files Files and versions
xet
Community
MN-12B-Lyra-v1-GGUF
85.6 GB
  • 1 contributor
History: 14 commits
Reiterate3680's picture
Reiterate3680
Upload imatrix.dat
cb58fca verified over 1 year ago
  • .gitattributes
    2.51 kB
    Upload imatrix.dat over 1 year ago
  • MN-12B-Lyra-v1-IQ2_M-imat.gguf
    4.44 GB
    xet
    Upload 3 files over 1 year ago
  • MN-12B-Lyra-v1-IQ3_M-imat.gguf
    5.72 GB
    xet
    Upload 3 files over 1 year ago
  • MN-12B-Lyra-v1-IQ4_XS-imat.gguf
    6.74 GB
    xet
    Upload 3 files over 1 year ago
  • MN-12B-Lyra-v1-Q2_K_S-imat.gguf
    4.49 GB
    xet
    Rename MN-12B-Lyra-v1-Q2_K_M-imat.gguf to MN-12B-Lyra-v1-Q2_K_S-imat.gguf over 1 year ago
  • MN-12B-Lyra-v1-Q3_K_L-imat.gguf
    6.56 GB
    xet
    Upload 2 files over 1 year ago
  • MN-12B-Lyra-v1-Q4_K_L-imat.gguf
    7.98 GB
    xet
    Upload 2 files over 1 year ago
  • MN-12B-Lyra-v1-Q4_K_M-imat.gguf
    7.48 GB
    xet
    Rename MN-12B-Lyra-v1-Q4_K_L-imat.gguf to MN-12B-Lyra-v1-Q4_K_M-imat.gguf over 1 year ago
  • MN-12B-Lyra-v1-Q5_K_M-imat.gguf
    8.73 GB
    xet
    Rename MN-12B-Lyra-v1-Q5_K_L-imat.gguf to MN-12B-Lyra-v1-Q5_K_M-imat.gguf over 1 year ago
  • MN-12B-Lyra-v1-Q6_K-imat.gguf
    10.1 GB
    xet
    Rename MN-12B-Lyra-v1-Q6_K_L-imat.gguf to MN-12B-Lyra-v1-Q6_K-imat.gguf over 1 year ago
  • MN-12B-Lyra-v1-Q6_K_L-imat.gguf
    10.4 GB
    xet
    Upload 2 files over 1 year ago
  • MN-12B-Lyra-v1-Q8_0-imat.gguf
    13 GB
    xet
    Upload 2 files over 1 year ago
  • README.md
    391 Bytes
    Create README.md over 1 year ago
  • imatrix.dat
    7.05 MB
    xet
    Upload imatrix.dat over 1 year ago