This quants are specific for the DS4 inference engine. They may work with other inference engines or not (they should, but not the MTP model which requires a specific loader).
1.4M487上下文 4K2GB
chageyun.aiDetail.tabOverview
下载
文件
chageyun.aiDetail.tabRankings
评论评分
相关文章
用途
text-generation→
chageyun.aiDetail.sectionCapabilities
chat
chageyun.aiDetail.sectionSpecs
chageyun.ai.deploymentPlatform
huggingface
chageyun.ai.hardwareType
nvidiaamdintelapple_mcpu
chageyun.ai.quantization
fp16bf16gguf
API 站点比价
收录该模型的 AI API 站点定价(每 1M tokens),每组取前 5 家;「最低价」按输入价升序,「评分最高」按站点评分降序;不做汇率换算。