*** Welcome to KoboldCpp - Version 1.124.2 Loading Chat Completions Adapter: C:\Users\\AppData\Local\Temp\_MEI12962\kcpp_adapters\AutoGuess.json Chat Completions Adapter Loaded No GPU or CPU backend was selected. Trying to assign one for you automatically... Unable to detect VRAM. Auto Selected Default Backend (flag=0) Unable to detect VRAM. No GPU backend found, or could not automatically determine GPU layers. You may prefer to set layers manually. System: Windows 10.0.20348 AMD64 AMD64 Family 25 Model 17 Stepping 1, AuthenticAMD Unable to determine GPU Memory Detected Available RAM: 13790 MB Initializing dynamic library: koboldcpp_default.dll Loaded shared common library: koboldcpp_common.dll ========== Namespace(admin=False, admindir='', adminpassword= adminunloadtimeout=0, agent=False, agent_api_key= agent_base_url=None, agentload='', allow_config_onready=False, analyze='', autofit=False, autofitpadding=1024, autoswapmode=False, autoswapthreshold=256, baseconfig='', batchsize=512, benchmark=None, blasthreads=0, chatcompletionsadapter='AutoGuess', cli=False, config=None, contextsize=16384, debugmode=0, defaultgenamt=2048, device='', downloaddir='', draftamount=4, draftgpulayers=999, draftgpusplit=None, draftmodel='', embeddingsgpu=False, embeddingsmaxctx=4096, embeddingsmodel='', enableguidance=False, exportconfig='', exporttemplate='', failsafe=False, ffncpu=0, flashattention=False, forceversion=False, foreground=False, gendefaults='', gendefaultsoverwrite=False, genlimit=0, gpulayers=0, highpriority=False, hordeconfig=None, hordegenlen=0, hordekey='', hordemaxctx=0, hordemodelname='', hordeworkername='', host='', ignoremissing=False, jinja=False, jinja_kwargs='', jinjatemplate='', jinjathink='default', launch=False, lazy_mode='auto', lora=None, loramult=1.0, lowvram=False, maingpu=-1, maxrequestsize=32, mcpfile='', mmproj='', mmprojcpu=False, model=['results\\ci-2\\windows-2022-nocuda\\_files\\truncated.gguf'], model_param='results\\ci-2\\windows-2022-nocuda\\_files\\truncated.gguf', moe_cache_mib=0, moecpu=0, moeexperts=-1, multiplayer=False, multiuser=None, musicdiffusion='', musicembeddings='', musicllm='', musiclowvram=False, musicvae='', noavx2=False, noblas=False, nobostoken= nocertify=False, nofastforward=False, noflashattention=False, nommap=False, nommq=False, nomodel=False, nopipelineparallel=False, noshift=False, noswa=False, onready='', overridekv='', overridenativecontext=0, overridetensors='', parallelrequests=1, paralleltotalcontext=0, password= pipelineparallel=False, port=63154, port_param=63154, preloadstory='', prompt='', proxy_port=None, quantkv='f16', queuelimit=10, quiet=False, ratelimit=0, reasoningeffort='default', remotetunnel=False, reqtimeout=600, ropeconfig=[0.0, 10000.0], routermode=False, rpccache='', rpcdevice='', rpchost='0.0.0.0', rpcmode='disabled', rpcport=5551, rpctargets='', run_bundled_agent=False, savedatafile='', sdaudiovae='', sdclamped=0, sdclampedsoft=0, sdclip1='', sdclip2='', sdclipdevice=-2, sdclipgpu=False, sdconfig=None, sdconvdirect='off', sdflashattention=False, sdgendefaults=False, sdllm='', sdlora=[], sdloramult=[1.0], sdmaingpu=None, sdmodel='', sdnotile=False, sdoffloadcpu=False, sdphotomaker='', sdquant=0, sdt5xxl=None, sdthreads=0, sdtiledvae=512, sdupscaler='', sdvae='', sdvaeauto=False, sdvaecpu=False, sdvaedevice=-1, sdvramlimit=0, showgui=False, singleinstance=False, skiplauncher=True, smartcache=0, smartcontext=False, splitmode='layer', ssl=None, swapadding=0, tensor_split=None, testmemory=False, threads=2, ttsdir='', ttsgpu=False, ttsmaxlen=4096, ttsmodel='', ttsthreads=0, ttswavtokenizer='', ubatchsize=-1, unpack='', usecpu=False, usecuda=None, usedirectio=False, usemlock=False, usemmap=False, usemtp=False, useswa=False, usevulkan=None, version=False, visionmaxres=1024, visionmaxtokens=-1, visionmintokens=-1, websearch=False, whispermodel='') ========== Loading Text Model: D:\a\test-KoboldCpp\test-KoboldCpp\results\ci-2\windows-2022-nocuda\_files\truncated.gguf llama_model_load: error loading model: tensor 'output.weight' data is not within the file bounds, model is corrupted or incomplete llama_model_load_from_file_impl: failed to load model Load Text Model OK: False Could not load text model: D:\a\test-KoboldCpp\test-KoboldCpp\results\ci-2\windows-2022-nocuda\_files\truncated.gguf The reported GGUF Arch is: qwen2 Arch Category: 24 --- Identified as GGUF model. Attempting to Load... --- Using automatic RoPE scaling for GGUF. If the model has custom RoPE settings, they'll be used directly instead! System Info: AVX = 1 | AVX_VNNI = 0 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | AMX_INT8 = 0 | FMA = 1 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | RISCV_VECT = 0 | WASM_SIMD = 0 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 | Number of Backends: 2 Backend 0: RPC Backend 1: CPU gpttype_load_model: error: failed to load model 'D:\a\test-KoboldCpp\test-KoboldCpp\results\ci-2\windows-2022-nocuda\_files\truncated.gguf'