| Base score | 100 |
| LOW No license field in GGUF metadata (general.license) | -3 |
| LOW No embedded provenance metadata | -3 |
| Penalty subtotal | 94/100 |
| Final | A / 94 |
| Runtime | Status | Quant | Architecture | Context |
|---|---|---|---|---|
| llama.cpp | ✓ | ✓ | ✓ | 1k |
| Ollama | ✓ | ✓ | ✓ | 1k |
| LM Studio | ✓ | ✓ | ✓ | 1k |
| vLLM | ✗ | N/A | GGUF not supported — requires safetensors format | |
| HuggingFace Transformers | ✗ | N/A | GGUF not directly supported — use safetensors or PyTorch checkpoint | |
| Architecture Neural network family — determines which runtime can load this model | gpt2 |
| Name | Checkpoint Before Edit |
| Size label Human-readable parameter count from model metadata | 124M |
| Quantization Weight storage format derived from actual tensor dtypes; lower bits = smaller file and faster inference at the cost of accuracy |
F16 |
| Parameters ~ Estimated total number of weight values; determines VRAM needed at inference | 124,439,808 |
| Context length Maximum tokens the model can process in a single prompt+response; affects KV-cache memory | 1,024 tokens |
| Embedding dim Hidden state dimension (d_model); larger = more expressive but more compute per token | 768 |
| FFN dim Feed-forward network intermediate size; typically 2.7–4× embedding_length | 3,072 |
| Layers Number of transformer blocks (depth); more layers = more reasoning capacity | 12 |
| Attention heads (Q) Number of query heads; GQA/MQA models use fewer KV heads than Q heads | 12 |
| Vocab size Number of unique tokens the tokenizer knows; affects embedding table size | 50,257 |
| BOS / EOS tokens Beginning-of-sequence and end-of-sequence token IDs used by the tokenizer | 50256 / 50256 |
| Tokenizer Tokenizer algorithm family (e.g. gpt2 = BPE, llama = SentencePiece) | gpt2 |
| Chat template Jinja2 prompt template embedded in model; controls how messages are formatted for inference | ✗ No |
| Tensors Total number of weight tensors stored in the file | 148 |
| File size Size on disk in megabytes | 240.77 MB |
| SHA-256 | 1809955eb25d7667f2c2cd8adc269677866ff244467cd4c83da6d04074e67ec1 |
| SHA-512 | 0957398901f34b405eaacd0a9a640dc8171a264cd762c9869e180e3a9935caf46ef2c42c07727888… |
| File size (bytes) | 252,470,336 |
| Header + KV + tensor directory | 1,775,168 bytes (1.69 MB) |
| Tensor data region | 250,695,168 bytes (239.08 MB) |
| Trailing bytes | 0 |
| Unaccounted bytes | 0 ✓ |
| KV metadata keys | 20 |
| Tensors parsed | 148 |
| Offsets monotone | ✓ OK |
| Max tensor offset | 173,500,416 |
| DType | Count | Total bytes | Total MB | Avg bits/elem |
|---|---|---|---|---|
| F16 | 49 | 247,064,064 | 235.62 | 16.0 |
| F32 | 99 | 3,631,104 | 3.46 | 32.0 |
| # | Name | Dims | DType | Offset | Bytes | bits/elem |
|---|---|---|---|---|---|---|
| 0 | blk.0.attn_qkv.bias | [2304] | F32 | 0 | 9,216 | 32.0 |
| 1 | blk.0.attn_qkv.weight | [768, 2304] | F16 | 9,216 | 3,538,944 | 16.0 |
| 2 | blk.0.attn_output.bias | [768] | F32 | 3,548,160 | 3,072 | 32.0 |
| 3 | blk.0.attn_output.weight | [768, 768] | F16 | 3,551,232 | 1,179,648 | 16.0 |
| 4 | blk.0.attn_norm.bias | [768] | F32 | 4,730,880 | 3,072 | 32.0 |
| 5 | blk.0.attn_norm.weight | [768] | F32 | 4,733,952 | 3,072 | 32.0 |
| 6 | blk.0.ffn_norm.bias | [768] | F32 | 4,737,024 | 3,072 | 32.0 |
| 7 | blk.0.ffn_norm.weight | [768] | F32 | 4,740,096 | 3,072 | 32.0 |
| 8 | blk.0.ffn_up.bias | [3072] | F32 | 4,743,168 | 12,288 | 32.0 |
| 9 | blk.0.ffn_up.weight | [768, 3072] | F16 | 4,755,456 | 4,718,592 | 16.0 |
| 10 | blk.0.ffn_down.bias | [768] | F32 | 9,474,048 | 3,072 | 32.0 |
| 11 | blk.0.ffn_down.weight | [3072, 768] | F16 | 9,477,120 | 4,718,592 | 16.0 |
| 12 | blk.1.attn_qkv.bias | [2304] | F32 | 14,195,712 | 9,216 | 32.0 |
| 13 | blk.1.attn_qkv.weight | [768, 2304] | F16 | 14,204,928 | 3,538,944 | 16.0 |
| 14 | blk.1.attn_output.bias | [768] | F32 | 17,743,872 | 3,072 | 32.0 |
| 15 | blk.1.attn_output.weight | [768, 768] | F16 | 17,746,944 | 1,179,648 | 16.0 |
| 16 | blk.1.attn_norm.bias | [768] | F32 | 18,926,592 | 3,072 | 32.0 |
| 17 | blk.1.attn_norm.weight | [768] | F32 | 18,929,664 | 3,072 | 32.0 |
| 18 | blk.1.ffn_norm.bias | [768] | F32 | 18,932,736 | 3,072 | 32.0 |
| 19 | blk.1.ffn_norm.weight | [768] | F32 | 18,935,808 | 3,072 | 32.0 |
| 20 | blk.1.ffn_up.bias | [3072] | F32 | 18,938,880 | 12,288 | 32.0 |
| 21 | blk.1.ffn_up.weight | [768, 3072] | F16 | 18,951,168 | 4,718,592 | 16.0 |
| 22 | blk.1.ffn_down.bias | [768] | F32 | 23,669,760 | 3,072 | 32.0 |
| 23 | blk.1.ffn_down.weight | [3072, 768] | F16 | 23,672,832 | 4,718,592 | 16.0 |
| 24 | blk.10.attn_qkv.bias | [2304] | F32 | 28,391,424 | 9,216 | 32.0 |
| 25 | blk.10.attn_qkv.weight | [768, 2304] | F16 | 28,400,640 | 3,538,944 | 16.0 |
| 26 | blk.10.attn_output.bias | [768] | F32 | 31,939,584 | 3,072 | 32.0 |
| 27 | blk.10.attn_output.weight | [768, 768] | F16 | 31,942,656 | 1,179,648 | 16.0 |
| 28 | blk.10.attn_norm.bias | [768] | F32 | 33,122,304 | 3,072 | 32.0 |
| 29 | blk.10.attn_norm.weight | [768] | F32 | 33,125,376 | 3,072 | 32.0 |
| 30 | blk.10.ffn_norm.bias | [768] | F32 | 33,128,448 | 3,072 | 32.0 |
| 31 | blk.10.ffn_norm.weight | [768] | F32 | 33,131,520 | 3,072 | 32.0 |
| 32 | blk.10.ffn_up.bias | [3072] | F32 | 33,134,592 | 12,288 | 32.0 |
| 33 | blk.10.ffn_up.weight | [768, 3072] | F16 | 33,146,880 | 4,718,592 | 16.0 |
| 34 | blk.10.ffn_down.bias | [768] | F32 | 37,865,472 | 3,072 | 32.0 |
| 35 | blk.10.ffn_down.weight | [3072, 768] | F16 | 37,868,544 | 4,718,592 | 16.0 |
| 36 | blk.11.attn_qkv.bias | [2304] | F32 | 42,587,136 | 9,216 | 32.0 |
| 37 | blk.11.attn_qkv.weight | [768, 2304] | F16 | 42,596,352 | 3,538,944 | 16.0 |
| 38 | blk.11.attn_output.bias | [768] | F32 | 46,135,296 | 3,072 | 32.0 |
| 39 | blk.11.attn_output.weight | [768, 768] | F16 | 46,138,368 | 1,179,648 | 16.0 |
| 40 | blk.11.attn_norm.bias | [768] | F32 | 47,318,016 | 3,072 | 32.0 |
| 41 | blk.11.attn_norm.weight | [768] | F32 | 47,321,088 | 3,072 | 32.0 |
| 42 | blk.11.ffn_norm.bias | [768] | F32 | 47,324,160 | 3,072 | 32.0 |
| 43 | blk.11.ffn_norm.weight | [768] | F32 | 47,327,232 | 3,072 | 32.0 |
| 44 | blk.11.ffn_up.bias | [3072] | F32 | 47,330,304 | 12,288 | 32.0 |
| 45 | blk.11.ffn_up.weight | [768, 3072] | F16 | 47,342,592 | 4,718,592 | 16.0 |
| 46 | blk.11.ffn_down.bias | [768] | F32 | 52,061,184 | 3,072 | 32.0 |
| 47 | blk.11.ffn_down.weight | [3072, 768] | F16 | 52,064,256 | 4,718,592 | 16.0 |
| 48 | blk.2.attn_qkv.bias | [2304] | F32 | 56,782,848 | 9,216 | 32.0 |
| 49 | blk.2.attn_qkv.weight | [768, 2304] | F16 | 56,792,064 | 3,538,944 | 16.0 |
{
"compatibility": [
{
"arch": true,
"container": true,
"context": "1k",
"notes": "GGUF v3 container: supported | quant F16: supported",
"quant": true,
"runtime": "llama.cpp",
"supported": true
},
{
"arch": true,
"container": true,
"context": "1k",
"notes": "GGUF via llama.cpp backend: container and quantization supported",
"quant": true,
"runtime": "Ollama",
"supported": true
},
{
"arch": true,
"container": true,
"context": "1k",
"notes": "GGUF container and quantization supported; GPU/CPU inference",
"quant": true,
"runtime": "LM Studio",
"supported": true
},
{
"arch": null,
"container": false,
"context": null,
"not_supported_msg": "GGUF not supported \u2014 requires safetensors format",
"notes": "GGUF not supported; requires safetensors format",
"quant": false,
"runtime": "vLLM",
"supported": false
},
{
"arch": null,
"container": false,
"context": null,
"not_supported_msg": "GGUF not directly supported \u2014 use safetensors or PyTorch checkpoint",
"notes": "GGUF not supported; requires safetensors or PyTorch checkpoint",
"quant": false,
"runtime": "HuggingFace Transformers",
"supported": false
}
],
"format": "LLM-SCAN",
"format_version": "1.0",
"generator": {
"name": "llmscan-engine",
"version": "2.0.0"
},
"model": {
"alignment": 32,
"arch": "gpt2",
"architecture": "gpt2",
"basename": null,
"block_count": 12,
"bos_token_id": 50256,
"chat_template": null,
"context_length": 1024,
"dtype_histogram": {
"F16": 49,
"F32": 99
},
"dtype_percentage": {
"F16": 33.1,
"F32": 66.9
},
"dtype_stats": {
"F16": {
"avg_bits_per_elem": 16.0,
"bytes": 247064064,
"count": 49,
"mb": 235.62
},
"F32": {
"avg_bits_per_elem": 32.0,
"bytes": 3631104,
"count": 99,
"mb": 3.46
}
},
"embedding_length": 768,
"eos_token_id": 50256,
"feed_forward_length": 3072,
"file_size_bytes": 252470336,
"file_size_mb": 240.77,
"finetune": null,
"format": "gguf",
"gguf_version": 3,
"has_chat_template": false,
"head_count": 12,
"head_count_kv": null,
"header_kv_dir_bytes": 1775168,
"kv_count": 20,
"kv_meta": {
"keys": [
"general.architecture",
"general.file_type",
"general.name",
"general.quantization_version",
"general.size_label",
"general.type",
"gpt2.attention.head_count",
"gpt2.attention.layer_norm_epsilon",
"gpt2.block_count",
"gpt2.context_length",
"gpt2.embedding_length",
"gpt2.feed_forward_length",
"tokenizer.ggml.bos_token_id",
"tokenizer.ggml.eos_token_id",
"tokenizer.ggml.merges",
"tokenizer.ggml.model",
"tokenizer.ggml.pre",
"tokenizer.ggml.token_type",
"tokenizer.ggml.tokens",
"tokenizer.ggml.unknown_token_id"
],
"kv_count": 20,
"values_redacted": true
},
"license": null,
"max_tensor_offset": 173500416,
"misaligned_tensors": 0,
"model_name": "Checkpoint Before Edit",
"offsets_monotone": true,
"oob_tensor_count": 0,
"overlapping_tensor_pairs": 0,
"param_estimate": 124439808,
"params_estimate": 124439808,
"quantization": "F16",
"scanner_model_info": {
"alignment": 32,
"architecture": "gpt2",
"basename": null,
"block_count": 12,
"bos_token_id": 50256,
"chat_template": null,
"context_length": 1024,
"data_section_start": 1775168,
"dtype_histogram": {
"F16": 49,
"F32": 99
},
"dtype_percentage": {
"F16": 33.1,
"F32": 66.9
},
"dtype_stats": {
"F16": {
"avg_bits_per_elem": 16.0,
"bytes": 247064064,
"count": 49,
"mb": 235.62
},
"F32": {
"avg_bits_per_elem": 32.0,
"bytes": 3631104,
"count": 99,
"mb": 3.46
}
},
"embedding_length": 768,
"eos_token_id": 50256,
"feed_forward_length": 3072,
"file_size_bytes": 252470336,
"file_size_mb": 240.77,
"finetune": null,
"has_chat_template": false,
"head_count": 12,
"head_count_kv": null,
"header_end_offset": 1775153,
"header_kv_dir_bytes": 1775168,
"kv_count": 20,
"kv_keys": [
"general.architecture",
"general.file_type",
"general.name",
"general.quantization_version",
"general.size_label",
"general.type",
"gpt2.attention.head_count",
"gpt2.attention.layer_norm_epsilon",
"gpt2.block_count",
"gpt2.context_length",
"gpt2.embedding_length",
"gpt2.feed_forward_length",
"tokenizer.ggml.bos_token_id",
"tokenizer.ggml.eos_token_id",
"tokenizer.ggml.merges",
"tokenizer.ggml.model",
"tokenizer.ggml.pre",
"tokenizer.ggml.token_type",
"tokenizer.ggml.tokens",
"tokenizer.ggml.unknown_token_id"
],
"license": null,
"magic": "GGUF",
"max_tensor_offset": 173500416,
"misaligned_tensors": 0,
"model_name": "Checkpoint Before Edit",
"offsets_monotone": true,
"oob_tensor_count": 0,
"overlapping_tensor_pairs": 0,
"param_estimate": 124439808,
"quantization": "F16",
"sha256": "1809955eb25d7667f2c2cd8adc269677866ff244467cd4c83da6d04074e67ec1",
"sha512": "0957398901f34b405eaacd0a9a640dc8171a264cd762c9869e180e3a9935caf46ef2c42c07727888b333655f8641fefbc975f20742374a9b6de50a27b88b9ffd",
"size_label": "124M",
"tensor_bytes_sum": 250695168,
"tensor_count": 148,
"tensor_delta_bytes": 1775168,
"tensor_delta_mb": 1.69,
"tensor_preview": [
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 0,
"name": "blk.0.attn_qkv.bias",
"offset": 0
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 1,
"name": "blk.0.attn_qkv.weight",
"offset": 9216
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 2,
"name": "blk.0.attn_output.bias",
"offset": 3548160
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 3,
"name": "blk.0.attn_output.weight",
"offset": 3551232
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 4,
"name": "blk.0.attn_norm.bias",
"offset": 4730880
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 5,
"name": "blk.0.attn_norm.weight",
"offset": 4733952
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 6,
"name": "blk.0.ffn_norm.bias",
"offset": 4737024
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 7,
"name": "blk.0.ffn_norm.weight",
"offset": 4740096
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 8,
"name": "blk.0.ffn_up.bias",
"offset": 4743168
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 9,
"name": "blk.0.ffn_up.weight",
"offset": 4755456
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 10,
"name": "blk.0.ffn_down.bias",
"offset": 9474048
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 11,
"name": "blk.0.ffn_down.weight",
"offset": 9477120
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 12,
"name": "blk.1.attn_qkv.bias",
"offset": 14195712
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 13,
"name": "blk.1.attn_qkv.weight",
"offset": 14204928
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 14,
"name": "blk.1.attn_output.bias",
"offset": 17743872
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 15,
"name": "blk.1.attn_output.weight",
"offset": 17746944
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 16,
"name": "blk.1.attn_norm.bias",
"offset": 18926592
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 17,
"name": "blk.1.attn_norm.weight",
"offset": 18929664
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 18,
"name": "blk.1.ffn_norm.bias",
"offset": 18932736
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 19,
"name": "blk.1.ffn_norm.weight",
"offset": 18935808
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 20,
"name": "blk.1.ffn_up.bias",
"offset": 18938880
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 21,
"name": "blk.1.ffn_up.weight",
"offset": 18951168
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 22,
"name": "blk.1.ffn_down.bias",
"offset": 23669760
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 23,
"name": "blk.1.ffn_down.weight",
"offset": 23672832
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 24,
"name": "blk.10.attn_qkv.bias",
"offset": 28391424
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 25,
"name": "blk.10.attn_qkv.weight",
"offset": 28400640
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 26,
"name": "blk.10.attn_output.bias",
"offset": 31939584
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 27,
"name": "blk.10.attn_output.weight",
"offset": 31942656
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 28,
"name": "blk.10.attn_norm.bias",
"offset": 33122304
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 29,
"name": "blk.10.attn_norm.weight",
"offset": 33125376
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 30,
"name": "blk.10.ffn_norm.bias",
"offset": 33128448
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 31,
"name": "blk.10.ffn_norm.weight",
"offset": 33131520
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 32,
"name": "blk.10.ffn_up.bias",
"offset": 33134592
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 33,
"name": "blk.10.ffn_up.weight",
"offset": 33146880
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 34,
"name": "blk.10.ffn_down.bias",
"offset": 37865472
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 35,
"name": "blk.10.ffn_down.weight",
"offset": 37868544
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 36,
"name": "blk.11.attn_qkv.bias",
"offset": 42587136
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 37,
"name": "blk.11.attn_qkv.weight",
"offset": 42596352
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 38,
"name": "blk.11.attn_output.bias",
"offset": 46135296
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 39,
"name": "blk.11.attn_output.weight",
"offset": 46138368
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 40,
"name": "blk.11.attn_norm.bias",
"offset": 47318016
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 41,
"name": "blk.11.attn_norm.weight",
"offset": 47321088
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 42,
"name": "blk.11.ffn_norm.bias",
"offset": 47324160
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 43,
"name": "blk.11.ffn_norm.weight",
"offset": 47327232
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 44,
"name": "blk.11.ffn_up.bias",
"offset": 47330304
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 45,
"name": "blk.11.ffn_up.weight",
"offset": 47342592
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 46,
"name": "blk.11.ffn_down.bias",
"offset": 52061184
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 47,
"name": "blk.11.ffn_down.weight",
"offset": 52064256
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 48,
"name": "blk.2.attn_qkv.bias",
"offset": 56782848
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 49,
"name": "blk.2.attn_qkv.weight",
"offset": 56792064
}
],
"tokenizer_model": "gpt2",
"top_tensors_by_size": [
{
"byte_len": 77194752,
"dims": [
768,
50257
],
"dtype": "F16",
"n_elem": 38597376,
"name": "token_embd.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.0.ffn_up.weight"
},
{
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.0.ffn_down.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.1.ffn_up.weight"
},
{
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.1.ffn_down.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.10.ffn_up.weight"
},
{
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.10.ffn_down.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.11.ffn_up.weight"
},
{
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.11.ffn_down.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.2.ffn_up.weight"
}
],
"trailing_bytes": 0,
"unaccounted_bytes": 0,
"version": 3,
"vocab_size": 50257
},
"sha256": "1809955eb25d7667f2c2cd8adc269677866ff244467cd4c83da6d04074e67ec1",
"sha512": "0957398901f34b405eaacd0a9a640dc8171a264cd762c9869e180e3a9935caf46ef2c42c07727888b333655f8641fefbc975f20742374a9b6de50a27b88b9ffd",
"size_label": "124M",
"tensor_bytes_sum": 250695168,
"tensor_count": 148,
"tensor_delta_bytes": 1775168,
"tensor_delta_mb": 1.69,
"tensor_preview": [
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 0,
"name": "blk.0.attn_qkv.bias",
"offset": 0
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 1,
"name": "blk.0.attn_qkv.weight",
"offset": 9216
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 2,
"name": "blk.0.attn_output.bias",
"offset": 3548160
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 3,
"name": "blk.0.attn_output.weight",
"offset": 3551232
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 4,
"name": "blk.0.attn_norm.bias",
"offset": 4730880
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 5,
"name": "blk.0.attn_norm.weight",
"offset": 4733952
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 6,
"name": "blk.0.ffn_norm.bias",
"offset": 4737024
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 7,
"name": "blk.0.ffn_norm.weight",
"offset": 4740096
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 8,
"name": "blk.0.ffn_up.bias",
"offset": 4743168
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 9,
"name": "blk.0.ffn_up.weight",
"offset": 4755456
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 10,
"name": "blk.0.ffn_down.bias",
"offset": 9474048
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 11,
"name": "blk.0.ffn_down.weight",
"offset": 9477120
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 12,
"name": "blk.1.attn_qkv.bias",
"offset": 14195712
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 13,
"name": "blk.1.attn_qkv.weight",
"offset": 14204928
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 14,
"name": "blk.1.attn_output.bias",
"offset": 17743872
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 15,
"name": "blk.1.attn_output.weight",
"offset": 17746944
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 16,
"name": "blk.1.attn_norm.bias",
"offset": 18926592
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 17,
"name": "blk.1.attn_norm.weight",
"offset": 18929664
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 18,
"name": "blk.1.ffn_norm.bias",
"offset": 18932736
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 19,
"name": "blk.1.ffn_norm.weight",
"offset": 18935808
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 20,
"name": "blk.1.ffn_up.bias",
"offset": 18938880
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 21,
"name": "blk.1.ffn_up.weight",
"offset": 18951168
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 22,
"name": "blk.1.ffn_down.bias",
"offset": 23669760
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 23,
"name": "blk.1.ffn_down.weight",
"offset": 23672832
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 24,
"name": "blk.10.attn_qkv.bias",
"offset": 28391424
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 25,
"name": "blk.10.attn_qkv.weight",
"offset": 28400640
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 26,
"name": "blk.10.attn_output.bias",
"offset": 31939584
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 27,
"name": "blk.10.attn_output.weight",
"offset": 31942656
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 28,
"name": "blk.10.attn_norm.bias",
"offset": 33122304
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 29,
"name": "blk.10.attn_norm.weight",
"offset": 33125376
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 30,
"name": "blk.10.ffn_norm.bias",
"offset": 33128448
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 31,
"name": "blk.10.ffn_norm.weight",
"offset": 33131520
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 32,
"name": "blk.10.ffn_up.bias",
"offset": 33134592
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 33,
"name": "blk.10.ffn_up.weight",
"offset": 33146880
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 34,
"name": "blk.10.ffn_down.bias",
"offset": 37865472
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 35,
"name": "blk.10.ffn_down.weight",
"offset": 37868544
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 36,
"name": "blk.11.attn_qkv.bias",
"offset": 42587136
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 37,
"name": "blk.11.attn_qkv.weight",
"offset": 42596352
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 38,
"name": "blk.11.attn_output.bias",
"offset": 46135296
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 39,
"name": "blk.11.attn_output.weight",
"offset": 46138368
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 40,
"name": "blk.11.attn_norm.bias",
"offset": 47318016
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 41,
"name": "blk.11.attn_norm.weight",
"offset": 47321088
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 42,
"name": "blk.11.ffn_norm.bias",
"offset": 47324160
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 43,
"name": "blk.11.ffn_norm.weight",
"offset": 47327232
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 44,
"name": "blk.11.ffn_up.bias",
"offset": 47330304
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 45,
"name": "blk.11.ffn_up.weight",
"offset": 47342592
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 46,
"name": "blk.11.ffn_down.bias",
"offset": 52061184
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 47,
"name": "blk.11.ffn_down.weight",
"offset": 52064256
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 48,
"name": "blk.2.attn_qkv.bias",
"offset": 56782848
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 49,
"name": "blk.2.attn_qkv.weight",
"offset": 56792064
}
],
"tokenizer_model": "gpt2",
"top_tensors_by_size": [
{
"byte_len": 77194752,
"dims": [
768,
50257
],
"dtype": "F16",
"n_elem": 38597376,
"name": "token_embd.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.0.ffn_up.weight"
},
{
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.0.ffn_down.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.1.ffn_up.weight"
},
{
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.1.ffn_down.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.10.ffn_up.weight"
},
{
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.10.ffn_down.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.11.ffn_up.weight"
},
{
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.11.ffn_down.weight"
},
{
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype": "F16",
"n_elem": 2359296,
"name": "blk.2.ffn_up.weight"
}
],
"trailing_bytes": 0,
"unaccounted_bytes": 0,
"values_redacted": true,
"vocab_size": 50257
},
"report": {
"bullets": [
"GGUF v3 model | architecture: gpt2 | size: 124M | quantization: F16 | 148 tensors | 2 warnings / 1 informational",
"Size: 240.77 MB",
"SHA256: 1809955eb25d7667..."
],
"recommendations": [
"Add general.license to model metadata before distributing; use an SPDX identifier",
"Add at least one of: general.author, general.source.huggingface.repository, or general.source.url"
],
"summary": "GGUF v3 model | architecture: gpt2 | size: 124M | quantization: F16 | 148 tensors | 2 warnings / 1 informational"
},
"scan_context": {
"duration_ms": 904,
"ended_at": "2026-07-22T21:05:13+00:00Z",
"limits": {
"sandbox": true,
"timeout_ms": 60000
},
"mode": "static-deep",
"started_at": "2026-07-22T21:05:13+00:00Z"
},
"security": {
"findings": [
{
"category": "Supply Chain",
"detail": "Absence of license information makes it impossible to determine usage rights",
"recommendation": "Add general.license to model metadata before distributing; use an SPDX identifier",
"severity": "LOW",
"title": "No license field in GGUF metadata (general.license)"
},
{
"category": "Supply Chain",
"detail": "None of general.author, general.source.url, general.base_model.0, or general.source.huggingface.repository are embedded in the GGUF file. Without any origin signal the model cannot be traced to a trusted source or compared against a reference checkpoint for tampering detection. For files uploaded directly, provenance is especially critical because the scanner cannot infer repository origin from the file alone.",
"recommendation": "Add at least one of: general.author, general.source.huggingface.repository, or general.source.url",
"severity": "LOW",
"title": "No embedded provenance metadata"
},
{
"category": "Embedding Size",
"detail": "vocab=50,257 x emb_dim=768 x 2.0 B/elem -\u003e expected 77,194,752 B \u2014 size is consistent with architecture",
"recommendation": "No action needed; large embeddings are expected for large-vocabulary models",
"severity": "INFO",
"title": "Large embedding tensor \u0027token_embd.weight\u0027: 77,194,752 bytes"
}
],
"grade": "A",
"score": 94
},
"source": {
"filename": "john-before.gguf",
"hashes": {
"sha256": "1809955eb25d7667f2c2cd8adc269677866ff244467cd4c83da6d04074e67ec1"
},
"input_type": "file",
"size_bytes": 252470336
},
"tensors": {
"count": 148,
"dtype_histogram": {
"F16": 49,
"F32": 99
},
"dtype_stats": {
"F16": {
"avg_bits_per_elem": 16.0,
"bytes": 247064064,
"count": 49,
"mb": 235.62
},
"F32": {
"avg_bits_per_elem": 32.0,
"bytes": 3631104,
"count": 99,
"mb": 3.46
}
},
"integrity": {
"header_kv_dir_bytes": 1775168,
"misaligned_tensors": 0,
"offsets_monotone": true,
"oob_tensor_count": 0,
"overlapping_tensor_pairs": 0,
"tensor_bytes_sum": 250695168,
"tensor_delta_bytes": 1775168,
"tensor_delta_mb": 1.69,
"trailing_bytes": 0,
"unaccounted_bytes": 0
},
"preview": [
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 0,
"name": "blk.0.attn_qkv.bias",
"offset": 0
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 1,
"name": "blk.0.attn_qkv.weight",
"offset": 9216
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 2,
"name": "blk.0.attn_output.bias",
"offset": 3548160
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 3,
"name": "blk.0.attn_output.weight",
"offset": 3551232
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 4,
"name": "blk.0.attn_norm.bias",
"offset": 4730880
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 5,
"name": "blk.0.attn_norm.weight",
"offset": 4733952
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 6,
"name": "blk.0.ffn_norm.bias",
"offset": 4737024
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 7,
"name": "blk.0.ffn_norm.weight",
"offset": 4740096
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 8,
"name": "blk.0.ffn_up.bias",
"offset": 4743168
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 9,
"name": "blk.0.ffn_up.weight",
"offset": 4755456
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 10,
"name": "blk.0.ffn_down.bias",
"offset": 9474048
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 11,
"name": "blk.0.ffn_down.weight",
"offset": 9477120
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 12,
"name": "blk.1.attn_qkv.bias",
"offset": 14195712
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 13,
"name": "blk.1.attn_qkv.weight",
"offset": 14204928
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 14,
"name": "blk.1.attn_output.bias",
"offset": 17743872
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 15,
"name": "blk.1.attn_output.weight",
"offset": 17746944
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 16,
"name": "blk.1.attn_norm.bias",
"offset": 18926592
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 17,
"name": "blk.1.attn_norm.weight",
"offset": 18929664
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 18,
"name": "blk.1.ffn_norm.bias",
"offset": 18932736
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 19,
"name": "blk.1.ffn_norm.weight",
"offset": 18935808
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 20,
"name": "blk.1.ffn_up.bias",
"offset": 18938880
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 21,
"name": "blk.1.ffn_up.weight",
"offset": 18951168
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 22,
"name": "blk.1.ffn_down.bias",
"offset": 23669760
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 23,
"name": "blk.1.ffn_down.weight",
"offset": 23672832
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 24,
"name": "blk.10.attn_qkv.bias",
"offset": 28391424
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 25,
"name": "blk.10.attn_qkv.weight",
"offset": 28400640
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 26,
"name": "blk.10.attn_output.bias",
"offset": 31939584
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 27,
"name": "blk.10.attn_output.weight",
"offset": 31942656
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 28,
"name": "blk.10.attn_norm.bias",
"offset": 33122304
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 29,
"name": "blk.10.attn_norm.weight",
"offset": 33125376
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 30,
"name": "blk.10.ffn_norm.bias",
"offset": 33128448
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 31,
"name": "blk.10.ffn_norm.weight",
"offset": 33131520
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 32,
"name": "blk.10.ffn_up.bias",
"offset": 33134592
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 33,
"name": "blk.10.ffn_up.weight",
"offset": 33146880
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 34,
"name": "blk.10.ffn_down.bias",
"offset": 37865472
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 35,
"name": "blk.10.ffn_down.weight",
"offset": 37868544
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 36,
"name": "blk.11.attn_qkv.bias",
"offset": 42587136
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 37,
"name": "blk.11.attn_qkv.weight",
"offset": 42596352
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 38,
"name": "blk.11.attn_output.bias",
"offset": 46135296
},
{
"bits_per_elem": 16.0,
"byte_len": 1179648,
"dims": [
768,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 39,
"name": "blk.11.attn_output.weight",
"offset": 46138368
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 40,
"name": "blk.11.attn_norm.bias",
"offset": 47318016
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 41,
"name": "blk.11.attn_norm.weight",
"offset": 47321088
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 42,
"name": "blk.11.ffn_norm.bias",
"offset": 47324160
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 43,
"name": "blk.11.ffn_norm.weight",
"offset": 47327232
},
{
"bits_per_elem": 32.0,
"byte_len": 12288,
"dims": [
3072
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 44,
"name": "blk.11.ffn_up.bias",
"offset": 47330304
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
768,
3072
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 45,
"name": "blk.11.ffn_up.weight",
"offset": 47342592
},
{
"bits_per_elem": 32.0,
"byte_len": 3072,
"dims": [
768
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 46,
"name": "blk.11.ffn_down.bias",
"offset": 52061184
},
{
"bits_per_elem": 16.0,
"byte_len": 4718592,
"dims": [
3072,
768
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 47,
"name": "blk.11.ffn_down.weight",
"offset": 52064256
},
{
"bits_per_elem": 32.0,
"byte_len": 9216,
"dims": [
2304
],
"dtype_id": 0,
"dtype_name": "F32",
"index": 48,
"name": "blk.2.attn_qkv.bias",
"offset": 56782848
},
{
"bits_per_elem": 16.0,
"byte_len": 3538944,
"dims": [
768,
2304
],
"dtype_id": 1,
"dtype_name": "F16",
"index": 49,
"name": "blk.2.attn_qkv.weight",
"offset": 56792064
}
]
},
"tokenizer": {
"bos_token_id": 50256,
"chat_template_chars": null,
"eos_token_id": 50256,
"has_chat_template": false,
"type": "gpt2",
"vocab_size": 50257
}
}