{ "cells": [ { "cell_type": "markdown", "metadata": { "id": "gS9Rp2w7GjPW" }, "source": [ "# Fine-tune an 8B model on 4 GB of VRAM — run it yourself\n", "\n", "[](https://colab.research.google.com/github/MakazhanAlpamys/Soup/blob/main/notebooks/proof-4gb.ipynb)\n", "\n", "[Soup](https://github.com/MakazhanAlpamys/Soup) trains a model whose weights do not fit\n", "in your GPU. The frozen base stays in host RAM and is streamed to the GPU one decoder\n", "layer at a time, so peak VRAM is bounded by **one layer** instead of by the model.\n", "\n", "This notebook does not ask you to believe that. It caps this process to **4 GB** on\n", "Colab's free T4 and then measures what actually happens.\n", "\n", "| Section | What it proves | Time |\n", "|---|---|---|\n", "| 1–3 | The cap is real, and this GPU has no bf16 | ~2 min |\n", "| 4 | A streamed model and a normal one produce **bit-identical** logits | ~3 min |\n", "| 5 | Llama-3.1-8B trains with a measured peak under 4 GB | ~20 min |\n", "\n", "Sections 1–4 are the argument. Section 5 is the headline and is optional.\n", "\n", "**Runtime → Change runtime type → T4 GPU** before you start.\n" ] }, { "cell_type": "markdown", "metadata": { "id": "EU3gwmuZGjPY" }, "source": [ "## 1. Install\n", "\n", "This notebook is pinned to **soup-cli==0.75.0**, the release this run was verified\n", "against. **v0.74.0** was the first release carrying both the T4 precision fix\n", "([#385](https://github.com/MakazhanAlpamys/Soup/issues/385),\n", "[#387](https://github.com/MakazhanAlpamys/Soup/issues/387)) and the T4 GradScaler fix\n", "([#429](https://github.com/MakazhanAlpamys/Soup/issues/429)) that section 5 needs to\n", "train at all on this card; 0.75.0 is pinned here only because it is the exact release\n", "this run's committed outputs were produced against. Bump the pin only after re-running\n", "this notebook end to end on a real T4 and recording the new outputs.\n", "\n", "The `torchao` line is not incidental either. Colab preinstalls **torchao 0.10.0**, and\n", "`peft` does not merely decline to use a version it considers too old — it *raises*\n", "`ImportError` from `is_torchao_available()`, several frames inside `get_peft_model`.\n", "Nothing here needs torchao, so it is removed rather than upgraded (upgrading risks\n", "pulling a wheel built against a different torch).\n", "\n", "**Colab's default Python can be newer than this project supports.** `soup-cli` caps at `<3.13` on purpose (untested torch/bitsandbytes wheels on newer interpreters fail with an opaque loader crash, not a clean error). Colab's hosted runtime does not let you pick an arbitrary kernel the way local Jupyter does, so if you land on Python 3.13+, the next cell falls back to installing with `--ignore-requires-python` — that trades the guarantee for a best-effort install, on the assumption that the `[train]` extras (torch,\n", "transformers, peft, bitsandbytes, accelerate) have caught up with a 3.13 wheel by the time you are reading this. If anything below fails with an import or ABI error, that assumption did not hold on this Colab image; open an issue with the\n", "traceback rather than treating it as this notebook's bug.\n" ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "pmPJQk1ZGjPY", "outputId": "e66c8068-1288-4152-f0b7-3bed5c681bec" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "Colab Python: 3.13.15 (soup-cli supports <3.13)\n", "Falling back to --ignore-requires-python for the install below;\n", "see the note above this cell for what that trades away.\n" ] } ], "source": [ "import sys\n", "\n", "PY_OK = sys.version_info < (3, 13)\n", "print(f\"Colab Python: {sys.version.split()[0]} (soup-cli supports <3.13)\")\n", "if not PY_OK:\n", " print(\"Falling back to --ignore-requires-python for the install below;\")\n", " print(\"see the note above this cell for what that trades away.\")\n" ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "R2ZoGhWwGjPZ", "outputId": "62cb934a-8bf5-4a34-d98b-2efc0fda7768" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m2.2/2.2 MB\u001b[0m \u001b[31m29.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m43.1/43.1 MB\u001b[0m \u001b[31m15.8 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m475.8/475.8 kB\u001b[0m \u001b[31m16.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m531.0/531.0 kB\u001b[0m \u001b[31m16.9 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m47.4/47.4 kB\u001b[0m \u001b[31m3.3 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n", "\u001b[?25hsoup 0.75.0\n", "pre-Ampere fix present: True\n", "torchao gone (peft raises on an old one): True\n" ] } ], "source": [ "%pip uninstall -q -y torchao\n", "import sys\n", "\n", "_extra_flag = \"--ignore-requires-python\" if sys.version_info >= (3, 13) else \"\"\n", "%pip install -q \"soup-cli[train]==0.75.0\" {_extra_flag}\n", "\n", "import importlib.util\n", "\n", "import soup_cli\n", "import soup_cli.utils.gpu\n", "\n", "print(\"soup\", soup_cli.__version__)\n", "print(\"pre-Ampere fix present:\", hasattr(soup_cli.utils.gpu, \"bf16_fp16_flags\"))\n", "print(\"torchao gone (peft raises on an old one):\",\n", " importlib.util.find_spec(\"torchao\") is None)\n" ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "k9_uWtXUGjPZ", "outputId": "5a953364-68e2-4093-ace8-b1266d337581" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "torch 2.11.0+cu128\n", "transformers 5.16.1\n", "peft 0.20.0\n", "bitsandbytes 0.50.2\n", "soup_cli 0.75.0\n" ] } ], "source": [ "import bitsandbytes\n", "import peft\n", "import torch\n", "import transformers\n", "\n", "print(\"torch \", torch.__version__)\n", "print(\"transformers\", transformers.__version__)\n", "print(\"peft \", peft.__version__)\n", "print(\"bitsandbytes\", bitsandbytes.__version__)\n", "print(\"soup_cli \", soup_cli.__version__)\n" ] }, { "cell_type": "markdown", "metadata": { "id": "1IEi4wOPGjPZ" }, "source": [ "## 2. What card did we get, and does it have bf16?\n", "\n", "Colab's free tier is a **T4** — Turing, sm_75. bf16 hardware arrived with Ampere, so a\n", "T4 has none.\n", "\n", "**Read the two lines below carefully, because they disagree, and the disagreement is\n", "the point.** `torch.cuda.is_bf16_supported()` defaults to `including_emulation=True`:\n", "when the compute-capability check fails it falls through to *constructing* a bf16\n", "tensor, which software emulation satisfies. So a T4 answers **True** to the question\n", "everyone asks, and False only to `is_bf16_supported(including_emulation=False)`.\n", "\n", "Soup asked the permissive question and therefore handed bf16 to a card with no bf16\n", "units. The first version of this fix asked it too, and was a no-op on exactly the\n", "hardware it was written for — caught by running this notebook on a real T4, not before\n", "([#385](https://github.com/MakazhanAlpamys/Soup/issues/385),\n", "[#387](https://github.com/MakazhanAlpamys/Soup/issues/387)).\n" ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "ebZmw05TGjPa", "outputId": "a348715e-5852-4369-b219-110cc80ecb06" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "GPU Tesla T4 (sm_75)\n", "VRAM 15.6 GB\n", "bf16, incl. emulation True\n", "bf16 IN HARDWARE False\n", "Soup will train in fp16\n" ] } ], "source": [ "import torch\n", "\n", "from soup_cli.utils.gpu import bf16_fp16_flags\n", "\n", "assert torch.cuda.is_available(), \"No GPU. Runtime -> Change runtime type -> T4 GPU.\"\n", "\n", "name = torch.cuda.get_device_name(0)\n", "major, minor = torch.cuda.get_device_capability(0)\n", "total = torch.cuda.get_device_properties(0).total_memory\n", "\n", "print(f\"GPU {name} (sm_{major}{minor})\")\n", "print(f\"VRAM {total / 1e9:.1f} GB\")\n", "print(f\"bf16, incl. emulation {torch.cuda.is_bf16_supported()}\")\n", "print(f\"bf16 IN HARDWARE \"\n", " f\"{torch.cuda.is_bf16_supported(including_emulation=False)}\")\n", "\n", "bf16, fp16 = bf16_fp16_flags(\"cuda\")\n", "print(f\"Soup will train in {'bf16' if bf16 else 'fp16' if fp16 else 'fp32'}\")\n" ] }, { "cell_type": "markdown", "metadata": { "id": "l7M_09spGjPa" }, "source": [ "## 3. Cap this process to 4 GB\n", "\n", "`set_per_process_memory_fraction` caps PyTorch's allocator. Everything after this cell\n", "runs as if the card were a 4 GB laptop GPU — an allocation past the cap raises, exactly\n", "as it would on the real thing.\n", "\n", "**One historical caveat, now closed.** `torch.cuda.mem_get_info()` reports the whole\n", "card, so Soup's own pre-flight check used to read that and print a \"free VRAM\" line that\n", "belonged to the host card, not to this capped process — it would have allowed a\n", "configuration that the allocator then refused. That was\n", "[#347](https://github.com/MakazhanAlpamys/Soup/issues/347), closed by\n", "`training.stream_vram_override` in v0.73.1: section 5's config below sets it to this\n", "notebook's own 4 GB cap, so the pre-flight checks against the same number the allocator\n", "enforces.\n" ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "WerOAXc-GjPa", "outputId": "9dea490f-a394-4654-f44a-2fafdceb7571" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "capped at 4.00 GB (fraction 0.256 of this card)\n", "refused, as it should be: CUDA out of memory. Tried to allocate 4.29 GiB. GPU 0 has a total capacity of 14.56 GiB of\n" ] } ], "source": [ "BUDGET_BYTES = 4 * 1000**3 # 4 GB, the card this method was developed on\n", "\n", "fraction = BUDGET_BYTES / total\n", "torch.cuda.set_per_process_memory_fraction(fraction)\n", "print(f\"capped at {BUDGET_BYTES / 1e9:.2f} GB (fraction {fraction:.3f} of this card)\")\n", "\n", "# Prove the cap bites: ask for 15% more than the budget and expect a refusal.\n", "try:\n", " _ = torch.empty(int(BUDGET_BYTES * 1.15), dtype=torch.uint8, device=\"cuda\")\n", " print(\"WARNING: the allocation succeeded — the cap is NOT in force\")\n", "except RuntimeError as exc:\n", " print(\"refused, as it should be:\", str(exc).splitlines()[0][:90])\n" ] }, { "cell_type": "markdown", "metadata": { "id": "OJhzXWHkGjPa" }, "source": [ "## 4. The claim that matters: streamed == resident, bit for bit\n", "\n", "A streaming bug is silent. If the base were substituted wrongly, or the autograd path\n", "severed, the loss would still fall — the upper layers keep learning — and you would ship\n", "a damaged model without an error anywhere.\n", "\n", "So the check is not \"does it train\". It is: **the same weights, through the same kernels,\n", "must produce the same numbers.** Below, one model is streamed layer-by-layer and the\n", "other is an ordinary resident model, both carrying identical adapter weights.\n", "`torch.equal` is exact equality, not a tolerance.\n", "\n", "This runs on a small model because the reference has to fit in memory next to the\n", "streamed copy — that is the whole reason the headline size cannot be checked this way.\n" ] }, { "cell_type": "code", "execution_count": 6, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 182, "referenced_widgets": [ "5ce8709eb08141b49ec54002daaf6a02", "1ade6c23233e4dc8928b74379f919b52", "64dac42bdc2948108be4191c0ceda935", "703835e267844b2081cc77a980f29a5a", "7bcd0e9f66b44345be83558727ea4f73", "ea2e2f0858604f8cbb26396a34486582", "57d7a95684aa4448a094b483607d8a7b", "26c64bed491b40338f08829696b702d2", "bf620d6b3d3247c3b885a9b52ed50e72", "e2482e92256f4dc3abf1da54bcbd0b4e", "611b1dafb25f44bd88803b30c5fb8be2", "1eb41dbea62d4d38a15c1861465a89af", "653f8a5aec8a4f268ac5131721b95939", "909b04d476b64bfeb01e889a31579ec2", "319044ab454c41ecafd14d019bd3dae6", "8afdfbea52874655b291ad460c7a06ca", "c01d30ec7dc943c7b73eee9bab52ff7d", "1c2eff1f10744844b12048ee187cd7d5", "d609772e7c8a4b92a86dc1e4e381b330", "9f1e69eb590248e2b8f3e9f4705d5efa", "f086e453790c472cb3f7302d0a9a9c59", "5a8439b13e404597ad30f6841c88e503", "cf4ec404d5144f7c9d4b333d0a715c2b", "9b2b590e6a4b475b8de2ea0408f0431f", "a18dada832ec421bbaf389daad3d1dd9", "c5dab0b774fa4f32b8837655f217fe87", "fbefa341e54f44669cbd6b008d332388", "9730f83efe164a26a2f929a2d5389e83", "339fabb1f51b435687047788de187438", "bf1f2e0942a248bb856bcce5fde22450", "c874443864e44b4d96fe173cef76774f", "5e7f3e8b868546c8ba1ada9c93690215", "a80e7b254bc84ea1aab5cb84c07d5167" ] }, "id": "v0m9f-XoGjPa", "outputId": "35c5d4e3-cafa-40e3-9121-09c4e539b104" }, "outputs": [ { "output_type": "display_data", "data": { "text/plain": [ "Downloading bytes: | 0.00B " ], "application/vnd.jupyter.widget-view+json": { "version_major": 2, "version_minor": 0, "model_id": "5ce8709eb08141b49ec54002daaf6a02" } }, "metadata": {} }, { "output_type": "display_data", "data": { "text/plain": [ "Reconstructing (incomplete total...): | | 0.00B / 0.00B " ], "application/vnd.jupyter.widget-view+json": { "version_major": 2, "version_minor": 0, "model_id": "1eb41dbea62d4d38a15c1861465a89af" } }, "metadata": {} }, { "output_type": "display_data", "data": { "text/plain": [ "Fetching 11 files: 0%| | 0/11 [00:00, ?it/s]" ], "application/vnd.jupyter.widget-view+json": { "version_major": 2, "version_minor": 0, "model_id": "cf4ec404d5144f7c9d4b333d0a715c2b" } }, "metadata": {} }, { "output_type": "stream", "name": "stderr", "text": [ "Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.\n", "WARNING:huggingface_hub.utils._http:Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.\n", "[transformers] `torch_dtype` is deprecated! Use `dtype` instead!\n" ] }, { "output_type": "stream", "name": "stdout", "text": [ "streamed: 30 layers, dtype=float16\n" ] } ], "source": [ "import tempfile\n", "from pathlib import Path\n", "\n", "from peft import LoraConfig, TaskType, get_peft_model\n", "from transformers import AutoModelForCausalLM\n", "\n", "from soup_cli.utils.layer_shard import shard_checkpoint\n", "from soup_cli.utils.layer_stream import resolve_stream_dtype\n", "from soup_cli.utils.layer_stream_runtime import build_streamed_model\n", "from soup_cli.utils.spectrum_scan import resolve_model_weights\n", "\n", "MODEL = \"HuggingFaceTB/SmolLM2-135M-Instruct\"\n", "DTYPE = resolve_stream_dtype(\"cuda\") # fp16 on a T4, bf16 on an Ampere card\n", "LORA = LoraConfig(\n", " r=8, lora_alpha=16, lora_dropout=0.0, bias=\"none\",\n", " target_modules=[\"q_proj\", \"v_proj\"], task_type=TaskType.CAUSAL_LM,\n", ")\n", "\n", "workdir = Path(tempfile.mkdtemp())\n", "weights = resolve_model_weights(MODEL) # downloads on first use\n", "index = shard_checkpoint(weights, str(workdir / \"shards\"), dtype=DTYPE, arch=\"llama\")\n", "streamed, runtime = build_streamed_model(\n", " model_id=weights, shard_dir=str(workdir / \"shards\"), index=index,\n", " lora_config=LORA, device=\"cuda\", dtype=DTYPE, buffers=2, pin=True, seed=0,\n", ")\n", "print(f\"streamed: {index.n_layers} layers, dtype={DTYPE}\")\n" ] }, { "cell_type": "code", "execution_count": 7, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 173, "referenced_widgets": [ "16c9123ed8cb4c02b25729e7fe8fb2df", "8dd8ccb477cb4da3af7d7511124c9c5d", "c0a5556c08e44280a72c0ecc8810f2a6", "463038b513e849d19431f12ecb26c8a1", "3341a9dac7c64af38c5e479d9a5083f8", "7c91ec1827844d05ba8e51ba994d1f7f", "c219201c066b41bb84dae9e5c981facb", "0aa7563bd4d04e848f32f2782f7717fe", "13c5ab409fbb49888ce477f55e1f62af", "6dbd72ea2b8846408bb53debf64a756d", "9b5d5a1c32624c54b530692430dab2a2" ] }, "id": "N_eeBzptGjPa", "outputId": "40330dec-5c8b-416e-8441-1a1914664b3b" }, "outputs": [ { "output_type": "display_data", "data": { "text/plain": [ "Loading weights: 0%| | 0/272 [00:00, ?it/s]" ], "application/vnd.jupyter.widget-view+json": { "version_major": 2, "version_minor": 0, "model_id": "16c9123ed8cb4c02b25729e7fe8fb2df" } }, "metadata": {} }, { "output_type": "stream", "name": "stderr", "text": [ "/usr/local/lib/python3.13/dist-packages/peft/mapping_func.py:78: UserWarning: The PEFT config's `base_model_name_or_path` was renamed from '/root/.soup/spectrum/weights/HuggingFaceTB__SmolLM2-135M-Instruct' to 'HuggingFaceTB/SmolLM2-135M-Instruct'. Please ensure that the correct base model is loaded when loading this checkpoint.\n", " warnings.warn(\n" ] }, { "output_type": "stream", "name": "stdout", "text": [ "max |streamed - resident| = 0.0\n", "torch.equal = True\n", "\n", "Bit-exact. The streamed model is the same model.\n" ] } ], "source": [ "# PEFT initialises lora_B to zero, so an untrained adapter contributes NOTHING and any\n", "# comparison would silently be about the base model alone. Make it load-bearing first.\n", "gen = torch.Generator().manual_seed(7)\n", "with torch.no_grad():\n", " for pname, param in streamed.named_parameters():\n", " if \"lora_B\" in pname:\n", " param.copy_(torch.randn(param.shape, generator=gen).to(param.device, param.dtype))\n", "\n", "resident = AutoModelForCausalLM.from_pretrained(\n", " MODEL, dtype=getattr(torch, DTYPE), device_map={\"\": \"cuda\"}\n", ")\n", "resident = get_peft_model(resident, LORA)\n", "\n", "# Copy the adapter across. The streamed wrapper inserts an '.inner.' segment in its keys.\n", "src = {k.replace(\".inner.\", \".\"): v for k, v in streamed.state_dict().items() if \"lora_\" in k}\n", "dst = {k.replace(\".inner.\", \".\"): v for k, v in resident.state_dict().items() if \"lora_\" in k}\n", "assert src and set(src) == set(dst)\n", "with torch.no_grad():\n", " for key, val in src.items():\n", " dst[key].copy_(val.to(dst[key].dtype))\n", "\n", "ids = torch.randint(0, 4096, (1, 32), device=\"cuda\")\n", "with torch.no_grad():\n", " a = streamed(input_ids=ids).logits\n", " b = resident(input_ids=ids).logits\n", "\n", "print(\"max |streamed - resident| =\", (a.float() - b.float()).abs().max().item())\n", "print(\"torch.equal =\", torch.equal(a, b))\n", "assert torch.equal(a, b), \"NOT bit-exact — please open an issue with this output\"\n", "print(\"\\nBit-exact. The streamed model is the same model.\")\n" ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "5ES65VQSGjPb", "outputId": "43f9d542-3a8a-43b1-88d0-00facecf1b6d" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "reset\n" ] } ], "source": [ "import gc\n", "\n", "# Free the reference before the headline run.\n", "runtime.close()\n", "del streamed, resident, a, b\n", "gc.collect()\n", "torch.cuda.empty_cache()\n", "torch.cuda.reset_peak_memory_stats()\n", "print(\"reset\")\n" ] }, { "cell_type": "markdown", "metadata": { "id": "xQGpbvi6GjPb" }, "source": [ "## 5. The headline: Llama-3.1-8B, trained under the 4 GB cap\n", "\n", "8B parameters. In NF4 the weights alone are about **4.5 GB** — more than the budget this\n", "process is allowed, before activations, gradients or the optimizer. It trains anyway,\n", "because at any moment only a couple of decoder layers are resident.\n", "\n", "Expect ~20 minutes, most of it the download. The number to watch is the **peak VRAM**\n", "at the end — not the loss. This is a handful of steps on 32 toy rows; over that distance\n", "the loss can go up as easily as down, and it would prove nothing either way. What is\n", "being demonstrated is that the run *happens at all* inside the budget.\n" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "50nv26cMGjPb", "outputId": "759fba3c-dbf8-4be0-e084-1102ff6b26f5" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "\n", "base: NousResearch/Meta-Llama-3.1-8B-Instruct\n", "task: sft\n", "data:\n", " train: train.jsonl\n", " max_length: 256\n", "training:\n", " epochs: 1\n", " batch_size: 1\n", " lr: 0.0002\n", " logging_steps: 1 # short run — without this nothing gets logged\n", " quantization: 4bit # NF4 — the store is ~4x smaller than bf16\n", " stream_layers: true # the feature\n", " stream_buffers: 2\n", " stream_vram_override: 4000000000 # same 4 GB the allocator enforces above (#347)\n", " lora:\n", " r: 8\n", " alpha: 16\n", "output: ./out-8b\n", "\n" ] } ], "source": [ "import json\n", "\n", "# Varied on both sides on purpose: 32 copies of one answer drive the loss to 0.000\n", "# immediately and the printed curve stops meaning anything.\n", "TOPICS = [\n", " (\"streaming\", \"Only a couple of decoder layers are resident at any moment.\"),\n", " (\"NF4\", \"Four-bit weights make the host-side store about four times smaller.\"),\n", " (\"LoRA\", \"The base is frozen, so it is read and never written.\"),\n", " (\"VRAM\", \"Peak memory is bounded by one layer instead of by the model.\"),\n", "]\n", "rows = [\n", " {\"messages\": [\n", " {\"role\": \"user\", \"content\": f\"Question {i}: tell me about {topic}.\"},\n", " {\"role\": \"assistant\", \"content\": answer},\n", " ]}\n", " for i in range(8)\n", " for topic, answer in TOPICS\n", "]\n", "Path(\"train.jsonl\").write_text(\"\\n\".join(json.dumps(r) for r in rows), encoding=\"utf-8\")\n", "\n", "config = \"\"\"\n", "base: NousResearch/Meta-Llama-3.1-8B-Instruct\n", "task: sft\n", "data:\n", " train: train.jsonl\n", " max_length: 256\n", "training:\n", " epochs: 1\n", " batch_size: 1\n", " lr: 0.0002\n", " logging_steps: 1 # short run — without this nothing gets logged\n", " quantization: 4bit # NF4 — the store is ~4x smaller than bf16\n", " stream_layers: true # the feature\n", " stream_buffers: 2\n", " stream_vram_override: 4000000000 # same 4 GB the allocator enforces above (#347)\n", " lora:\n", " r: 8\n", " alpha: 16\n", "output: ./out-8b\n", "\"\"\"\n", "Path(\"soup.yaml\").write_text(config, encoding=\"utf-8\")\n", "print(config)\n" ] }, { "cell_type": "markdown", "metadata": { "id": "WV-0mv5sGjPb" }, "source": [ "The cell below runs the trainer **in this process** rather than shelling out to\n", "`soup train`. That is deliberate and it is the only reason: `max_memory_allocated()`\n", "reports the peak of *the process that calls it*, so a subprocess would train fine and\n", "leave us measuring nothing. It is the same code path the CLI runs on the same\n", "`soup.yaml` above — the CLI adds argument parsing and the pre-flight panel, neither of\n", "which changes what the GPU does.\n" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 1000, "referenced_widgets": [ "35ee497596604617ba94600ad274f67b", "e9d3eab7d0c9432f8ba491ad54f70114", "a40a14b07135429887a87f9e2f195f0a", "45e1fbb311674c4d90997812cd009ca7", "e4b6c79bd2b04ccd9c973727fea03b31", "ce3cb4ffeaa2483c9b07ddfa67099794", "245389ff14d04303b07e2caf74fcd613", "ef8cda62d86340a7a8f5eb9fbd5b5379", "4be68f8397054652abcf76bcb9c6dd07", "83d159c08b1e4cd396456c8efdfe3363", "6ead2f696d0242caaafe54134031c85b", "f9d81b93d99a4500921e5b7ecb4eaf10", "80af22410bd84a2085b101295240e1da", "d755dc0ccaba45c686e88cdffb446b03", "5c5356b513744719a17b456bf85b02f8", "e6e09bde3db84cb5b05ff17979a1c756", "c0e7eb7462294f90bc895d4fc35e24a7", "71f2bb58ebb4449e96e741cd6a871307", "50c77663bb614591955ac0361dca2303", "7d5d6a70d69840b58c3074ef51d64e76", "8e8b99dba8164613bee68ddbed15939e", "8d29bcdabd494acaa2f98c1e8e9b3e91", "c686a763c243420284c300807d60608a", "6274db24e591412d8d29b28cce60ce33", "42d74bf8b23542c3b7c6b9cab6ffe304", "816bd5861347404291f3dd7ea97165dd", "d34f9a02bbe346f4a975d4ccdd632d7e", "29aa7549f9e147439585b07d652bb070", "9ba6f453cb204408b7e77922d7208134", "93537120d889491e9ea5fad0f1343c6a", "6890fc7518b94db48ed087f7128e1aa9", "8210fe01d55a4d9e8573559072bfc77f", "a3eddcd776754633990da638e1ab1686", "88416241eaae466c83f73d29931a20bc", "3fd4bdbdff694191be84c113a4ee8d6d", "23bb0118c7dc415089538f68691a6ebb", "4da521b3b720410abeca6e0982dddb8d", "0b327fce5f4449399847d7f1f12746ee", "8613547a5d474090a35b08b5281e8a7d", "6e5647ac37484373a8b8fa270c977984", "60b9a418c0234eb1835162e1cfdaf694", "34ffd5006ec74b5993f4d4a87c99ae8e", "0374db7ed4ed4d0ebb2336a00e2a86c9", "130630254ce64432b24f4f7bdcbd2344", "65160c38c03248ea98ffc998b6304b81", "a4581c1c8ca0410ebe88a1f44c0376d1", "460ae660d82b4b8c98d7b92f361127f2", "40b0767205474f0f8212e8af673b8b36", "5b6d0637d0f5465f9170a0e88dce8620", "e0816fefa70f4fc9b599ce0b12a751cf", "95d3abe8e87a48209a6d5b7db1899a3c", "e83fa3e9c84b4ac1855bd10e8f636ae3", "13457c4fb87649f082787743450ce477", "c900cc97b8804caeb1f4da05b9afcd27", "2a0bea75275b4c29b5ad4a38b6589eb9", "b64e93cc27994aa4a6019128222302e4", "7c542b2d56bf4c7dbe690ab888ff3900", "f7558f8cc9ab4c2d9f4d5394551ca76c", "a668be7526a84398ba637c1d7b3a7517", "8b2e5061814845a2af0bbea3ef969bf5", "e73005d74e014e018b5ea0093fc9797a", "03f2a35c338a494396cf3e8a7294af41", "4614dcff59d8438588ba05f78142f3e6", "6057cd6ca93c4e3aba06e431bed676bb", "1ef6b499144647628881409798a6dc7a", "7fc91fc2438a42b28ebb86b6d4561bd5", "f80cbd912101453c8be873d807aaf2e8", "e84755b2bd364309a189abc658aed7e6", "fe1161b83b1f41fcb0b915d74fb1ad85", "54bf53b947f546bab6871edee4f42dd0", "e9b63850ce1b42079c7c4d4b0af16049", "298c737f48ba4b78b18e1bbf5a65f106", "efb9f916092347689564d2eb3971a2b3", "4cccf7f16fa745a8bbcb5133cdbf50e6", "f3506fb615524f0985b84a42f9623c96", "4be70f5c998a4002a904d4dcdea8ed8f", "0ef32da4b20f4b259c9dc6db37fdf8a8", "7bbfaa6685b94518a43751f208d14194", "b80fc4b54ac446be9dc9e9684611760e", "208d4b88b10941abaac3370d13be017a", "83d74109bbff421b922f09a0bfc96731", "e49360e10ca64dd49bd34a431b80fdee", "a4805fc732ca42da9ef3048c189d8825", "dbafadb2a5164b1c81efec284d2eafb1", "f03b91976b61427c9226b02864b1a24b", "598714ba52c844199123a68c7c05ee23", "b37f1aa2034e45608b2e5813f821f608", "b34b00154e134af6bdccdfd4ec0319bb", "d52de28dd3c5408e9a89a10ec7910215", "31137da3af584d33ae9bbc3a322cb5b5", "0a003709e02e4285938da4bb2c4ef7f1", "7741ea6eaf1d4a6abc722effc1297b88", "faf1ddf281784aad91c2c3b4bca6b957", "ff466ea4fd094cfeb2b72c4e900f83b1", "222a3b9e28b040c9aa615f7a8afd3c16", "78b5998326384bd2a3f956b658a6c45a", "ff756b7ae2bf45999416d11a11d89565", "4b9e7bb47d3f4a87af852c4100b2d0f8", "350114c77ee649f0aab61aeb376d08fb", "8003bb7941eb4090a1fcf6bcea55c6ea", "7d328a3f5a9642388b4aeab3e05c69bd", "74dea5b5be6941b997844cb51cbacbd8", "d34c375a32a844cdbaa133bd768f19d5", "c56e8789c81f492d9520936635415098", "68e33220036347d3afa231bd3d2b7865", "2cf81a35ef9c4bb1bbcd12a0643a99c4", "3ba5e545209245eeac1d44040aca3d6d", "b6093fbc34af407895066bf8ce21e6a3", "5d98ed609ec745f0868394ea47dd72d3", "507014f569ff434395c0be2320e28396", "59d99840b2574bae89690e14d8fe26b6", "439184a795f042e6b2ac12c4a1217722", "a14faf64a126456d9ae482b76752a62c", "9752b710bc124934853c5f2e239038fd", "16c1d4a11b214f1aa8944820eb9db631", "f31373192dce4c1abeb178b229596289", "42e486c8f6074ac0ae4a2cb01bd3ac28", "2ab53c5552e24c4a93fb02f6ea12831e", "f1c0fd3eb8254e22babe007edf3f36b4", "ca8e430e28c1420489010799a6a1651b", "08fe8e8b9a414dc491c485d95806af93" ] }, "id": "hEeldGwuGjPb", "outputId": "811f5852-a0f3-477c-fed2-0cfa97383967" }, "outputs": [ { "data": { "text/html": [ "
Auto-detected format: chatml\n",
"\n"
],
"text/plain": [
"\u001b[2mAuto-detected format: chatml\u001b[0m\n"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"Loading tokenizer: NousResearch/Meta-Llama-3.1-8B-Instruct\n", "\n" ], "text/plain": [ "\u001b[2mLoading tokenizer: NousResearch/Meta-Llama-\u001b[0m\u001b[1;2;36m3.1\u001b[0m\u001b[2m-8B-Instruct\u001b[0m\n" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "35ee497596604617ba94600ad274f67b", "version_major": 2, "version_minor": 0 }, "text/plain": [ "config.json: 0%| | 0.00/855 [00:00, ?B/s]" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "f9d81b93d99a4500921e5b7ecb4eaf10", "version_major": 2, "version_minor": 0 }, "text/plain": [ "tokenizer_config.json: 0%| | 0.00/50.9k [00:00, ?B/s]" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "c686a763c243420284c300807d60608a", "version_major": 2, "version_minor": 0 }, "text/plain": [ "tokenizer.json: 0%| | 0.00/9.09M [00:00, ?B/s]" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "88416241eaae466c83f73d29931a20bc", "version_major": 2, "version_minor": 0 }, "text/plain": [ "special_tokens_map.json: 0%| | 0.00/296 [00:00, ?B/s]" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "65160c38c03248ea98ffc998b6304b81", "version_major": 2, "version_minor": 0 }, "text/plain": [ "Downloading bytes: | 0.00B " ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "b64e93cc27994aa4a6019128222302e4", "version_major": 2, "version_minor": 0 }, "text/plain": [ "Reconstructing (incomplete total...): | | 0.00B / 0.00B " ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "f80cbd912101453c8be873d807aaf2e8", "version_major": 2, "version_minor": 0 }, "text/plain": [ "Fetching 11 files: 0%| | 0/11 [00:00, ?it/s]" ] }, "metadata": {}, "output_type": "display_data" }, { "output_type": "display_data", "data": { "text/plain": [ "╭──────────────────────────────────────── Layer streaming disk pre-flight ────────────────────────────────────────╮\n", "│ HF/local source: 16.06 GB │\n", "│ Soup materialized copy: 16.06 GB (write required) │\n", "│ Layer-shard cache: 4.14 GB (write required) │\n", "│ Projected total on disk: 36.26 GB │\n", "│ Additional writes before training: 20.20 GB │\n", "│ Free on target volume (materialized weight copy + layer-shard cache): 52.91 GB │\n", "╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯\n" ], "text/html": [ "
╭──────────────────────────────────────── Layer streaming disk pre-flight ────────────────────────────────────────╮\n",
"│ HF/local source: 16.06 GB │\n",
"│ Soup materialized copy: 16.06 GB (write required) │\n",
"│ Layer-shard cache: 4.14 GB (write required) │\n",
"│ Projected total on disk: 36.26 GB │\n",
"│ Additional writes before training: 20.20 GB │\n",
"│ Free on target volume (materialized weight copy + layer-shard cache): 52.91 GB │\n",
"╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯\n",
"\n"
]
},
"metadata": {}
},
{
"output_type": "display_data",
"data": {
"text/plain": [
"\u001b[2mPreparing layer shards -> \u001b[0m\u001b[2;35m/root/.soup/layer-stream/\u001b[0m\u001b[2;95mNousResearch__Meta-Llama-3.1-8B-Instruct\u001b[0m\n"
],
"text/html": [
"Preparing layer shards -> /root/.soup/layer-stream/NousResearch__Meta-Llama-3.1-8B-Instruct\n", "\n" ] }, "metadata": {} }, { "output_type": "display_data", "data": { "text/plain": [ "\u001b[33mRe-sharding layer cache:\u001b[0m cache index is missing or unreadable.\n" ], "text/html": [ "
Re-sharding layer cache: cache index is missing or unreadable.\n",
"\n"
]
},
"metadata": {}
},
{
"output_type": "display_data",
"data": {
"text/plain": [
"\u001b[36m╭─\u001b[0m\u001b[36m───────────────────────────────────────────\u001b[0m\u001b[36m training.stream_layers \u001b[0m\u001b[36m────────────────────────────────────────────\u001b[0m\u001b[36m─╮\u001b[0m\n",
"\u001b[36m│\u001b[0m \u001b[1mLayer streaming\u001b[0m \u001b[33mBETA\u001b[0m — arch \u001b[36mllama\u001b[0m, tier \u001b[36mram\u001b[0m \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m base store 5.70 GB across 32 layers (pinned) \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m VRAM buffers 2 x 113 MB + 1 x 1051 MB large-layer slot = 1276 MB \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m resident 0 MB extras + adapters \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m peak VRAM ~1.97 GB at batch 1 x seq 256 (logits 0.46 GB) \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m free VRAM 4.00 GB (training.stream_vram_override; driver reports 15.15 GB) \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m forecast 288-423 tok/s — a compute-bound bound, not a promise \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m (from 20.39 TFLOPS measured on this card now using float16 @ 525 MHz) \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m \u001b[33m!\u001b[0m accumulating 4x at batch 1: the base is re-read once per micro-batch. Per token that is free, but reaching \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m effective batch 4 by raising training.batch_size instead measured ~2.5x faster. Accumulation holds peak VRAM \u001b[36m│\u001b[0m\n",
"\u001b[36m│\u001b[0m flat, so raise batch_size while the budget above allows, then accumulate for the rest. \u001b[36m│\u001b[0m\n",
"\u001b[36m╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯\u001b[0m\n"
],
"text/html": [
"╭──────────────────────────────────────────── training.stream_layers ─────────────────────────────────────────────╮\n", "│ Layer streaming BETA — arch llama, tier ram │\n", "│ base store 5.70 GB across 32 layers (pinned) │\n", "│ VRAM buffers 2 x 113 MB + 1 x 1051 MB large-layer slot = 1276 MB │\n", "│ resident 0 MB extras + adapters │\n", "│ peak VRAM ~1.97 GB at batch 1 x seq 256 (logits 0.46 GB) │\n", "│ free VRAM 4.00 GB (training.stream_vram_override; driver reports 15.15 GB) │\n", "│ forecast 288-423 tok/s — a compute-bound bound, not a promise │\n", "│ (from 20.39 TFLOPS measured on this card now using float16 @ 525 MHz) │\n", "│ ! accumulating 4x at batch 1: the base is re-read once per micro-batch. Per token that is free, but reaching │\n", "│ effective batch 4 by raising training.batch_size instead measured ~2.5x faster. Accumulation holds peak VRAM │\n", "│ flat, so raise batch_size while the budget above allows, then accumulate for the rest. │\n", "╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯\n", "\n" ] }, "metadata": {} }, { "output_type": "display_data", "data": { "text/plain": [ "\u001b[33mLayer streaming is BETA:\u001b[0m slower than resident training, but this model may not run resident on this card at all.\n" ], "text/html": [ "
Layer streaming is BETA: slower than resident training, but this model may not run resident on this card at all.\n",
"\n"
]
},
"metadata": {}
},
{
"output_type": "display_data",
"data": {
"text/plain": [
"\u001b[2mexpandable_segments allocator hint not enabled: CUDA was already initialised before Soup could set it — the \u001b[0m\n",
"\u001b[2mallocator reads PYTORCH_CUDA_ALLOC_CONF once, at context creation\u001b[0m\n"
],
"text/html": [
"expandable_segments allocator hint not enabled: CUDA was already initialised before Soup could set it — the \n", "allocator reads PYTORCH_CUDA_ALLOC_CONF once, at context creation\n", "\n" ] }, "metadata": {} }, { "output_type": "display_data", "data": { "text/plain": [ "\u001b[32mLayer streaming ready:\u001b[0m \u001b[1;36m32\u001b[0m layers, \u001b[1;36m5.70\u001b[0m GB pinned RAM store, \u001b[1;36m2\u001b[0m x \u001b[1;36m113\u001b[0m MB decoder buffers + \u001b[1;36m1\u001b[0m x \u001b[1;36m1051\u001b[0m MB large-layer \n", "slot\n" ], "text/html": [ "
Layer streaming ready: 32 layers, 5.70 GB pinned RAM store, 2 x 113 MB decoder buffers + 1 x 1051 MB large-layer \n", "slot\n", "\n" ] }, "metadata": {} }, { "output_type": "display_data", "data": { "text/plain": [ "\u001b[32mLoRA applied:\u001b[0m \u001b[1;36m3\u001b[0m,\u001b[1;36m407\u001b[0m,\u001b[1;36m872\u001b[0m trainable \u001b[35m/\u001b[0m \u001b[1;36m8\u001b[0m,\u001b[1;36m030\u001b[0m,\u001b[1;36m261\u001b[0m,\u001b[1;36m248\u001b[0m total \u001b[1m(\u001b[0m\u001b[1;36m0.04\u001b[0m%\u001b[1m)\u001b[0m\n" ], "text/html": [ "
LoRA applied: 3,407,872 trainable / 8,030,261,248 total (0.04%)\n", "\n" ] }, "metadata": {} }, { "output_type": "display_data", "data": { "text/plain": [ "Map: 0%| | 0/28 [00:00, ? examples/s]" ], "application/vnd.jupyter.widget-view+json": { "version_major": 2, "version_minor": 0, "model_id": "7bbfaa6685b94518a43751f208d14194" } }, "metadata": {} }, { "output_type": "stream", "name": "stderr", "text": [ "[transformers] return_assistant_tokens_mask==True but chat template does not contain `{% generation %}` keyword.\n" ] }, { "output_type": "display_data", "data": { "text/plain": [ "Map: 0%| | 0/4 [00:00, ? examples/s]" ], "application/vnd.jupyter.widget-view+json": { "version_major": 2, "version_minor": 0, "model_id": "d52de28dd3c5408e9a89a10ec7910215" } }, "metadata": {} }, { "output_type": "display_data", "data": { "text/plain": [ "Truncating train dataset: 0%| | 0/28 [00:00, ? examples/s]" ], "application/vnd.jupyter.widget-view+json": { "version_major": 2, "version_minor": 0, "model_id": "8003bb7941eb4090a1fcf6bcea55c6ea" } }, "metadata": {} }, { "output_type": "display_data", "data": { "text/plain": [ "Truncating eval dataset: 0%| | 0/4 [00:00, ? examples/s]" ], "application/vnd.jupyter.widget-view+json": { "version_major": 2, "version_minor": 0, "model_id": "59d99840b2574bae89690e14d8fe26b6" } }, "metadata": {} }, { "output_type": "stream", "name": "stderr", "text": [ "[transformers] The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 128009, 'pad_token_id': 128009}.\n" ] }, { "output_type": "display_data", "data": { "text/plain": [ "
| Step | \n", "Training Loss | \n", "
|---|---|
| 1 | \n", "4.529099 | \n", "
| 2 | \n", "4.441022 | \n", "
| 3 | \n", "3.946751 | \n", "
| 4 | \n", "4.775282 | \n", "
| 5 | \n", "4.251106 | \n", "
| 6 | \n", "4.155877 | \n", "
| 7 | \n", "4.029544 | \n", "
" ] }, "metadata": {} }, { "output_type": "stream", "name": "stdout", "text": [ "\n", "steps: 7 loss: 4.529 -> 4.030\n" ] } ], "source": [ "from soup_cli.config.loader import load_config_from_string\n", "from soup_cli.data.loader import load_dataset\n", "from soup_cli.trainer.sft import SFTTrainerWrapper\n", "\n", "cfg = load_config_from_string(config)\n", "dataset = load_dataset(cfg.data)\n", "\n", "torch.cuda.empty_cache()\n", "torch.cuda.reset_peak_memory_stats()\n", "\n", "wrapper = SFTTrainerWrapper(cfg)\n", "wrapper.setup(dataset) # downloads, shards to NF4, builds the streamed model\n", "result = wrapper.train()\n", "\n", "print(f\"\\nsteps: {result['total_steps']} loss: {result['initial_loss']:.3f}\"\n", " f\" -> {result['final_loss']:.3f}\")\n" ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "4YmrBTWkGjPb", "outputId": "735ebe34-4229-40dd-89b7-247069af1c30" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "peak VRAM allocated by this process: 1.83 GB\n", "budget this process was capped to: 4.00 GB\n", "model weights in NF4, for scale: ~4.5 GB\n", "\n", "adapter written: True\n", "adapter tensors: 128, non-zero: 128\n" ] } ], "source": [ "peak = torch.cuda.max_memory_allocated()\n", "print(f\"peak VRAM allocated by this process: {peak / 1e9:.2f} GB\")\n", "print(f\"budget this process was capped to: {BUDGET_BYTES / 1e9:.2f} GB\")\n", "print(\"model weights in NF4, for scale: ~4.5 GB\")\n", "\n", "adapter = Path(\"out-8b/adapter_model.safetensors\")\n", "print(f\"\\nadapter written: {adapter.exists()}\")\n", "if adapter.exists():\n", " from safetensors.torch import load_file\n", "\n", " tensors = load_file(str(adapter))\n", " live = sum(1 for v in tensors.values() if v.abs().max().item() > 0)\n", " print(f\"adapter tensors: {len(tensors)}, non-zero: {live}\")\n" ] }, { "cell_type": "markdown", "metadata": { "id": "72bL5REbGjPb" }, "source": [ "## What this proved, and what it did not\n", "\n", "**Proved, on your hardware:**\n", "\n", "- A streamed model returns **bit-identical** logits to an ordinary one (§4).\n", "- An 8B model trained with a measured peak below a cap smaller than its own weights (§5).\n", "- Both on a GPU with **no bf16** — the case that was broken until recently.\n", "\n", "**Not proved:**\n", "\n", "- *Backward* exactness at this size. §4 compares the forward. Gradient exactness is\n", " verified up to 14B against resident references on hardware that can hold them, and\n", " a defect **above** that size was found, named upstream and repaired — see\n", " [`benchmarks/`](https://github.com/MakazhanAlpamys/Soup/tree/main/benchmarks).\n", "- Speed. A T4 under an artificial cap is not a throughput benchmark, and this notebook\n", " deliberately does not quote tok/s.\n", "\n", "Layer streaming is **BETA** and opt-in (`stream_layers: true`).\n", "\n", "**If any assertion above failed, that is worth an issue** — with the cell output. A\n", "reproduction on hardware we do not own is more useful to this project than a star.\n", "\n", "The method, the correctness protocol and every measurement:\n", "[10.5281/zenodo.21771064](https://doi.org/10.5281/zenodo.21771064) ·\n", "[measurement records](https://github.com/MakazhanAlpamys/Soup/tree/main/benchmarks)\n" ] } ], "metadata": { "accelerator": "GPU", "colab": { "gpuType": "T4", "provenance": [] }, "kernelspec": { "display_name": "Python 3", "name": "python3" }, "language_info": { "name": "python" }, "widgets": { "application/vnd.jupyter.widget-state+json": { "version_major": 2, "version_minor": 0, "state": { "5ce8709eb08141b49ec54002daaf6a02": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_1ade6c23233e4dc8928b74379f919b52", "IPY_MODEL_64dac42bdc2948108be4191c0ceda935", "IPY_MODEL_703835e267844b2081cc77a980f29a5a" ], "layout": "IPY_MODEL_7bcd0e9f66b44345be83558727ea4f73" } }, "1ade6c23233e4dc8928b74379f919b52": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_ea2e2f0858604f8cbb26396a34486582", "placeholder": "", "style": "IPY_MODEL_57d7a95684aa4448a094b483607d8a7b", "value": "Download complete: : " } }, "64dac42bdc2948108be4191c0ceda935": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_26c64bed491b40338f08829696b702d2", "max": 1, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_bf620d6b3d3247c3b885a9b52ed50e72", "value": 1 } }, "703835e267844b2081cc77a980f29a5a": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_e2482e92256f4dc3abf1da54bcbd0b4e", "placeholder": "", "style": "IPY_MODEL_611b1dafb25f44bd88803b30c5fb8be2", "value": " 271MB, 224MB/s " } }, "7bcd0e9f66b44345be83558727ea4f73": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "ea2e2f0858604f8cbb26396a34486582": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "57d7a95684aa4448a094b483607d8a7b": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "26c64bed491b40338f08829696b702d2": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "20px" } }, "bf620d6b3d3247c3b885a9b52ed50e72": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "e2482e92256f4dc3abf1da54bcbd0b4e": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "611b1dafb25f44bd88803b30c5fb8be2": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "1eb41dbea62d4d38a15c1861465a89af": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_653f8a5aec8a4f268ac5131721b95939", "IPY_MODEL_909b04d476b64bfeb01e889a31579ec2", "IPY_MODEL_319044ab454c41ecafd14d019bd3dae6" ], "layout": "IPY_MODEL_8afdfbea52874655b291ad460c7a06ca" } }, "653f8a5aec8a4f268ac5131721b95939": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_c01d30ec7dc943c7b73eee9bab52ff7d", "placeholder": "", "style": "IPY_MODEL_1c2eff1f10744844b12048ee187cd7d5", "value": "Reconstruction complete: 100%" } }, "909b04d476b64bfeb01e889a31579ec2": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_d609772e7c8a4b92a86dc1e4e381b330", "max": 1, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_9f1e69eb590248e2b8f3e9f4705d5efa", "value": 1 } }, "319044ab454c41ecafd14d019bd3dae6": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_f086e453790c472cb3f7302d0a9a9c59", "placeholder": "", "style": "IPY_MODEL_5a8439b13e404597ad30f6841c88e503", "value": " 272MB / 272MB, 139MB/s " } }, "8afdfbea52874655b291ad460c7a06ca": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "c01d30ec7dc943c7b73eee9bab52ff7d": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "1c2eff1f10744844b12048ee187cd7d5": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "d609772e7c8a4b92a86dc1e4e381b330": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "20px" } }, "9f1e69eb590248e2b8f3e9f4705d5efa": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "f086e453790c472cb3f7302d0a9a9c59": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "5a8439b13e404597ad30f6841c88e503": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "cf4ec404d5144f7c9d4b333d0a715c2b": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_9b2b590e6a4b475b8de2ea0408f0431f", "IPY_MODEL_a18dada832ec421bbaf389daad3d1dd9", "IPY_MODEL_c5dab0b774fa4f32b8837655f217fe87" ], "layout": "IPY_MODEL_fbefa341e54f44669cbd6b008d332388" } }, "9b2b590e6a4b475b8de2ea0408f0431f": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_9730f83efe164a26a2f929a2d5389e83", "placeholder": "", "style": "IPY_MODEL_339fabb1f51b435687047788de187438", "value": "Fetching 11 files: 100%" } }, "a18dada832ec421bbaf389daad3d1dd9": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_bf1f2e0942a248bb856bcce5fde22450", "max": 11, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_c874443864e44b4d96fe173cef76774f", "value": 11 } }, "c5dab0b774fa4f32b8837655f217fe87": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_5e7f3e8b868546c8ba1ada9c93690215", "placeholder": "", "style": "IPY_MODEL_a80e7b254bc84ea1aab5cb84c07d5167", "value": " 11/11 [00:03<00:00, 13.46it/s]" } }, "fbefa341e54f44669cbd6b008d332388": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "9730f83efe164a26a2f929a2d5389e83": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "339fabb1f51b435687047788de187438": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "bf1f2e0942a248bb856bcce5fde22450": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "c874443864e44b4d96fe173cef76774f": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "5e7f3e8b868546c8ba1ada9c93690215": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "a80e7b254bc84ea1aab5cb84c07d5167": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "16c9123ed8cb4c02b25729e7fe8fb2df": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_8dd8ccb477cb4da3af7d7511124c9c5d", "IPY_MODEL_c0a5556c08e44280a72c0ecc8810f2a6", "IPY_MODEL_463038b513e849d19431f12ecb26c8a1" ], "layout": "IPY_MODEL_3341a9dac7c64af38c5e479d9a5083f8" } }, "8dd8ccb477cb4da3af7d7511124c9c5d": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_7c91ec1827844d05ba8e51ba994d1f7f", "placeholder": "", "style": "IPY_MODEL_c219201c066b41bb84dae9e5c981facb", "value": "Loading weights: 100%" } }, "c0a5556c08e44280a72c0ecc8810f2a6": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_0aa7563bd4d04e848f32f2782f7717fe", "max": 272, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_13c5ab409fbb49888ce477f55e1f62af", "value": 272 } }, "463038b513e849d19431f12ecb26c8a1": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_6dbd72ea2b8846408bb53debf64a756d", "placeholder": "", "style": "IPY_MODEL_9b5d5a1c32624c54b530692430dab2a2", "value": " 272/272 [00:00<00:00, 638.61it/s]" } }, "3341a9dac7c64af38c5e479d9a5083f8": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "7c91ec1827844d05ba8e51ba994d1f7f": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "c219201c066b41bb84dae9e5c981facb": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "0aa7563bd4d04e848f32f2782f7717fe": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "13c5ab409fbb49888ce477f55e1f62af": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "6dbd72ea2b8846408bb53debf64a756d": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "9b5d5a1c32624c54b530692430dab2a2": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "35ee497596604617ba94600ad274f67b": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_e9d3eab7d0c9432f8ba491ad54f70114", "IPY_MODEL_a40a14b07135429887a87f9e2f195f0a", "IPY_MODEL_45e1fbb311674c4d90997812cd009ca7" ], "layout": "IPY_MODEL_e4b6c79bd2b04ccd9c973727fea03b31" } }, "e9d3eab7d0c9432f8ba491ad54f70114": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_ce3cb4ffeaa2483c9b07ddfa67099794", "placeholder": "", "style": "IPY_MODEL_245389ff14d04303b07e2caf74fcd613", "value": "config.json: 100%" } }, "a40a14b07135429887a87f9e2f195f0a": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_ef8cda62d86340a7a8f5eb9fbd5b5379", "max": 855, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_4be68f8397054652abcf76bcb9c6dd07", "value": 855 } }, "45e1fbb311674c4d90997812cd009ca7": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_83d159c08b1e4cd396456c8efdfe3363", "placeholder": "", "style": "IPY_MODEL_6ead2f696d0242caaafe54134031c85b", "value": " 855/855 [00:00<00:00, 19.2kB/s]" } }, "e4b6c79bd2b04ccd9c973727fea03b31": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "ce3cb4ffeaa2483c9b07ddfa67099794": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "245389ff14d04303b07e2caf74fcd613": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "ef8cda62d86340a7a8f5eb9fbd5b5379": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "4be68f8397054652abcf76bcb9c6dd07": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "83d159c08b1e4cd396456c8efdfe3363": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "6ead2f696d0242caaafe54134031c85b": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "f9d81b93d99a4500921e5b7ecb4eaf10": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_80af22410bd84a2085b101295240e1da", "IPY_MODEL_d755dc0ccaba45c686e88cdffb446b03", "IPY_MODEL_5c5356b513744719a17b456bf85b02f8" ], "layout": "IPY_MODEL_e6e09bde3db84cb5b05ff17979a1c756" } }, "80af22410bd84a2085b101295240e1da": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_c0e7eb7462294f90bc895d4fc35e24a7", "placeholder": "", "style": "IPY_MODEL_71f2bb58ebb4449e96e741cd6a871307", "value": "tokenizer_config.json: 100%" } }, "d755dc0ccaba45c686e88cdffb446b03": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_50c77663bb614591955ac0361dca2303", "max": 50870, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_7d5d6a70d69840b58c3074ef51d64e76", "value": 50870 } }, "5c5356b513744719a17b456bf85b02f8": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_8e8b99dba8164613bee68ddbed15939e", "placeholder": "", "style": "IPY_MODEL_8d29bcdabd494acaa2f98c1e8e9b3e91", "value": " 50.9k/50.9k [00:00<00:00, 1.39MB/s]" } }, "e6e09bde3db84cb5b05ff17979a1c756": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "c0e7eb7462294f90bc895d4fc35e24a7": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "71f2bb58ebb4449e96e741cd6a871307": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "50c77663bb614591955ac0361dca2303": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "7d5d6a70d69840b58c3074ef51d64e76": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "8e8b99dba8164613bee68ddbed15939e": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "8d29bcdabd494acaa2f98c1e8e9b3e91": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "c686a763c243420284c300807d60608a": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_6274db24e591412d8d29b28cce60ce33", "IPY_MODEL_42d74bf8b23542c3b7c6b9cab6ffe304", "IPY_MODEL_816bd5861347404291f3dd7ea97165dd" ], "layout": "IPY_MODEL_d34f9a02bbe346f4a975d4ccdd632d7e" } }, "6274db24e591412d8d29b28cce60ce33": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_29aa7549f9e147439585b07d652bb070", "placeholder": "", "style": "IPY_MODEL_9ba6f453cb204408b7e77922d7208134", "value": "tokenizer.json: 100%" } }, "42d74bf8b23542c3b7c6b9cab6ffe304": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_93537120d889491e9ea5fad0f1343c6a", "max": 9085657, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_6890fc7518b94db48ed087f7128e1aa9", "value": 9085657 } }, "816bd5861347404291f3dd7ea97165dd": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_8210fe01d55a4d9e8573559072bfc77f", "placeholder": "", "style": "IPY_MODEL_a3eddcd776754633990da638e1ab1686", "value": " 9.09M/9.09M [00:00<00:00, 22.7MB/s]" } }, "d34f9a02bbe346f4a975d4ccdd632d7e": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "29aa7549f9e147439585b07d652bb070": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "9ba6f453cb204408b7e77922d7208134": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "93537120d889491e9ea5fad0f1343c6a": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "6890fc7518b94db48ed087f7128e1aa9": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "8210fe01d55a4d9e8573559072bfc77f": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "a3eddcd776754633990da638e1ab1686": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "88416241eaae466c83f73d29931a20bc": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_3fd4bdbdff694191be84c113a4ee8d6d", "IPY_MODEL_23bb0118c7dc415089538f68691a6ebb", "IPY_MODEL_4da521b3b720410abeca6e0982dddb8d" ], "layout": "IPY_MODEL_0b327fce5f4449399847d7f1f12746ee" } }, "3fd4bdbdff694191be84c113a4ee8d6d": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_8613547a5d474090a35b08b5281e8a7d", "placeholder": "", "style": "IPY_MODEL_6e5647ac37484373a8b8fa270c977984", "value": "special_tokens_map.json: 100%" } }, "23bb0118c7dc415089538f68691a6ebb": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_60b9a418c0234eb1835162e1cfdaf694", "max": 296, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_34ffd5006ec74b5993f4d4a87c99ae8e", "value": 296 } }, "4da521b3b720410abeca6e0982dddb8d": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_0374db7ed4ed4d0ebb2336a00e2a86c9", "placeholder": "", "style": "IPY_MODEL_130630254ce64432b24f4f7bdcbd2344", "value": " 296/296 [00:00<00:00, 9.14kB/s]" } }, "0b327fce5f4449399847d7f1f12746ee": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "8613547a5d474090a35b08b5281e8a7d": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "6e5647ac37484373a8b8fa270c977984": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "60b9a418c0234eb1835162e1cfdaf694": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "34ffd5006ec74b5993f4d4a87c99ae8e": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "0374db7ed4ed4d0ebb2336a00e2a86c9": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "130630254ce64432b24f4f7bdcbd2344": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "65160c38c03248ea98ffc998b6304b81": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_a4581c1c8ca0410ebe88a1f44c0376d1", "IPY_MODEL_460ae660d82b4b8c98d7b92f361127f2", "IPY_MODEL_40b0767205474f0f8212e8af673b8b36" ], "layout": "IPY_MODEL_5b6d0637d0f5465f9170a0e88dce8620" } }, "a4581c1c8ca0410ebe88a1f44c0376d1": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_e0816fefa70f4fc9b599ce0b12a751cf", "placeholder": "", "style": "IPY_MODEL_95d3abe8e87a48209a6d5b7db1899a3c", "value": "Download complete: : " } }, "460ae660d82b4b8c98d7b92f361127f2": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_e83fa3e9c84b4ac1855bd10e8f636ae3", "max": 1, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_13457c4fb87649f082787743450ce477", "value": 1 } }, "40b0767205474f0f8212e8af673b8b36": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_c900cc97b8804caeb1f4da05b9afcd27", "placeholder": "", "style": "IPY_MODEL_2a0bea75275b4c29b5ad4a38b6589eb9", "value": " 13.8GB, 8.66MB/s " } }, "5b6d0637d0f5465f9170a0e88dce8620": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "e0816fefa70f4fc9b599ce0b12a751cf": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "95d3abe8e87a48209a6d5b7db1899a3c": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "e83fa3e9c84b4ac1855bd10e8f636ae3": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "20px" } }, "13457c4fb87649f082787743450ce477": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "c900cc97b8804caeb1f4da05b9afcd27": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "2a0bea75275b4c29b5ad4a38b6589eb9": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "b64e93cc27994aa4a6019128222302e4": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_7c542b2d56bf4c7dbe690ab888ff3900", "IPY_MODEL_f7558f8cc9ab4c2d9f4d5394551ca76c", "IPY_MODEL_a668be7526a84398ba637c1d7b3a7517" ], "layout": "IPY_MODEL_8b2e5061814845a2af0bbea3ef969bf5" } }, "7c542b2d56bf4c7dbe690ab888ff3900": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_e73005d74e014e018b5ea0093fc9797a", "placeholder": "", "style": "IPY_MODEL_03f2a35c338a494396cf3e8a7294af41", "value": "Reconstruction complete: 100%" } }, "f7558f8cc9ab4c2d9f4d5394551ca76c": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_4614dcff59d8438588ba05f78142f3e6", "max": 1, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_6057cd6ca93c4e3aba06e431bed676bb", "value": 1 } }, "a668be7526a84398ba637c1d7b3a7517": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_1ef6b499144647628881409798a6dc7a", "placeholder": "", "style": "IPY_MODEL_7fc91fc2438a42b28ebb86b6d4561bd5", "value": " 16.1GB / 16.1GB, 120MB/s " } }, "8b2e5061814845a2af0bbea3ef969bf5": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "e73005d74e014e018b5ea0093fc9797a": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "03f2a35c338a494396cf3e8a7294af41": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "4614dcff59d8438588ba05f78142f3e6": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": "20px" } }, "6057cd6ca93c4e3aba06e431bed676bb": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "1ef6b499144647628881409798a6dc7a": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "7fc91fc2438a42b28ebb86b6d4561bd5": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "f80cbd912101453c8be873d807aaf2e8": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_e84755b2bd364309a189abc658aed7e6", "IPY_MODEL_fe1161b83b1f41fcb0b915d74fb1ad85", "IPY_MODEL_54bf53b947f546bab6871edee4f42dd0" ], "layout": "IPY_MODEL_e9b63850ce1b42079c7c4d4b0af16049" } }, "e84755b2bd364309a189abc658aed7e6": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_298c737f48ba4b78b18e1bbf5a65f106", "placeholder": "", "style": "IPY_MODEL_efb9f916092347689564d2eb3971a2b3", "value": "Fetching 11 files: 100%" } }, "fe1161b83b1f41fcb0b915d74fb1ad85": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_4cccf7f16fa745a8bbcb5133cdbf50e6", "max": 11, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_f3506fb615524f0985b84a42f9623c96", "value": 11 } }, "54bf53b947f546bab6871edee4f42dd0": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_4be70f5c998a4002a904d4dcdea8ed8f", "placeholder": "", "style": "IPY_MODEL_0ef32da4b20f4b259c9dc6db37fdf8a8", "value": " 11/11 [05:58<00:00, 34.98s/it]" } }, "e9b63850ce1b42079c7c4d4b0af16049": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "298c737f48ba4b78b18e1bbf5a65f106": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "efb9f916092347689564d2eb3971a2b3": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "4cccf7f16fa745a8bbcb5133cdbf50e6": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "f3506fb615524f0985b84a42f9623c96": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "4be70f5c998a4002a904d4dcdea8ed8f": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "0ef32da4b20f4b259c9dc6db37fdf8a8": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "7bbfaa6685b94518a43751f208d14194": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_b80fc4b54ac446be9dc9e9684611760e", "IPY_MODEL_208d4b88b10941abaac3370d13be017a", "IPY_MODEL_83d74109bbff421b922f09a0bfc96731" ], "layout": "IPY_MODEL_e49360e10ca64dd49bd34a431b80fdee" } }, "b80fc4b54ac446be9dc9e9684611760e": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_a4805fc732ca42da9ef3048c189d8825", "placeholder": "", "style": "IPY_MODEL_dbafadb2a5164b1c81efec284d2eafb1", "value": "Map: 100%" } }, "208d4b88b10941abaac3370d13be017a": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_f03b91976b61427c9226b02864b1a24b", "max": 28, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_598714ba52c844199123a68c7c05ee23", "value": 28 } }, "83d74109bbff421b922f09a0bfc96731": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_b37f1aa2034e45608b2e5813f821f608", "placeholder": "", "style": "IPY_MODEL_b34b00154e134af6bdccdfd4ec0319bb", "value": " 28/28 [00:00<00:00, 262.68 examples/s]" } }, "e49360e10ca64dd49bd34a431b80fdee": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "a4805fc732ca42da9ef3048c189d8825": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "dbafadb2a5164b1c81efec284d2eafb1": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "f03b91976b61427c9226b02864b1a24b": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "598714ba52c844199123a68c7c05ee23": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "b37f1aa2034e45608b2e5813f821f608": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "b34b00154e134af6bdccdfd4ec0319bb": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "d52de28dd3c5408e9a89a10ec7910215": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_31137da3af584d33ae9bbc3a322cb5b5", "IPY_MODEL_0a003709e02e4285938da4bb2c4ef7f1", "IPY_MODEL_7741ea6eaf1d4a6abc722effc1297b88" ], "layout": "IPY_MODEL_faf1ddf281784aad91c2c3b4bca6b957" } }, "31137da3af584d33ae9bbc3a322cb5b5": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_ff466ea4fd094cfeb2b72c4e900f83b1", "placeholder": "", "style": "IPY_MODEL_222a3b9e28b040c9aa615f7a8afd3c16", "value": "Map: 100%" } }, "0a003709e02e4285938da4bb2c4ef7f1": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_78b5998326384bd2a3f956b658a6c45a", "max": 4, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_ff756b7ae2bf45999416d11a11d89565", "value": 4 } }, "7741ea6eaf1d4a6abc722effc1297b88": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_4b9e7bb47d3f4a87af852c4100b2d0f8", "placeholder": "", "style": "IPY_MODEL_350114c77ee649f0aab61aeb376d08fb", "value": " 4/4 [00:00<00:00, 163.70 examples/s]" } }, "faf1ddf281784aad91c2c3b4bca6b957": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "ff466ea4fd094cfeb2b72c4e900f83b1": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "222a3b9e28b040c9aa615f7a8afd3c16": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "78b5998326384bd2a3f956b658a6c45a": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "ff756b7ae2bf45999416d11a11d89565": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "4b9e7bb47d3f4a87af852c4100b2d0f8": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "350114c77ee649f0aab61aeb376d08fb": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "8003bb7941eb4090a1fcf6bcea55c6ea": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_7d328a3f5a9642388b4aeab3e05c69bd", "IPY_MODEL_74dea5b5be6941b997844cb51cbacbd8", "IPY_MODEL_d34c375a32a844cdbaa133bd768f19d5" ], "layout": "IPY_MODEL_c56e8789c81f492d9520936635415098" } }, "7d328a3f5a9642388b4aeab3e05c69bd": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_68e33220036347d3afa231bd3d2b7865", "placeholder": "", "style": "IPY_MODEL_2cf81a35ef9c4bb1bbcd12a0643a99c4", "value": "Truncating train dataset: 100%" } }, "74dea5b5be6941b997844cb51cbacbd8": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_3ba5e545209245eeac1d44040aca3d6d", "max": 28, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_b6093fbc34af407895066bf8ce21e6a3", "value": 28 } }, "d34c375a32a844cdbaa133bd768f19d5": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_5d98ed609ec745f0868394ea47dd72d3", "placeholder": "", "style": "IPY_MODEL_507014f569ff434395c0be2320e28396", "value": " 28/28 [00:00<00:00, 1403.25 examples/s]" } }, "c56e8789c81f492d9520936635415098": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "68e33220036347d3afa231bd3d2b7865": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "2cf81a35ef9c4bb1bbcd12a0643a99c4": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "3ba5e545209245eeac1d44040aca3d6d": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "b6093fbc34af407895066bf8ce21e6a3": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "5d98ed609ec745f0868394ea47dd72d3": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "507014f569ff434395c0be2320e28396": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "59d99840b2574bae89690e14d8fe26b6": { "model_module": "@jupyter-widgets/controls", "model_name": "HBoxModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_439184a795f042e6b2ac12c4a1217722", "IPY_MODEL_a14faf64a126456d9ae482b76752a62c", "IPY_MODEL_9752b710bc124934853c5f2e239038fd" ], "layout": "IPY_MODEL_16c1d4a11b214f1aa8944820eb9db631" } }, "439184a795f042e6b2ac12c4a1217722": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_f31373192dce4c1abeb178b229596289", "placeholder": "", "style": "IPY_MODEL_42e486c8f6074ac0ae4a2cb01bd3ac28", "value": "Truncating eval dataset: 100%" } }, "a14faf64a126456d9ae482b76752a62c": { "model_module": "@jupyter-widgets/controls", "model_name": "FloatProgressModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_2ab53c5552e24c4a93fb02f6ea12831e", "max": 4, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_f1c0fd3eb8254e22babe007edf3f36b4", "value": 4 } }, "9752b710bc124934853c5f2e239038fd": { "model_module": "@jupyter-widgets/controls", "model_name": "HTMLModel", "model_module_version": "1.5.0", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_ca8e430e28c1420489010799a6a1651b", "placeholder": "", "style": "IPY_MODEL_08fe8e8b9a414dc491c485d95806af93", "value": " 4/4 [00:00<00:00, 174.18 examples/s]" } }, "16c1d4a11b214f1aa8944820eb9db631": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "f31373192dce4c1abeb178b229596289": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "42e486c8f6074ac0ae4a2cb01bd3ac28": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "2ab53c5552e24c4a93fb02f6ea12831e": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "f1c0fd3eb8254e22babe007edf3f36b4": { "model_module": "@jupyter-widgets/controls", "model_name": "ProgressStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "ca8e430e28c1420489010799a6a1651b": { "model_module": "@jupyter-widgets/base", "model_name": "LayoutModel", "model_module_version": "1.2.0", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "08fe8e8b9a414dc491c485d95806af93": { "model_module": "@jupyter-widgets/controls", "model_name": "DescriptionStyleModel", "model_module_version": "1.5.0", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } } } } } }, "nbformat": 4, "nbformat_minor": 0 }