e4b_wiseft_v3_v5_lam035

When

Recorded date: 2026-11-04

First archive commit: 2026-11-04T17:35:03-05:00 (offset shown).

Training run day: Unknown (America/New_York). For derived variants, this is the parent run day, not the variant’s creation day.

First Git archive commit time (UTC offset shown), not the time training changed weights. Per-update wall timestamps were not preserved.

Exact tensor-change timestamp: unavailable.

Why change it?

The exact recipe and motivation are not recorded in the preserved manifest.

Which part changed?

Adapter matrices over the frozen base, targeting: ^model\.language_model\.layers\.\d+\.(self_attn\.(q_proj|k_proj|v_proj|o_proj)|mlp\.(gate_proj|up_proj|down_proj))$

The source describes adapter targets and mathematical changes. No before/after tensor comparison is available in this viewer.

How was it changed?

An exported adapter is preserved; its name alone is insufficient to establish a weight-interpolation formula. Exported low-rank adapter, rank 64, scaling alpha 32.

Did it improve?

Historical measurements · The historical v5 family includes a WiSE-FT result of 7/45, but the source does not explicitly prove that result belongs to this exact tensor export.

Evaluation set: Historical sets vary; see source table · Batch: Not applicable. Local screening and historical task scores are not competition scores unless explicitly identified in the source. Different evaluation sets cannot be compared as a gain.

Original evidence

• v2/experiments/adapters/e4b_wiseft_v3_v5_lam035/checkpoint_manifest.json
• v2/experiments/adapters/e4b_wiseft_v3_v5_lam035/adapter_config.json
• docs/v2-post-training-and-lb-postmortem.md

Literal source excerpts follow. They may contain original predictions and superseded counts; use the measured-outcome summary and corrections above for the current result.

{
  "base_model_name_or_path": "gemma-4-e4b-it-qat-w4a16-ct",
  "bias": "none",
  "lora_alpha": 32,
  "lora_dropout": 0.0,
  "peft_type": "LORA",
  "r": 64,
  "target_modules": "^model\\.language_model\\.layers\\.\\d+\\.(self_attn\\.(q_proj|k_proj|v_proj|o_proj)|mlp\\.(gate_proj|up_proj|down_proj))$",
  "task_type": "CAUSAL_LM",
  "use_rslora": false
}

{
  "adapter_id": "e4b_wiseft_v3_v5_lam035",
  "wrx90_path": "/home/keith/gemma-v2/adapters/e4b_wiseft_v3_v5_lam035",
  "files": {
    "adapter_model.safetensors": {
      "size_bytes": 279129832,
      "sha256": "b880162d2239edc9208c99d2800ddd99467019351ec7511158bae509cb658b40"
    }
  }
}