aldigobbler's picture
Update README.md
8ea3818 verified
metadata
library_name: ben2
tags:
  - BEN2
  - Dichotomous image segmentation
  - background remove
  - background-remove
  - mask-generation
  - model_hub_mixin
  - pytorch_model_hub_mixin

BEN2 pruning test # 1 - distillation

Original parameters: 94,134,658

Pruned parameters: 36,275,254

Parameter reduction: 61.5%

  • Swin Transformer depths: [2, 2, 18, 2] → [2, 2, 6, 2]
  • Swin Transformer heads: [4, 8, 16, 32] → [3, 6, 12, 24]

distill loss: 0.0008