random-forest finetuned CNN
random-forest based JAX implementation for sigmoid backpropagation.
- Input
- 8025-dim embedding
- Encoder
- 14 x CNN with 18 heads
- Output
- accuracy projection
Training config
optimizer=NAdam, lr=0.256, scheduler=exponential, warmup=1468