doyying_bert_first_again Open Source Model - Generated with Keras Callbacks, Practical Features Await Exploration!

Doyying Bert First Again

Developed by DoyyingFace

This is a model generated by Keras callbacks, with incomplete information provided

Downloads 16

Release Time : 3/2/2022

Model Overview

This model was trained from scratch on an unknown dataset, and its specific functions and purposes are unclear

Uses Adam optimizer

The Adam optimizer was used during training, along with a polynomial learning rate decay strategy

Custom learning rate scheduling

Initial learning rate was 5e-05, with final learning rate decaying to 0.0 over 1374 decay steps

This model was trained from scratch on an unknown dataset and achieves certain results on the evaluation set.

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

optimizer: {'name': 'Adam', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 5e-05, 'decay_steps': 1374, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
training_precision: float32