SparseOperationKit Optimizers

There are several optimized optimizers inside SOK.

Adam optimizer

class*args, **kwargs)[source]

Abbreviated as

The unique and unsorted_segment_sum are replaced with GPU implementations.

When TF version <= 2.4, this optimizer can be used to obtain performance gain, while TF version >= 2.5, its performance should be identical to tf.keras.optimizers.Adam.

All the arguments are identical to tf.keras.optimizers.Adam, please refer to for documentation.

Local update Adam optimizer