FmhaBwdBatchModeDropoutKargs Struct Reference#
ck_tile::FmhaBwdDQDKDVKernel< FmhaPipeline_, KGradEpiloguePipeline_, VGradEpiloguePipeline_, QGradEpiloguePipeline_ >::FmhaBwdBatchModeDropoutKargs Struct Reference
#include <fmha_bwd_kernel.hpp>
Inheritance diagram for ck_tile::FmhaBwdDQDKDVKernel< FmhaPipeline_, KGradEpiloguePipeline_, VGradEpiloguePipeline_, QGradEpiloguePipeline_ >::FmhaBwdBatchModeDropoutKargs:
Public Attributes | |
| ck_tile::index_t | batch_stride_randval = 0 |
| Public Attributes inherited from ck_tile::FmhaBwdDQDKDVKernel< FmhaPipeline_, KGradEpiloguePipeline_, VGradEpiloguePipeline_, QGradEpiloguePipeline_ >::FmhaBwdCommonDropoutKargs | |
| float | rp_undrop = 1 |
| float | scale_rp_undrop = 1 |
| uint8_t | p_undrop_in_uint8_t = std::numeric_limits<uint8_t>::max() |
| void * | rand_val_ptr = nullptr |
| ck_tile::index_t | stride_randval = 0 |
| ck_tile::index_t | nhead_stride_randval = 0 |
| Public Attributes inherited from ck_tile::FmhaBwdDQDKDVKernel< FmhaPipeline_, KGradEpiloguePipeline_, VGradEpiloguePipeline_, QGradEpiloguePipeline_ >::FmhaBwdDropoutSeedOffset | |
| ValueOrPointer< uint64_t > | drop_seed |
| ValueOrPointer< uint64_t > | drop_offset |
| bool | is_drop_seed_offset_from_host |
Additional Inherited Members | |
| Public Member Functions inherited from ck_tile::FmhaBwdDQDKDVKernel< FmhaPipeline_, KGradEpiloguePipeline_, VGradEpiloguePipeline_, QGradEpiloguePipeline_ >::FmhaBwdCommonDropoutKargs | |
| void | init_dropout (float p_drop, uint64_t seed, uint64_t offset, float raw_scale) |
| void | init_dropout (float p_drop, const uint64_t *seed_ptr, const uint64_t *offset_ptr, float raw_scale) |
Member Data Documentation
◆ batch_stride_randval
template<typename FmhaPipeline_, typename KGradEpiloguePipeline_, typename VGradEpiloguePipeline_, typename QGradEpiloguePipeline_ = void>
| ck_tile::index_t ck_tile::FmhaBwdDQDKDVKernel< FmhaPipeline_, KGradEpiloguePipeline_, VGradEpiloguePipeline_, QGradEpiloguePipeline_ >::FmhaBwdBatchModeDropoutKargs::batch_stride_randval = 0 |
The documentation for this struct was generated from the following file: