BlockFmhaFwdPagedKVPipelineQRKSVSDefaultPolicy Struct Reference

BlockFmhaFwdPagedKVPipelineQRKSVSDefaultPolicy Struct Reference#

Composable Kernel: ck_tile::BlockFmhaFwdPagedKVPipelineQRKSVSDefaultPolicy Struct Reference
ck_tile::BlockFmhaFwdPagedKVPipelineQRKSVSDefaultPolicy Struct Reference

#include <block_fmha_fwd_pagedkv_pipeline_qr_ks_vs_default_policy.hpp>

Inheritance diagram for ck_tile::BlockFmhaFwdPagedKVPipelineQRKSVSDefaultPolicy:
ck_tile::BlockFmhaPipelineQXKSVSCustomPolicy< true, false, 1, 1 > ck_tile::BlockFmhaPipelineQXCustomPolicy< QLoadOnce_ >

Static Public Member Functions

template<typename Problem>
static CK_TILE_HOST_DEVICE constexpr auto GetQKBlockGemm ()
Static Public Member Functions inherited from ck_tile::BlockFmhaPipelineQXKSVSCustomPolicy< true, false, 1, 1 >
static CK_TILE_HOST_DEVICE constexpr auto GetLdsBufferSequence ()
static CK_TILE_HOST_DEVICE constexpr auto GetSmemKPackK ()
static CK_TILE_HOST_DEVICE constexpr auto GetAlignmentK ()
static CK_TILE_HOST_DEVICE constexpr auto GetSmemKPackV ()
static CK_TILE_HOST_DEVICE constexpr auto GetAlignmentV ()
static CK_TILE_HOST_DEVICE constexpr auto GetAlignmentBias ()
static CK_TILE_HOST_DEVICE constexpr auto GetAlignmentO ()
static CK_TILE_HOST_DEVICE constexpr auto GetSingleSmemElementSpaceSize ()
static CK_TILE_HOST_DEVICE constexpr auto MakeKLdsBlockDescriptor ()
static CK_TILE_HOST_DEVICE constexpr auto MakeKLdsStoreBlockDescriptor (number< IBuf >=number< 0 >{})
static CK_TILE_HOST_DEVICE constexpr auto MakeKLdsLoadBlockDescriptor ()
static CK_TILE_HOST_DEVICE constexpr auto MakeVLdsBlockDescriptor ()
static CK_TILE_HOST_DEVICE constexpr ck_tile::index_t GetSmemSizeKV ()
static CK_TILE_HOST_DEVICE constexpr ck_tile::index_t GetSmemSize ()
static CK_TILE_HOST_DEVICE constexpr std::enable_if_t< std::is_convertible_v< decltype(Problem::kHasDropout), bool >, ck_tile::index_tGetSmemSizeDropout (int)
static CK_TILE_HOST_DEVICE constexpr ck_tile::index_t GetSmemSizeDropout (...)
static CK_TILE_HOST_DEVICE constexpr auto MakeKDramTileDistribution ()
static CK_TILE_DEVICE constexpr auto MakeVDramTileDistribution ()
static CK_TILE_HOST_DEVICE constexpr auto MakeBiasDramTileDistribution ()
static CK_TILE_HOST_DEVICE constexpr auto MakeShuffledVRegBlockDescriptor ()
static CK_TILE_HOST_DEVICE constexpr auto GetKVBlockGemm ()

Additional Inherited Members

Public Types inherited from ck_tile::BlockFmhaPipelineQXKSVSCustomPolicy< true, false, 1, 1 >
using QXPolicy
Static Public Attributes inherited from ck_tile::BlockFmhaPipelineQXKSVSCustomPolicy< true, false, 1, 1 >
static constexpr bool AsyncCopy
static constexpr index_t NumPrefetchK
static constexpr index_t NumPrefetchV
static constexpr index_t NumKVLdsBuffers

Member Function Documentation

◆ GetQKBlockGemm()

template<typename Problem>
CK_TILE_HOST_DEVICE constexpr auto ck_tile::BlockFmhaFwdPagedKVPipelineQRKSVSDefaultPolicy::GetQKBlockGemm ( )
inlinestaticconstexpr

The documentation for this struct was generated from the following file: