Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] add more example for permute/scatter-gather/moe #1471

Open
wants to merge 22 commits into
base: develop
Choose a base branch
from
Open

[WIP] add more example for permute/scatter-gather/moe #1471

wants to merge 22 commits into from
+8,194 −99

Conversation

carlushuang
Copy link
Contributor

@carlushuang carlushuang commented Aug 18, 2024 •
edited
Loading

  • add test topk
  • add test topk-softmax
  • add test tile_reduce
  • add test scatter-gather
  • add tensor transform support for scatter-gather
  • modify buffer raw related tile api
  • add async load (non-raw version) api
  • add block_tile_reduce_xor_sync() api
  • add example permute
  • add permute utility kernel for moe index
  • debug moe-ffn pipeline
  • add example moe

@carlushuang carlushuang changed the title [WIP] add more example for permute/moe [WIP] add more example for permute/scatter-gather/moe Aug 18, 2024
poyenc
poyenc reviewed Aug 20, 2024
View reviewed changes
example/ck_tile/05_moe/CMakeLists.txt
@@ -0,0 +1,75 @@
# generate a list of kernels, but not actually emit files at config stage
execute_process(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't see generate.py in this folder. do you use it elsewhere?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@poyenc poyenc poyenc left review comments

@junliume junliume Awaiting requested review from junliume junliume is a code owner

@illsilin illsilin Awaiting requested review from illsilin illsilin is a code owner

@aosewski aosewski Awaiting requested review from aosewski aosewski is a code owner

@geyyer geyyer Awaiting requested review from geyyer geyyer is a code owner

@bartekxk bartekxk Awaiting requested review from bartekxk bartekxk is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@carlushuang @poyenc