Skip to content

Conversation

@Hodoryu
Copy link

@Hodoryu Hodoryu commented Nov 6, 2025

feature adapter for mcoplib, it is a metax office ops library

@Hodoryu Hodoryu requested a review from jinminxi104 as a code owner November 6, 2025 03:08
@Hodoryu
Copy link
Author

Hodoryu commented Nov 6, 2025

adaper for new verison mcoplib

@wanfengcxz
Copy link
Collaborator

wanfengcxz commented Nov 10, 2025

您好,通过dir函数发现mcoplib_ops只开放了三个函数['doc', 'file', 'loader', 'name', 'package', 'spec', 'lmdeploy_rotary_embedding', 'paged_attention_v1', 'reshape_and_cache_new'],其他的算子通过torch.ops._C接入。paged_attention_v1函数无法正确调用,还需要您帮忙看下。或者能提供一份关于paged_attention_v1函数的说明

@Hodoryu
Copy link
Author

Hodoryu commented Nov 11, 2025

from mcoplib import lmdeploy as mcoplib_ops
from mcoplib import op as op_origin
import mcoplib._C
mcoplib中有三个模块提供对应的算子实现, 这样做为了我们内部算子公用, 其中paged_attention_v1是使用了 from mcoplib import lmdeploy as mcoplib_ops, 保持了之前paged_attention_v1算子实现, 我们内部测试没问题呃

@Hodoryu
Copy link
Author

Hodoryu commented Nov 11, 2025

paged_attention_v1这个接口已经弃用了, 使用了flashattn库中的实现, reshape_and_cache_new这个接口也变更了, 改成:reshape_and_cache_flash 这个接口, 这个需要再修改下代码

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants