Open
Conversation
Member
|
改动大,新建工具,而不是在老工具上堆特性 格式看起来就是个 ini,读写 ini 直接写一个就行,没必要搞第三方toml代码 |
Contributor
Author
嗯,所以先发 PR 看看让不让用 toml 。 都是 part1 了,所以 add/zeropoint 这些不支持的, part2 才会发啊。 Layernorm 系数是 per-channel 的,偶尔有的系数不一样。transformer 里 layernorm inp 离心值需要保留才能不损失精度。 |
Open
…nto ncnn-int8-toml
Contributor
Author
|
这个 PR 我没有要改的了,坐等 CI 。 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
背景
refactor 量化表结构成 .ini 格式,上个版本的量化表没法再加新的 opr
修改前:https://github.com/tpoisonooo/cpp-syntactic-sugar/blob/master/ini-config/ncnn.txt
修改后:https://github.com/tpoisonooo/cpp-syntactic-sugar/blob/master/ini-config/ncnn.ini
修改内容
ncnn2table命令新增选项: format=inincnn2int8增加对 .ini 解析测试方法
测试了 sqznet 分别用 .ini/.txt 跑
ncnn2table和ncnn2int8,对比最终 .bin 和 .param 文件的 md5 值相同。