【开源实习】Bartpho模型微调 #2030

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

lvyufeng merged 1 commit into mindspore-lab:master from SeasonMay:master

Apr 28, 2025

+512 −0

Contributor

SeasonMay commented Apr 24, 2025 •

edited

Loading

bartpho 模型微调

任务

任务编号：#IAUOYU
任务链接：[【开源实习】bartpho模型微调 · Issue #IAUOYU · MindSpore/community - Gitee.com](https://gitee.com/mindspore/community/issues/IAUOYU)
实现了bartpho在文本纠错任务数据集上的微调
模型：vinai/bartpho-syllable
数据集: HuyPham235711/BARTpho_Corrector

结果对比：

mindnlp+910b
·mindnlp==0.4.1
·mindspore==2.5.0

Epoch	train_loss	eval_loss	BLEU
1	0.4209	0.3085	86.5538
2	0.3052	0.2757	87.7926
3	0.2307	0.2531	88.8163
4	0.1864	0.2303	89.1350
5	0.1535	0.2048	90.4295

pytorch+3090

Epoch	train_loss	eval_loss	BLEU
1	0.9188	0.3580	86.3481
2	0.4843	0.3022	86.9550
3	0.3602	0.2728	87.5816
4	0.2866	0.2623	88.8584
5	0.2312	0.2659	89.8917


          【开源实习】Bartpho模型微调

2b1e289

lvyufeng merged commit b7fb2b1 into mindspore-lab:master

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet