transformers
参考
模型转换
Rust
书籍
- the book
- learn by examples
nomicon(Rustnomicon)
- Introduction - The Rustonomicon
- 编写 Unsafe Rust 必须的知识
内容
- 所有权 ownwership
- 指针
- 生命周期 lifetime
Bert
参考
- BERT详解:概念、原理与应用__StarryNight_的博客-CSDN博客
- huggingface 解释 bert: BERT 101 - State Of The Art NLP Model Explained
huggingface 训练 model 流程
GitHub - datawhalechina/learn-nlp-with-transformers: we want to create a repo…
Dark Theme
gtk 应用
| |
Read Notes
论文:GPT Self-Supervision for a Better Data Annotator
参考:
流程分析
one shot tuning
- 找到最优 template (template_input_i, template_summary_i)
- input data –> summary –> recover data
feedback values ?
- similar alignment
instruction, template, support data {w, t, x}.
- w: instruction
t: template
- 样本
- 样本 summary
- x: input data
$$s_i \leftarrow F(x_i| t_i, w_g, \theta)$$ 生成 summary 过程