Read Notes

论文:GPT Self-Supervision for a Better Data Annotator

参考:

流程分析

  • one shot tuning

    • 找到最优 template (template_input_i, template_summary_i)
    • input data –> summary –> recover data
    • feedback values ?

      • similar alignment
    • instruction, template, support data {w, t, x}.

      • w: instruction
      • t: template

        • 样本
        • 样本 summary
      • x: input data
    • $$s_i \leftarrow F(x_i| t_i, w_g, \theta)$$ 生成 summary 过程