Improve Code Summarization via Prompt-Tuning CodeT5  

作　　者：LI Huanzhen 

机构地区：[1]College of Information Engineering,Jiangxi University of Technology,Nanchang 330022,Jiangxi,China

出　　处：《Wuhan University Journal of Natural Sciences》2023年第6期474-482,共9页武汉大学学报（自然科学英文版）

摘　　要：Code comments are crucial in software engineering, aiding in program maintenance and code reuse. The process of generating clear and descriptive code comments, outlining code functionality, is called code summarization. Existing code summarization methods are typically trained using transformer-based models. However, these trained models often possess limited parameters and lack specific training tasks, hindering their ability to capture code semantics effectively. This paper uses a high-capacity pre-trained model, CodeT5, for code summarization. CodeT5 is designed with an encoder-decoder architecture that excels in code summarization tasks. Furthermore, we adopt a novel paradigm, "pre-train, prompt, predict", to unlock the knowledge embedded within CodeT5. We devise a prompt template to convert input code into code prompts and fine-tune CodeT5 with these prompts—a process we term prompt tuning. Our effectiveness experiments demonstrate that prompt tuning CodeT5 with only 40% of the dataset can achieve comparable performance to fine-tuning CodeT5 with 100% of the dataset. This means our approach is applicable in few-shot learning scenarios. Additionally, our prompt learning method is not sensitive to the size of the tuning dataset. Our practicality experiments show that the performance of prompt-tuned CodeT5 far surpasses that of transformer-based models trained on code-comment datasets collected from Stack Overflow.

关 键 词：code summarization transformer-based model prompt learning CodeT5 few-shot learning 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]