Segmented Summarization and Refinement:A Pipeline for Long-Document Analysis on Social Media  

作　　者：Guanghua Wang Priyanshi Garg Weili Wu 

机构地区：[1]the Department of Computer Science,The University of Texas at Dallas,Richardson,TX 75080,USA

出　　处：《Journal of Social Computing》2024年第2期132-144,共13页社会计算（英文）

摘　　要：Social media’s explosive growth has resulted in a massive influx of electronic documents influencing various facets of daily life.However,the enormous and complex nature of this content makes extracting valuable insights challenging.Long document summarization emerges as a pivotal technique in this context,serving to distill extensive texts into concise and comprehensible summaries.This paper presents a novel three-stage pipeline for effective long document summarization.The proposed approach combines unsupervised and supervised learning techniques,efficiently handling large document sets while requiring minimal computational resources.Our methodology introduces a unique process for forming semantic chunks through spectral dynamic segmentation,effectively reducing redundancy and repetitiveness in the summarization process.Contrary to previous methods,our approach aligns each semantic chunk with the entire summary paragraph,allowing the abstractive summarization model to process documents without truncation and enabling the summarization model to deduce missing information from other chunks.To enhance the summary generation,we utilize a sophisticated rewrite model based on Bidirectional and Auto-Regressive Transformers(BART),rearranging and reformulating summary constructs to improve their fluidity and coherence.Empirical studies conducted on the long documents from the Webis-TLDR-17 dataset demonstrate that our approach significantly enhances the efficiency of abstractive summarization transformers.The contributions of this paper thus offer significant advancements in the field of long document summarization,providing a novel and effective methodology for summarizing extensive texts in the context of social media.

关 键 词：long document summarization abstractive summarization text segmentation text alignment rewrite model spectral embedding 

分 类 号：G206[文化科学—传播学] TP391[自动化与计算机技术—计算机应用技术]