一种多模态模型与端到端的双智融合系统  

A Multimodal Model and End-to-end Dual Intelligence Fusion System

作　　者：王飞 陈培源 张炎磊 郭浩田 苏得秀 赵一州 WANG Fei;CHEN Peiyuan;ZHANG Yanlei;GUO Haotian;SU Dexiu;ZHAO Yizhou(Zhengzhou Nissan Automobile Co.,Ltd.,Technical Center,Zhengzhou 450000,China)

机构地区：[1]郑州日产汽车有限公司技术中心,河南郑州450000

出　　处：《汽车电器》2024年第10期1-3,共3页Auto Electric Parts

摘　　要：双智融合(Dual-AI)是一种将端到端自动驾驶与多模态模型(VLAM)相结合的技术。本文探讨双智融合(Dual-AI)技术的应用,将端到端自动驾驶和多模态模型(VLAM)相结合。希望能够通过这种融合,创建出能够直接从原始数据中学习并执行复杂任务的人工智能系统。这种系统可以同时处理图像、声音和其他类型的数据,以执行多模态任务,并能够更好地理解和响应用户的需求。Dual-AI is a technology that combines end-to-end autonomous driving with multimodal models.This paper explores the application of Dual-AI technology,which combines end-to-end autonomous driving and multimodal models(VLAM).The aim is to create an artificial intelligence system that can learn and perform complex tasks directly from raw data.This system can process images,sounds,and other types of data simultaneously to perform multimodal tasks and better understand and respond to user needs.

关 键 词：双智融合 多模态模型 ASR TTS SI 

分 类 号：U463.6[机械工程—车辆工程]