On May 10, 2024, an online and offline sharing event titled “AI’s Innovative Applications in Multimodal Database Construction” was held at the Tsinghua University MEM Center on Manufacturing Street in Zhongguancun. Despite the impending heavy rain, the event attracted more than twenty experts, scholars, and students from both China and abroad to participate offline, with … Read more
This article is authorized to be reproduced from: 58UXD（ID：i58UXD） The design of AI multimodal platforms is a challenging yet opportunity-filled field. Our multimodal AI platform is a comprehensive platform that integrates multimodal AI technologies such as image generation, video generation, and content understanding. The platform deploys industry-leading open-source and commercial model capabilities in real-time, while … Read more
Source: Algorithm Advancement This article is approximately 4100 words and is recommended to be read in 8 minutes. LongLLaVA performs excellently in long-context multimodal understanding. The authors of this article come from The Chinese University of Hong Kong, Shenzhen, and the Shenzhen Big Data Research Institute. The first authors are PhD student Wang Xidong and … Read more
Smart Introduction In recent years, Jiangsu courts have deeply implemented Xi Jinping’s thoughts on the rule of law and his important ideas on building a strong networked nation, closely focusing on the work theme of “justice and efficiency.” They have actively explored the deep integration of artificial intelligence and judicial applications, relying on multimodal perception … Read more
Introduction The artificial intelligence industry is like a giant ship sailing through the waves, heading towards a new blue ocean of the intelligent era at an unprecedented speed. Its development trends and prospects are vibrant and hopeful, not only triggering revolutionary changes in the technology sector but also deeply penetrating various industries, empowering industrial upgrades … Read more
Editor’s Note With the rapid development of artificial intelligence technology, the health sector is continuously trying to improve the quality of medical care and enhance work efficiency by introducing AI. Due to the capability of large model technology to process large-scale data and perform complex tasks, it significantly enhances the generalization, versatility, and practicality of … Read more
In daily life, humans utilize various senses such as vision and hearing to understand the surrounding environment. By integrating multiple perceptual modalities, a holistic understanding of events is formed. To enable machines to better mimic human cognitive abilities, multimodal cognitive computing simulates human “synaesthesia”, exploring efficient perception and comprehensive understanding methods for multimodal inputs such … Read more
It has been a whole year since the emergence of ChatGPT, GPT-4, and other innovations that sparked a new wave of transformation in artificial intelligence. During this year, numerous companies both domestically and internationally have entered the “arena” of large models, accelerating the iteration and leap of large model technologies. The unprecedented capability of large … Read more
Most applications of artificial intelligence in medicine utilize a single data modality to address tasks within a narrow scope, such as computed tomography (CT) scans or retinal photographs. However, clinicians integrate multi-source, multimodal data for diagnosis, prognosis assessment, and treatment planning. In this review, the authors explore the applications of multimodal datasets in healthcare, the … Read more
Author / Li Xi 0 Introduction This article organizes previous research on multimodal visual structure learning from a new perspective, focusing on the characteristics and applications of spherical panoramic images. Spherical images are mostly related to fisheye or 360° panoramic views, containing a wealth of structural knowledge, primarily aimed at applications such as autonomous driving, … Read more