Click on the “MLNLP” above to select the “Starred” public account Heavyweight content delivered first-hand Authors: Wu Yang, Hu Xiaoyu, Lin Zijie from Harbin Institute of Technology SCIR Introduction With the rapid development of social networks, the ways people express themselves on platforms have become increasingly rich, such as expressing their emotions and opinions through … Read more
MLNLP community is a well-known machine learning and natural language processing community in China and abroad, covering NLP master’s and doctoral students, university teachers, and corporate researchers. The Vision of the Community is to promote communication and progress between the academic and industrial sectors of natural language processing and machine learning, especially for beginners. Reprinted … Read more
Jin Chen, Contributor at Quantum Bits | WeChat Official Account QbitAI This time, it’s not about rolling parameters or computing power, but about rolling “cross-domain learning” — Let Stable Diffusion be the teacher, teaching multimodal large models (like Llama-3.2) how to “describe images”! Performance skyrocketed by 30%. The latest research by Chinese researchers in collaboration … Read more
©PaperWeekly Original · Author | Su Jianlin Affiliation | Scientific Space Research Direction | NLP, Neural Networks In the second article of this series, “The Path of Transformer Upgrade: A Rotational Position Encoding that Draws on the Strengths of Many,” the author proposes Rotational Position Encoding (RoPE) — a method to achieve relative position encoding … Read more
In recent years, end-to-end portrait animation technologies (such as audio-driven speaker generation) have made significant progress. However, existing methods still struggle to scale as broadly as general video generation models, which limits their practical applications. To address these issues, ByteDance has proposed OmniHuman— a portrait video generation framework based on Diffusion Transformer (Diffusion Transformer). OmniHuman … Read more
OmniHuman-1 is an end-to-end multimodal conditional human video generation framework proposed by ByteDance, capable of generating realistic human videos based on a single human image and motion signals (such as audio, video, or a combination of both). Currently, OmniHuman-1 does not provide a public API or download channel, only a paper. Diverse Video Generation Capabilities … Read more
Google releases the native multimodal AI large model Gemini A new visual prompt AI model T-Rex achieves image recognition through images The “white-box” Transformer architecture CRATE enhances AI model interpretability 【Key Insight】 In practical applications, artificial intelligence (AI) is often difficult to achieve a comprehensive improvement in production efficiency as a single technology, and often … Read more
MLNLP community is a well-known machine learning and natural language processing community both domestically and internationally, covering NLP master’s and doctoral students, university teachers, and researchers from enterprises. The community’s vision is to promote communication and progress between the academic and industrial sectors of natural language processing and machine learning at home and abroad, especially … Read more
Follow the official account “ML_NLP“ Set as “Starred“, delivering heavy content promptly! Introduction With the rapid development of social networks, the ways people express themselves on platforms have become increasingly rich, such as expressing emotions and opinions through images, text, and videos. Analyzing the emotions in multimodal data (this article refers to sound, images, and … Read more
This article is authorized to be reproduced from: 58UXD（ID：i58UXD） The design of AI multimodal platforms is a challenging yet opportunity-filled field. Our multimodal AI platform is a comprehensive platform that integrates multimodal AI technologies such as image generation, video generation, and content understanding. The platform deploys industry-leading open-source and commercial model capabilities in real-time, while … Read more