Title of paper:
Audio-Visual Controlled Video Diffusion with Masked Selective State Spaces Modeling for Natural Talking Head Generation
Authors:
Fa-Ting Hong, Zunnan Xu, Zixiang Zhou, Jun Zhou, Xiu Li, Qin Lin, Qinglin Lu, Dan Xu
Description:
This paper introduces ACTalker, an end-to-end video diffusion framework designed for natural talking head generation with both multi-signal and single-signal control capabilities.
The framework employs a parallel Mamba structure with multiple branches, each utilizing a separate driving signal to control specific facial regions.
A gate mechanism is applied across all branches, providing flexible control over video generation.
To ensure natural coordination of the controlled video both temporally and spatially, the Mamba structure enables driving signals to manipulate feature tokens across both dimensions in each branch.
Additionally, a mask-drop strategy is introduced, allowing each driving signal to independently control its corresponding facial region within the Mamba structure, preventing control conflicts.
Experimental results demonstrate that this method produces natural-looking facial videos driven by diverse signals, and that the Mamba layer seamlessly integrates multiple driving modalities without conflict.
Link of abstract paper:
https://arxiv.org/abs/2504.00000
Link of download paper:
https://arxiv.org/pdf/2504.00000.pdf
Code:
https://github.com/harlanhong/actalker
Datasets used in paper:
The paper does not specify the datasets used.
Hugging Face demo:
No Hugging Face demo available.
#ACTalker #TalkingHeadGeneration #VideoDiffusion #MultimodalControl #MambaStructure #DeepLearning #ComputerVision #AI #OpenSource

🤖🧠 Cognee: Powerful Memory for AI Agents in Just 6 Lines of Code

🗓️ 07 Oct 2025
📚 AI News & Trends

Artificial Intelligence is evolving rapidly, but one of the biggest challenges for developers is building agents that remember, reason and adapt. Traditional RAG (Retrieval-Augmented Generation) systems often fall short when handling context, scalability and precision. That’s where Cognee comes in. It is an open-source framework designed to provide AI agents with memory using a unique ...

#AI #Memory #AIAgents #OpenSource #RAG #ArtificialIntelligence

🤖🧠 NanoChat: The Best ChatGPT That $100 Can Buy

🗓️ 20 Oct 2025
📚 AI News & Trends

In a world dominated by billion-dollar AI models like GPT-4 and Claude 3, it’s refreshing to see a minimalist, open-source alternative that puts the power of Large Language Models (LLMs) back into the hands of hackers, researchers and enthusiasts. Enter NanoChat – an end-to-end, full-stack implementation of a ChatGPT-style AI chatbot developed by Andrej Karpathy, ...

#NanoChat #ChatGPT #AI #LargeLanguageModels #OpenSource #AndrejKarpathy

🤖🧠 Wan 2.1: Alibaba’s Open-Source Revolution in Video Generation

🗓️ 21 Oct 2025
📚 AI News & Trends

The landscape of artificial intelligence has been evolving rapidly, especially in the domain of video generation. Since OpenAI unveiled Sora in 2024, the world has witnessed an explosive surge in research and innovation within generative AI. However, most of these cutting-edge tools remained closed-source limiting transparency and accessibility. Recognizing this gap, Alibaba Group introduced Wan, ...

#Alibaba #Wan2.1 #VideoGeneration #GenerativeAI #OpenSource #ArtificialIntelligence

🤖🧠 Master Machine Learning: Explore the Ultimate “Machine-Learning-Tutorials” Repository

🗓️ 23 Oct 2025
📚 AI News & Trends

In today’s data-driven world, Machine Learning (ML) has become the cornerstone of modern technology from intelligent chatbots to predictive analytics and recommendation systems. However, mastering ML isn’t just about coding, it requires a structured understanding of algorithms, statistics, optimization techniques and real-world problem-solving. That’s where Ujjwal Karn’s Machine-Learning-Tutorials GitHub repository stands out. This open-source, topic-wise ...

#MachineLearning #MLTutorials #ArtificialIntelligence #DataScience #OpenSource #AIEducation

🤖🧠 LangChain: The Ultimate Framework for Building Reliable AI Agents and LLM Applications

🗓️ 24 Oct 2025
📚 AI News & Trends

As artificial intelligence continues to transform industries, developers are racing to build smarter, more adaptive applications powered by Large Language Models (LLMs). Yet, one major challenge remains how to make these models interact intelligently with real-world data and external systems in a scalable, reliable way. Enter LangChain, an open-source framework designed to make LLM-powered application ...

#LangChain #AI #LLM #ArtificialIntelligence #OpenSource #AIAgents

🤖🧠 Microsoft Data Formulator: Revolutionizing AI-Powered Data Visualization

🗓️ 28 Oct 2025
📚 AI News & Trends

In today’s data-driven world, visualization is everything. Whether you’re a business analyst, data scientist or researcher, the ability to convert raw data into meaningful visuals can define the success of your decisions. That’s where Microsoft’s Data Formulator steps in a cutting-edge, open-source platform designed to empower analysts to create rich, AI-assisted visualizations effortlessly. Developed by ...

#Microsoft #DataVisualization #AI #DataScience #OpenSource #Analytics

🤖🧠 Reflex: Build Full-Stack Web Apps in Pure Python — Fast, Flexible and Powerful

🗓️ 29 Oct 2025
📚 AI News & Trends

Building modern web applications has traditionally required mastering multiple languages and frameworks from JavaScript for the frontend to Python, Java or Node.js for the backend. For many developers, switching between different technologies can slow down productivity and increase complexity. Reflex eliminates that problem. It is an innovative open-source full-stack web framework that allows developers to ...

#Reflex #FullStack #WebDevelopment #Python #OpenSource #WebApps

🤖🧠 MiniMax-M2: The Open-Source Revolution Powering Coding and Agentic Intelligence

🗓️ 30 Oct 2025
📚 AI News & Trends

Artificial intelligence is evolving faster than ever, but not every innovation needs to be enormous to make an impact. MiniMax-M2, the latest release from MiniMax-AI, demonstrates that efficiency and power can coexist within a streamlined framework. MiniMax-M2 is an open-source Mixture of Experts (MoE) model designed for coding tasks, multi-agent collaboration and automation workflows. With ...

#MiniMaxM2 #OpenSource #MachineLearning #CodingAI #AgenticIntelligence #MixtureOfExperts

🤖🧠 LongCat-Video: Meituan’s Groundbreaking Step Toward Efficient Long Video Generation with AI

🗓️ 04 Nov 2025
📚 AI News & Trends

In the rapidly advancing field of generative AI, the ability to create realistic, coherent, and high-quality videos from text or images has become one of the most sought-after goals. Meituan, one of the leading technology innovators in China, has made a remarkable stride in this domain with its latest open-source model — LongCat-Video. Designed as ...

#LongCatVideo #Meituan #GenerativeAI #VideoGeneration #AIInnovation #OpenSource

✨olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Models

📝 Summary:
olmOCR is an open-source toolkit that uses a fine-tuned vision language model to convert PDFs into clean, structured text. It enables large-scale, cost-effective extraction of trillions of tokens for training language models.

🔹 Publication Date: Published on Feb 25

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2502.18443
• PDF: https://arxiv.org/pdf/2502.18443
• Github: https://github.com/allenai/olmocr

✨ Datasets citing this paper:
• https://huggingface.co/datasets/davanstrien/test-olmocr2
• https://huggingface.co/datasets/davanstrien/newspapers-olmocr2
• https://huggingface.co/datasets/stckmn/ocr-output-Directive017-1761355297

==================================

For more data science resources:
✓ https://t.iss.one/DataScienceT

#OCR #VLMs #LLM #DataExtraction #OpenSource

✨MinerU: An Open-Source Solution for Precise Document Content Extraction

📝 Summary:
MinerU is an open-source tool that provides high-precision document content extraction. It uses fine-tuned models and pre/postprocessing rules to consistently achieve high performance across diverse document types.

🔹 Publication Date: Published on Sep 27, 2024

🔹 Paper Links:
• arXiv Page: https://arxiv.org/pdf/2409.18839
• PDF: https://huggingface.co/spaces/Echo9k/PDF_reader
• Github: https://github.com/opendatalab/MinerU

✨ Spaces citing this paper:
• https://huggingface.co/spaces/opendatalab/MinerU
• https://huggingface.co/spaces/xiaoye-winters/MinerU-API
• https://huggingface.co/spaces/ApeAITW/MinerU_2.5_Test

==================================

For more data science resources:
✓ https://t.iss.one/DataScienceT

#DocumentExtraction #OpenSource #DataScience #NLP #AI

🤖🧠 Krea Realtime 14B: Redefining Real-Time Video Generation with AI

🗓️ 05 Nov 2025
📚 AI News & Trends

The field of artificial intelligence is undergoing a remarkable transformation and one of the most exciting developments is the rise of real-time video generation. From cinematic visual effects to immersive virtual environments, AI is rapidly blurring the boundaries between imagination and reality. At the forefront of this innovation stands Krea Realtime 14B, an advanced open-source ...

#AI #RealTimeVideo #ArtificialIntelligence #OpenSource #VideoGeneration #KreaRealtime14B

🤖🧠 FIBO: The First JSON-Native, Open-Source Text-to-Image Model Built for Real-World Control and Accuracy

🗓️ 07 Nov 2025
📚 AI News & Trends

The world of generative AI has evolved rapidly with text-to-image tools enabling creators, marketers, designers and enterprises to bring ideas to life with unprecedented ease. However, most existing models have a clear limitation: they prioritize imagination at the cost of control. Whether producing inconsistent styles, unpredictable lighting or drifting away from user prompts, traditional models ...

#FIBO #TextToImage #GenerativeAI #OpenSource #JSONNative #RealWorldControl

✨OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLM

📝 Summary:
OmniVinci is an open-source omni-modal LLM that improves cross-modal understanding for audio, vision, and robotics. It features innovative architecture for better embedding alignment and temporal capture, along with efficient data curation. OmniVinci outperforms competitors while using significan...

🔹 Publication Date: Published on Oct 17

🔹 Paper Links:
• arXiv Page: https://arxivexplained.com/papers/omnivinci-enhancing-architecture-and-data-for-omni-modal-understanding-llm
• PDF: https://arxiv.org/pdf/2510.15870
• Project Page: https://nvlabs.github.io/OmniVinci/
• Github: https://github.com/NVlabs/OmniVinci

🔹 Models citing this paper:
• https://huggingface.co/nvidia/omnivinci

==================================

For more data science resources:
✓ https://t.iss.one/DataScienceT

#LLM #MultimodalAI #Robotics #DeepLearning #OpenSource

🤖🧠 Meilisearch: The Lightning-Fast, AI-Ready Search Engine for Modern Applications

🗓️ 08 Nov 2025
📚 AI News & Trends

Search is no longer a luxury feature. Today’s users expect instant, relevant results across e-commerce platforms, SaaS tools, media libraries and knowledge systems. With AI-powered experiences becoming the new standard, developers need search infrastructure that is fast, flexible, developer-friendly and ready for hybrid semantic search. This is where Meilisearch stands out. Meilisearch is an open-source, ...

#Meilisearch #AIReadySearch #LightningFast #SearchEngine #ModernApplications #OpenSource

✨UniVA: Universal Video Agent towards Open-Source Next-Generation Video Generalist

📝 Summary:
UniVA is an open-source multi-agent framework that unifies video understanding, segmentation, editing, and generation. It uses a Plan-and-Act architecture with hierarchical memory to enable complex, iterative video workflows. This system aims to advance agentic video intelligence.

🔹 Publication Date: Published on Nov 11

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2511.08521
• PDF: https://arxiv.org/pdf/2511.08521
• Project Page: https://univa.online/
• Github: https://github.com/univa-agent/univa

==================================

For more data science resources:
✓ https://t.iss.one/DataScienceT

#VideoAI #AIagents #GenerativeAI #ComputerVision #OpenSource