Deploying convolutional neural networks (CNNs) on embedded devices is difficult due to the limited memory and computation resources. The redundancy in feature maps is an important characteristic of those successful CNNs, but has rarely been investigated in neural architecture design. This paper proposes a novel Ghost module to generate more feature maps from cheap operations. Based on a set of intrinsic feature maps, we apply a series of linear transformations with cheap cost to generate many ghost feature maps that could fully reveal information underlying intrinsic features.
2019: Kai Han, Yunhe Wang, Qi Tian, Jianyuan Guo, Chunjing Xu, Chang Xu
https://arxiv.org/pdf/1911.11907v2.pdf
Seven Failure Points When Engineering a Retrieval Augmented Generation System
Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning
Recurrent Context Compression: Efficiently Expanding the Context Window of LLM
Multi-Head RAG: Solving Multi-Aspect Problems with LLMs
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning
VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time
”Do Anything Now”: Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models
Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models
Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models
GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning
AutoCoder: Enhancing Code Large Language Model with \textsc{AIEV-Instruct}
From Sora What We Can See: A Survey of Text-to-Video Generation
The Future of Large Language Model Pre-training is Federated
Long-form factuality in large language models
Real-time Transformer-based Open-Vocabulary Detection with Efficient Fusion Head
Retrieval-Augmented Generation for AI-Generated Content: A Survey
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
LightAutoML: AutoML Solution for a Large Financial Services Ecosystem
Efficient Multimodal Large Language Models: A Survey
The Platonic Representation Hypothesis
Join Podbean Ads Marketplace and connect with engaged listeners.
Advertise Today
Create your
podcast in
minutes
It is Free
The WAN Show
Cyber Security Headlines
Babbage from The Economist
Techmeme Ride Home
Cybersecurity Today