Deploying convolutional neural networks (CNNs) on embedded devices is difficult due to the limited memory and computation resources. The redundancy in feature maps is an important characteristic of those successful CNNs, but has rarely been investigated in neural architecture design. This paper proposes a novel Ghost module to generate more feature maps from cheap operations. Based on a set of intrinsic feature maps, we apply a series of linear transformations with cheap cost to generate many ghost feature maps that could fully reveal information underlying intrinsic features.
2019: Kai Han, Yunhe Wang, Qi Tian, Jianyuan Guo, Chunjing Xu, Chang Xu
https://arxiv.org/pdf/1911.11907v2.pdf
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles
Let’s Verify Step by Step
Large Language Models as Tool Makers
Gorilla: Large Language Model Connected with Massive APIs
CodeT5+: Open Code Large Language Models for Code Understanding and Generation
VanillaNet: the Power of Minimalism in Deep Learning
QLoRA: Efficient Finetuning of Quantized LLMs
SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities
LLM-Pruner: On the Structural Pruning of Large Language Models
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Training language models to follow instructions with human feedback
Language Models Trained on Media Diets Can Predict Public Opinion
LoRA: Low-Rank Adaptation of Large Language Models
Pretraining Without Attention
ImageBind: One Embedding Space To Bind Them All
ZipIt! Merging Models from Different Tasks without Training
Chain of Thought Prompting Elicits Reasoning in Large Language Models
CodeGen2: Lessons for Training LLMs on Programming and Natural Languages
Shap-E: Generating Conditional 3D Implicit Functions
OPT: Open Pre-trained Transformer Language Models
Join Podbean Ads Marketplace and connect with engaged listeners.
Advertise Today
Create your
podcast in
minutes
It is Free
Cyber Security Headlines
The WAN Show
Babbage from The Economist
Cybersecurity Today
Big Technology Podcast