Deploying convolutional neural networks (CNNs) on embedded devices is difficult due to the limited memory and computation resources. The redundancy in feature maps is an important characteristic of those successful CNNs, but has rarely been investigated in neural architecture design. This paper proposes a novel Ghost module to generate more feature maps from cheap operations. Based on a set of intrinsic feature maps, we apply a series of linear transformations with cheap cost to generate many ghost feature maps that could fully reveal information underlying intrinsic features.
2019: Kai Han, Yunhe Wang, Qi Tian, Jianyuan Guo, Chunjing Xu, Chang Xu
https://arxiv.org/pdf/1911.11907v2.pdf
Text2Poster: Laying Out Stylized Texts on Retrieved Images
Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling
Reversible Column Networks
The Forward-Forward Algorithm: Some Preliminary Investigations
Cramming: Training a Language Model on a Single GPU in One Day
TorchGeo: deep learning with geospatial data
Revisiting Classifier: Transferring Vision-Language Models for Video Recognition
Editing Models with Task Arithmetic
What do Vision Transformers Learn? A Visual Exploration
Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learning
Programming Is Hard - Or at Least It Used to Be: Educational Opportunities And Challenges of AI Code Generation
MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition
DAMO-YOLO : A Report on Real-Time Object Detection Design
TorchScale: Transformers at Scale
InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions
OneFormer: One Transformer to Rule Universal Image Segmentation
Large Language Models Are Human-Level Prompt Engineers
Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models
On the Versatile Uses of Partial Distance Correlation in Deep Learning
SeaPearl: A Constraint Programming Solver guided by Reinforcement Learning
Join Podbean Ads Marketplace and connect with engaged listeners.
Advertise Today
Create your
podcast in
minutes
It is Free
The WAN Show
Babbage from The Economist
Cyber Security Headlines
The Flo Show, no filter
Cybersecurity Today