Technology
Adversarial Examples: A Problem
The apparent successes of the deep learning revolution conceal a dark underbelly. It may seem that we now know how to get computers to (say) check whether a photo is of a bird, but this façade of seemingly good performance is belied by the existence of adversarial examples—specially prepared data that looks ordinary to humans, but is seen radically differently by machine learning models.
The differentiable nature of neural networks, which make them possible to be trained at all, are also responsible for their downfall at the hands of an adversary. Deep learning models are fit using stochastic gradient descent (SGD) to approximate the function between expected inputs and outputs. Given an input, an expected output, and a loss function (which measures "how bad" it is for the actual output to differ from the expected output), we can calculate the gradient of the [...]
The original text contained 5 footnotes which were omitted from this narration.
---
First published:
April 29th, 2024
Source:
https://www.lesswrong.com/posts/H7fkGinsv8SDxgiS2/ironing-out-the-squiggles
---
Narrated by TYPE III AUDIO.
view more
The apparent successes of the deep learning revolution conceal a dark underbelly. It may seem that we now know how to get computers to (say) check whether a photo is of a bird, but this façade of seemingly good performance is belied by the existence of adversarial examples—specially prepared data that looks ordinary to humans, but is seen radically differently by machine learning models.
The differentiable nature of neural networks, which make them possible to be trained at all, are also responsible for their downfall at the hands of an adversary. Deep learning models are fit using stochastic gradient descent (SGD) to approximate the function between expected inputs and outputs. Given an input, an expected output, and a loss function (which measures "how bad" it is for the actual output to differ from the expected output), we can calculate the gradient of the [...]
The original text contained 5 footnotes which were omitted from this narration.
---
First published:
April 29th, 2024
Source:
https://www.lesswrong.com/posts/H7fkGinsv8SDxgiS2/ironing-out-the-squiggles
---
Narrated by TYPE III AUDIO.
More Episodes
“OpenAI o1 ” by Zach Stein-Perlman
2024-09-13
2024-09-13
“Nursing doubts ” by dynomight
2024-09-01
2024-09-01
“Principles for the AGI Race ” by William_S
2024-08-31
2024-08-31
“Liability regimes for AI ” by Ege Erdil
2024-08-23
2024-08-23
Get this podcast on your
phone, FREE
