#417: Test-Driven Prompt Engineering for LLMs with Promptimize

Large language models and chat-based AIs are kind of mind blowing at the moment. Many of us are playing with them for working on code or just as a fun alternative to search. But others of us are building applications with AI at the core. And when doing that, the slightly unpredictable nature and probabilistic nature of LLMs make writing and testing Python code very tricky. Enter promptimize from Maxime Beauchemin and Preset. It's a framework for non-deterministic testing of LLMs inside our applications. Let's dive inside the AIs with Max.

Links from the show

Max on Twitter: @mistercrunch
Promptimize: github.com
Introducing Promptimize ("the blog post"): preset.io
Preset: preset.io
Apache Superset: Modern Data Exploration Platform episode: talkpython.fm
ChatGPT: chat.openai.com
LeMUR: assemblyai.com
Microsoft Security Copilot: blogs.microsoft.com
AutoGPT: github.com
Midjourney: midjourney.com
Midjourney generated pytest tips thumbnail: talkpython.fm
Midjourney generated radio astronomy thumbnail: talkpython.fm
Prompt engineering: learnprompting.org
Michael's ChatGPT result for scraping Talk Python episodes: github.com
Apache Airflow: github.com
Apache Superset: github.com
Tay AI Goes Bad: theverge.com
LangChain: github.com
LangChain Cookbook: github.com
Promptimize Python Examples: github.com
TLDR AI: tldr.tech
AI Tool List: futuretools.io
Watch this episode on YouTube: youtube.com
Episode transcripts: talkpython.fm

--- Stay in touch with us ---
Subscribe to us on YouTube: youtube.com
Follow Talk Python on Mastodon: talkpython
Follow Michael on Mastodon: mkennedy

Sponsors
PyCharm
RedHat
Talk Python Training