ChatGPT Can Now See, Hear, and Speak
Spotify is going to clone podcasters’ voices — and translate them to other languages
In today’s email:
👂🏻 You Can Now Talk With ChatGPT and It Sounds Like a Human
🎙️ Spotify is going to clone podcasters’ voices
🧠 Everyone is above average
🧰 Various AI-related tools and platforms. Instantly build ChatGPT-powered chatbots, a fun startup game, analyze research papers at superhuman speed, design your dream backyard with AI, free AI subject line generator, dub your content in minutes, and more.
You Can Now Talk With ChatGPT and It Sounds Like a Human (Pretty Much) [Link]
ChatGPT can now see, hear, and speak. Rolling out over next two weeks, Plus users will be able to have voice conversations with ChatGPT (iOS & Android) and to include images in conversations (all platforms).
openai.com/blog/chatgpt-c…— OpenAI (@OpenAI)
12:12 PM • Sep 25, 2023
Voice Features
You can now engage in a back-and-forth voice conversation with ChatGPT.
Voice functionality will be available on iOS and Android.
Powered by a new text-to-speech model, ChatGPT can generate human-like audio.
Users can select from five different voice options.
Image Features
Users can show ChatGPT images for a wide variety of tasks, like troubleshooting or meal planning.
Image understanding is powered by multimodal GPT-3.5 and GPT-4.
A drawing tool is available for specifying areas of interest within an image.
Rollout and Availability
Initially, these features will be available to Plus and Enterprise users over the next two weeks.
Voice and images will be available on all platforms.
Other Details
OpenAI has taken measures to mitigate risks associated with voice impersonation and image interpretation.
Technical safeguards have been put in place to respect individuals' privacy.
OpenAI is also working with Spotify on a Voice Translation feature for podcasts.
Limitations include poor performance in transcribing some non-English languages and OpenAI advises against using it for high-risk applications without verification.
Amazon to invest up to $4 billion in AI startup Anthropic [Link]
Amazon is investing an initial $1.25 billion in AI startup Anthropic for a minority stake, with the option to increase the investment to $4 billion. The move pits Amazon against other tech giants like Microsoft and Google in the competitive AI field. Anthropic will use Amazon's AWS for mission-critical work and future AI development. The collaboration aims to enhance Amazon's customer experiences and expand its AI capabilities. Anthropic was valued at $5 billion earlier this year and plans to continue advancing in AI safety and research.
Spotify is going to clone podcasters’ voices — and translate them to other languages [Link]
Spotify is launching a pilot feature called Voice Translation for podcasts, which uses AI technology to translate podcasts into additional languages while retaining the original podcaster's voice style. The technology aims to offer a more authentic and personal listening experience compared to traditional dubbing. For the pilot, Spotify has partnered with podcasters such as Dax Shepard, Monica Padman, Lex Fridman, Bill Simmons, and Steven Bartlett to offer AI-powered voice translations in languages like Spanish, French, and German. This feature will be available to both Premium and Free users. An initial bundle of translated episodes is being rolled out, starting with Spanish, followed by French and German. The company plans to use feedback from this pilot to inform future expansions and innovations.
Alexa, Siri, and the other bots hanging out in the server break room again [Link]
Alexa, Siri and the other bots hanging out in the server break room again
— Elle Cordova (@ellerhymes)
10:42 PM • Sep 22, 2023
Other stuff
See How AI Generates Images from Text [Link] RECOMMENDED
TESCREAL, the Acronym Behind Our Wildest AI Dreams and Nightmares [Link] RECOMMENDED
Tesla’s Optimus sorts objects autonomously [Link]
Getty made an AI generator that only trained on its licensed images [Link]
The AI Revolution is Rotten to the Core [Link]
Simulating a village of AI NPCs [Video]
Everyone is above average [Link]
GPT4Tools: using ChatGPT as a teacher to show other LLMs how to use other tools for visual tasks. [Link] RECOMMENDED
Codenamed GAMECHANGER, an AI program helps the military make sense of its own “byzantine” and “tedious” bureaucracy. [Link]
21 Amazing AI.llusions 🌀 and how to make them 🔨 [Link] RECOMMENDED
Elicit is building a tool to automate scientific literature review [Link]
Superpower ChatGPT 5.6.0 has been released. 🎉
The most powerful release yet with Prompt Chains, AutoComplete Menu, Quick Sync, Custom Instruction Profiles, and many more features.
Editor's Pick
Wonderchat 💬 - Instantly build ChatGPT-powered chatbots trained on website links or PDF files. [Link]
Editor's Pick ✨http://Sillycovalley - Not AI, but a fun, genius startup game [Link]
The goal is to last 120 days and grow to as many users as possible before the Demo day.
Elicit - Analyze research papers at superhuman speed [Link]
BackyardDesign AI - Your dream backyard, landscaped in under an hour [Link]
DeepEval - Evaluation and Unit Testing for LLMs [GitHub]
Octomind - Give it a URL and with the power of AI it will discover, execute, and maintain your e2e tests in Playwright.[Link]
Neuralmind - AI-powered Product Analytics for your customers. [Link]
Mailmodo - Free AI Subject Line Generator [Link]
Alpha Inquire - Your personal team of AI-powered research agents. [Link]
FireCut AI - Your lightning-fast AI video editor [Link]
Dubbing by Wondercraft AI - Dub your content in minutes and preserve voice and emotion [Link]
ChatShelf - Save ChatGPT into Notion [Link]
Prompt of the Day 🍭: Podcaster Tweet Thread
Click on the image to load the full prompt in ChatGPT (requires Superpower ChatGPT)
Unclassified 🌀
cTuro - Analytics for Turo [Link]
CopyAI - Focus on the things you love. Automate the things you don't. [Link]
