Daily AI Newsletter: What if we set GPT-4 free in Minecraft?

So many gems in today’s email:

🧪 ChatGPT-powered Conversational Drug Editing.
🔥 Awesome talk on the State of GPT by Andrej Karpathy.
🧱 Voyager, the first AI agent playing Minecraft
🛠 Various AI-related tools and platforms, including LawPilot, Mendable, Pool Planner, DuetGPT, RemixMyFace, and more.

Highlights💡

ChatDrug uses a combination of a prompt module, a retrieval and domain feedback (ReDF) module, and a conversation module to streamline effective drug editing.
Empirical evidence shows that ChatDrug achieves the best performance on 33 out of 39 drug editing tasks, covering small molecules, peptides, and proteins.
Through 10 case studies, we demonstrate that ChatDrug can successfully identify key substructures (e.g., molecule functional groups, peptide motifs, and protein structures) for manipulation, generating diverse and valid suggestions for drug editing.
ChatDrug can also provide insightful explanations from a domain-specific perspective, enhancing interpretability and enabling informed decision-making.
The source codes for this research can be found in the provided GitHub repository.

Voyager is the first LLM-powered embodied lifelong learning agent in Minecraft.
Minecraft does not impose a predefined end goal or a fixed storyline but provides a unique playground with endless possibilities.
It continuously explores the world, acquires diverse skills, and makes novel discoveries without human intervention.
Voyager interacts with GPT-4 via black box queries, bypassing the need for model parameter fine-tuning.
Voyager outperforms all the alternatives, demonstrating the critical role of each component.
GPT-4 significantly outperforms GPT-3.5 in code generation.

Your browser does not support HTML video.

SoundStorm is a non-autoregressive audio generation model developed by Google Research, which is faster and maintains higher voice consistency than the autoregressive AudioLM.
When combined with SPEAR-TTS, SoundStorm can synthesize high-quality, natural dialogues in a short time, allowing control over content and speaker voices.
SoundStorm can generate audio conditioned on semantic tokens with or without voice prompts, maintaining high acoustic consistency and voice preservation.
SoundStorm can be used as a replacement for the acoustic generation pipeline of AudioLM and SPEAR-TTS, making audio generation research more accessible.
The authors acknowledge potential biases in training data and potential misuse of the technology and plan to explore other approaches for detecting synthesized speech, such as audio watermarking, to ensure responsible AI principles.

Real-time Transcription: WingmanAI can transcribe both system output and microphone input audio, allowing you to view the live transcription in an easy-to-read format.
ChatGPT Integration: You can chat with a ChatGPT-powered bot that reads your transcripts in real-time.
Efficient Memory Management: The bot maintains a record of the conversation but in a token-efficient manner, as only the current chunk of the transcript is passed to the bot.
Save and Load Transcripts: WingmanAI allows you to save transcripts for future use. You can load them up anytime later, and any query made to the bot will be cross-referenced with a vector database of the saved transcript, providing the bot with a richer context.

LawPilot - AI for Lawyers! [Link], [Video]
Terzo - Unlock financial insights hidden in your contracts[Link]
A 2-minute introduction to the fundamental building block behind Large Language Models [Link]
DocBase - Alana built the open-source alternative to DocSend [Link], [Github]
Documenso - And Timur made an open-source alternative to DocuSign [Link], [GitHub], [Video]
Good idea or not? JPMorgan is developing a ChatGPT-like A.I. service that gives investment advice [Link]

RemixMyFace - Turn your Photos into stunning Avatars with AI in seconds! 100% free and open source. [Demo], [GitHub], [Tutorial]
Idea: Make travel postcards using MidJourney and these Canva templates, and sell them on Amazon
Another idea: Can you turn this 30-line Google Drive + ChatGPT code into an extension? [Link]
Video: 6 Tips to write better prompts by Anna Bernstein from Copy.ai
Paper: LLMs can make their own tools just like humans! [Link]
Pool Planner - Visualize your dream pool using AI [Link]

ProlificDreamer - High-Fidelity and Diverse Text-to-3D Generation [GitHub], [Paper]

ChatGPT is saving my life [Link]
That’s cool: Check out the website for the family office of Nintendo heirs. [Link]