Welcome to Today’s AIography!

Picture this: you blink, and suddenly your family photo is a blockbuster trailer, your hummed tune is a chart-topping hit, and Hollywood bigwigs are debating if AI is the new Steven Spielberg. That's not science fiction – it's this week's AIography! As I dove into these mind-bending innovations, I realized we're not just peeking into the future of filmmaking; we're living it. Enjoy.

In today’s AIography:

• BREAKING: Meta Releases SAM 2: AI Game-Changer for Video Editing & Object Tracking

• Runway's Gen-3 Alpha Adds Image-to-Video Feature

• Comparing AI Music Tools: Suno vs Udio

• AI in Hollywood: Industry Leaders Discuss the Future of Filmmaking 

• Kling AI Video Generator Goes Global

• Essential Tools

• Short Takes

• One More Thing…

Read time: About 5 minutes

THE LATEST NEWS

VIDEO
BREAKING: Meta Releases SAM 2: Game-Changer for Video Editing and Object Tracking

TL;DR: Meta has released SAM 2 (Segment Anything Model 2), at SIGGRAPH, an AI tool that can identify and track objects in both images and videos in real-time. This technology could revolutionize video editing by making object selection and tracking much faster and more accurate.

Key Takeaways:

• Real-Time Object Segmentation: SAM 2 can instantly identify and outline objects in videos, potentially speeding up tasks like rotoscoping and masking.

• Interactive Editing: Users can refine object selections with simple prompts like clicks or boxes, making it adaptable to complex scenes.

• Versatile Applications: The tool works on any type of video content without needing specific training, making it useful for various editing tasks.

• Memory-Based Tracking: SAM 2 can remember and track objects across video frames, even with occlusions or camera movements.

Why it’s important: For video editors and post-production professionals, SAM 2 could significantly streamline workflows. Tasks that traditionally required frame-by-frame manual work, like object tracking or creating complex masks, could become much faster and more efficient. This technology has the potential to save hours of work on tasks like visual effects, color grading of specific objects, or creating precise mattes for compositing.

As AI tools continue to evolve, understanding and integrating technologies like SAM 2 could become crucial for staying competitive in the video editing and post-production industries. While it's not a replacement for human creativity and decision-making, it could free up more time for editors to focus on the creative aspects of their work.

VIDEO
Runway's Gen-3 Alpha Adds Image-to-Video Feature 🎬

TL;DR: Runway has incrementally added a new feature to its recently released Gen-3 Alpha, allowing users to transform still images into short videos. This enhancement builds on Gen-3 Alpha's advanced capabilities, offering powerful new tools for content creators.

Key Takeaways:

• New Image-to-Video Feature: The latest addition to Gen-3 Alpha enables the creation of 5 to 10-second videos from a single still image.

• Incremental Updates: Runway is releasing these new features to Gen-3 Alpha incrementally, continually enhancing its functionality.

• Rapid Processing: Depending on server load, the AI generates videos fairly quickly, making it a powerful and efficient tool for content creation.

• Versatile Input: Users can provide both images and text prompts to guide the video generation process.

Why it’s important: The incremental addition of new features to Runway's Gen-3 Alpha, such as the image-to-video capability, significantly enhances the tool's utility for creative professionals. This ongoing development ensures that users have access to cutting-edge AI technology for dynamic video creation, making the process more accessible and efficient. As Runway continues to expand Gen-3 Alpha's capabilities, it sets a new standard for AI-driven content creation, potentially transforming how videos are produced and consumed.

MUSIC
🎶 Comparing AI Music Tools: Suno vs. Udio

TL;DR: In this detailed comparison, AIMUSIC evaluates the AI music generators Suno and Udio, both of which recently released updates. Udio's version 1.5 boasts improved audio quality and new features, while Suno offers vocal and instrumental separation. The host tests both platforms by creating reggae songs and separating the stems, finding Udio's vocal stems to be of higher quality.

Key Takeaways:

• Simultaneous Updates: Both Suno and Udio released stem updates on the same day, sparking a competition in AI music generation.

• Udio's Enhancements: Udio's version 1.5 includes better audio quality, key control, global language results, and new features like dedicated creation pages, stem downloads, audio remixing, audio uploads, and shareable lyric videos.

• Suno's New Feature: Suno now allows Pro and Premier users to separate vocals and instruments from songs, giving users more control over their music creation.

• Testing Method: The reviewer created reggae-style songs using ChatGPT for lyrics and compared the stem separation quality of both platforms.

Why it’s important:  For video editors and music professionals, understanding the capabilities and limitations of AI music tools like Suno and Udio is crucial. These tools can significantly enhance the creative process by automating tasks like stem separation and song generation. However, the quality of the output and the range of features available can vary, making it important to choose the right tool for your needs. This comparison provides valuable insights into the strengths and weaknesses of both platforms, helping users make informed decisions about which AI music generator to use.

ROUNDTABLE DISCUSSION
AI in Hollywood: Industry Leaders On the Future of Filmmaking 🎬

TL;DR: A panel of experts at the Digital Hollywood AI Summit discussed the trajectory of generative AI in video production, exploring its current applications and future potential. The diverse panel included AI filmmakers, technology executives, and industry innovators, offering a comprehensive view of AI's impact on Hollywood.

Panelists:

• Paul Trillo: A leading AI filmmaker known for his work with Sora and other AI tools, shared insights on the current state and future of AI in filmmaking.

• Jen Hollingsworth: Chief Commercial Officer at Wallace AI, discussed the commercial applications and business implications of AI in the entertainment industry.

• Renard Jenkins: CEO of I2A2 Technology and a prominent AI evangelist, provided perspectives on AI innovation and its transformative potential.

• Andy Beach: CTO of the Media and Entertainment Group at Microsoft, highlighted the technological advancements and AI initiatives at Microsoft.

• Philip Fury: Founder of Artistic Inertia, focused on the creative and storytelling possibilities enabled by AI, particularly in story retelling and implementation.

• Moderated by Peter Csathy: Chairman, Creative Media

Why it’s important:  This roundtable discussion provides valuable insights into how AI is transforming the film industry. For creative professionals, understanding these developments is crucial as AI tools become increasingly integrated into various aspects of filmmaking. The diverse perspectives offered by the panelists shed light on both the opportunities and challenges that AI presents to the industry, helping filmmakers, producers, and other industry professionals prepare for and adapt to the evolving landscape of AI-driven content creation.

VIDEO
Kling AI Video Generator Goes Global 🌍 

TL;DR: Kling AI Video Generator has launched globally, offering a user-friendly platform for creating AI-generated videos using text prompts. The international version provides basic features like image-to-video conversion and daily free points, though some advanced features are still limited.

Key Takeaways:

• Global Availability: Kling AI is now accessible worldwide with a new URL, providing a similar user interface to its Chinese version.

• User-Friendly Platform: Users can sign in with an email address to create AI videos by setting text prompts and video preferences.

• Daily Free Points: The platform offers 66 free points daily for video creation, with each 5-second video consuming 10 points.

• Basic Features Available: Basic functionalities like image-to-video conversion are available, but some advanced features are still limited on the international site.

Why it’s important:  The global launch of Kling AI Video Generator democratizes access to advanced AI video creation tools, making it easier for creative professionals and enthusiasts worldwide to produce high-quality videos. By offering a user-friendly interface and daily free points, Kling AI lowers the barrier to entry for AI video generation, fostering innovation and creativity in digital content creation. This expansion also positions Kling AI as a competitive player in the AI video generation market, challenging established tools like OpenAI's Sora.

ESSENTIAL TOOLS

Tools to Check Out

Essential tools page/database still under construction. Until then, check out and bookmark the following pages.

• RunwayML - The first mover and leading vendor of AI Video-gen and editing tools. Look at their new Gen-3 feature

• Luma Dream Machine - Another powerful AI video generator with lots of features.

• PikaLabs - The closest competitor to Runway but coming on fast

• Midjourney - Leader in still image generation.

• Pixverse - Another good video generator. Simple to use.

• Hedra - Generate expressive and controllable human characters

• ElevenLabs - Powerful AI voice generator

• Suno - Currently considered the best AI music generator

• Udio (beta) - Neck and neck with Suno for music generation

• Claude 3.5 Sonnet - Claude’s new model that’s taking the chatbot world by storm.

• ChatGPT - Well, you probably already know and are using this one

SHORT TAKES

• 🤖 Meta Releases New Open-Source AI Model: Llama 3.1

• 🎨 Adobe Supercharges Illustrator and Photoshop with AI-Powered Innovations

• 🌍 "700 Days in Homs" AI-Generated Doc in Development

• 👩‍💻 New Tech “DynIBaR” Could Revolutionize 3D Video Creation 

• 💰 Canva Acquires Leonardo AI to Enhance Generative AI Capabilities

• 🚀 Leonardo AI Releases Leonardo for Teams 

• 🎬 Stability AI Unveils Stable Video 4D: Multi-Angle Video Generation

ONE MORE THING…

Released about 2 months ago, this weeks short is Holy Obsidian from TRGNY. Check more of his, (or her?) work on their YouTube Channel and let me know what you think.

If you have specific feedback or anything interesting you’d like to share, please let us know by replying to this email.

AIography may earn a commission for products purchased through some links in this newsletter. This doesn't affect our editorial independence or influence our recommendations—we're just keeping the AI lights on!