• AIography
  • Posts
  • AI's New Frontiers: Showrunner, Tribeca, and More! 🚀

AI's New Frontiers: Showrunner, Tribeca, and More! 🚀

Welcome Back to AIography!

This week, we're starting with a bang—Fable Studios new "Showrunner" platform is making waves by enabling anyone to create their own AI-generated “episodes,” potentially transforming content creation. Meanwhile, OpenAI's Sora is sparking excitement and debate as Tribeca prepares to showcase AI-generated short films. We also dive into why the "Spider-Verse" team is keeping AI at bay to preserve human creativity, and how Neil Druckmann of "The Last of Us" envisions AI shaping game development.

But that's not all—check out ElevenLabs' groundbreaking AI audio model, which is democratizing sound design, and the latest from Adobe's Photoshop, where Generative Fill is shaking up image editing. From industry pioneers to emerging tech, this week's newsletter is packed with insights and innovations. Buckle up and enjoy the ride!

In today’s AIography:

  • Fable's Showrunner AI redefines content creation

  • "Spider-Verse" avoids AI, prioritizes human creativity

  • “The Last of Us” director discusses AI, spurs debate

  • ElevenLabs AI model creates diverse sound effects

  • Tribeca to Screen AI-Generated Short Films Created by OpenAI’s Sora

  • AI film “Air Head” still needed help in post

  • Photoshop’s generative fill enhances image editing

Read time: About 5 minutes

THE LATEST NEWS

Image Credit: Showrunner

TL;DR: Fable Studios introduces Showrunner, (well, you can join a wait list, it’s not out yet) an AI streaming service enabling users to create their own episodes, potentially transforming entertainment production but sparking concerns about creative roles and copyright issues.

Key Takeaways:

  • Fable's new AI streaming service, Showrunner, allows users to create episodes, showcasing a shift in entertainment production.

  • Showrunner's versatile features let viewers script, voice, and animate shows, democratizing content creation with AI.

  • The platform could lower production costs and transform viewer experiences, but raises concerns about traditional creative roles.

  • Showrunner's impact may lead to debates on copyright, creativity, and the future role of human artists in digital media.

Why it’s important: Showrunner by Fable marks a pivotal shift in the entertainment landscape, turning viewers into creators and potentially diminishing the role of traditional content producers. Its impact extends beyond technology, stirring significant debates on copyright, creativity, and the valuation of human artistic labor in the digital era.

Image: Sony Pictures

TL;DR: Christopher Miller, producer of Sony's "Spider-Verse," opposes using generative AI in film production, prioritizing human creativity amidst industry debates over AI's role in the arts.

Key Takeaways:

  • Christopher Miller commits to excluding generative AI in the creation of the "Spider-Verse" series, emphasizing original artistry.

  • Sony's CEO, Tony Vinciquerra, contrasts by advocating for AI to enhance film and TV production efficiency.

  • Miller's stance reflects a broader concern in the film industry about AI compromising the quality and creativity of human-driven content.

  • The ongoing debate on AI in filmmaking delves into issues like job preservation, ethical technology use, and maintaining artistic integrity.

Why it’s important: Christopher Miller's commitment to avoid generative AI in the "Spider-Verse" series sets a tone in Hollywood that prioritizes human creativity and traditional craftsmanship over technological efficiency, impacting the industry's discussion on balancing innovation with artistic integrity.

Jeff Kravitz/FilmMagic for HBO

TL;DR: Naughty Dog's Neil Druckmann discussed AI's transformative potential in game development, emphasizing efficiency and enhanced creativity but calling for ethical integration to avoid replacing human jobs.

Key Takeaways:

  • Neil Druckmann, Naughty Dog's Head of Creative, discussed AI's role in future game development and storytelling.

  • Druckmann highlighted AI's potential to simplify production and expand creative possibilities, transitioning from hand-animation to motion capture.

  • Ethical concerns arise with AI in gaming, such as replacing human jobs, with Druckmann advocating for AI to augment rather than replace human creativity.

  • Broader industry leaders also see AI's value in enhancing game personalization and efficiency, while stressing the importance of skilled human oversight.

Why it’s important: Druckman's vision of AI in game development represents a critical evolution in how games are made and experienced. His emphasis on blending AI with human creativity hopefully would set a new industry standard, balancing innovative technology and ethical considerations in the rapidly evolving gaming landscape.

Audio Workstation

AI generated image

TL;DR:  ElevenLabs collaborates with Shutterstock, launching an AI Audio model that transforms text into diverse, professional-quality sound effects, democratizing audio production for all content creators.

Key Takeaways:

  • ElevenLabs introduces an AI Audio model that generates sound effects and voices from text, enhancing content creation tools.

  • The model supports a wide range of industries, including film, TV, gaming, and social media.

  • Developed in partnership with Shutterstock using their ethically-sourced audio library for diverse, high-quality sounds.

  • This innovation democratizes professional-grade audio, empowering both major studios and individual creators

Why it’s impotant: ElevenLabs' AI Audio model represents a major democratization of professional audio tools, potentially transforming content creation by enabling both industry giants and independent creators to produce rich, high-quality soundscapes affordably and efficiently.

FESTIVALS
OpenAI's Sora AI debuts at Tribeca 🎬💡

Image: Tribeca Film Festival

TL;DR: The Tribeca Film Festival will feature five AI-generated short films created by OpenAI’s Sora, highlighting advancements in AI filmmaking. The initiative involves notable filmmakers like 'Nanny' director Nikyatu Jusu. This marks a significant milestone in the integration of AI in creative processes.

Key Takeaways:

  • Historic Screening: Tribeca Festival dedicates a new program, Sora Shorts, to AI-generated films using OpenAI’s Sora model.

  • Diverse Filmmakers: The initiative includes notable filmmakers such as Nikyatu Jusu, Bonnie Discepolo, Ellie Foumbi, Reza Sixo Safai, and Michaela Ternasky-Holland.

  • Technological Capabilities: Sora enables the creation of longer and more complex video content up to 60 seconds, with advanced features like distinct camera moves and background interactions.

  • Broader Impact: The event underscores the evolving role of AI in filmmaking, with implications for industry practices and creative possibilities.

Why it’s important: OpenAI's Sora could revolutionize filmmaking, making the process more efficient and data-driven. Its debut at Tribeca signals a significant industry shift, where AI's role in creative decisions grows, potentially altering traditional roles and filmmaking techniques.

Editing Timeline

TL;DR: The video "Air Head," claimed to be AI-generated, required significant human editing, sparking discussions on the real capabilities of AI in video production and its future role.

Key Takeaways:

  • "Air Head," initially touted as AI-generated, required human-led post-production, highlighting current AI limitations.

  • The incident underscores the gap between AI's promotional claims and its actual practical functionalities in video production.

  • Filmmakers and tech enthusiasts are prompted to reevaluate the role of AI in creative processes due to these revelations.

  • The ongoing discussions may drive technological advancements aimed at harmonizing AI efficiency with human creative insight.

Why it’s important: The "Air Head" production serves as a case study in AI's current state in creative industries, illustrating the gap between expectation and reality. It prompts critical reflection and potentially accelerates efforts to enhance AI tools to better complement human creativity.

Image: Adobe

TL;DR:  Photoshop's 2024 update introduces Generative Fill, revolutionizing digital imaging by allowing expansive, creative edits and adding new elements, transforming the landscape of photography and design.

Key Takeaways:

  • Photoshop's 2024 update includes Generative Fill, expanding photos from portrait to landscape seamlessly.

  • Unlike Content Aware Fill, Generative Fill adds new, non-repetitive elements to enhance original images.

  • The tool allows for extensive creative edits by expanding canvas sizes and transforming perspectives.

  • Generative Fill impacts digital photography and design by saving time and encouraging bold experimentation.

Why it’s important: Photoshop's Generative Fill marks a paradigm shift in digital editing, empowering creatives with the tools to reinvent images effortlessly, setting new industry standards for innovation and artistic freedom.

ESSENTIAL TOOLS

Tools to Check Out

I’ll be starting an essential tools page/database soon. Until then, you should check out the following pages. You’re obviously not going to be creating a feature film with these, but I believe that learning them will provide a solid foundation in understanding what these tools can do.

Even if you’re just exploring, playing around with these interfaces will give you some valuable insights. Most of the web-based tools are quite similar, with varying functionality. This hands-on experience will not only enhance your skills but also keep you ahead of the curve in the rapidly evolving world of AI filmmaking.

  • RunwayML - The first mover and leading vendor of AI Video-gen and editing tools. Look at their Gen-2 feature

  • ChatGPT - Well, you probably already know and are using this one

  • PikaLabs - The closest competitor to Runway but coming on fast

  • Midjourney - Leader in still image gen.

  • Pixverse - Another good video generator. Simple to use.

  • Haiper - Video generator founded by people from DeepMind 7 Tiktok

  • ElevenLabs - Powerful AI voice generator

  • Suno - Currently considered the best AI music generator

SHORT TAKES

  • âť“How Will Generative AI Transform the Filmmaking Landscape?

  • 🎞️ Premiere, Resolve, Final Cut integrating AI to enhance editing efficiency

  • 👩‍💻Viggle AI, a popular video generation platform, is struggling with server overloads due to a surge in traffic, leading to restricted operations and prompting users to seek alternative services.

  • 🎥Sony Pictures is integrating AI into its film production processes, aiming to boost efficiency and cut costs. The move could redefine industry standards but raises concerns about job security and creative integrity.

  • đź’ĽDisney CEO Bob Iger believes Walt Disney would have endorsed AI in filmmaking as a modern tool to enhance storytelling, continuing Disney’s legacy of embracing innovative technologies.

  • 🍿The AI Film Academy introduced the AIFA Awards in Lisbon to celebrate AI's growing influence in democratizing the film industry, empowering diverse new filmmakers while addressing ethical concerns.

THAT’S IT FOR THIS WEEK

This short animation was 100% AI Generated with a program called ComfyUI, a visual, node-based interface for Stable Diffusion from Stability.ai. While it can be intimidating at first, ComfyUI allows users to create, modify, and manage the image generation process in a more intuitive and visual way by connecting different processing components, or "nodes." This approach can make the use of Stable Diffusion more accessible and flexible, particularly for those who prefer a graphical interface over coding.

@aiography

Meet Broody Bunch, some cartoon characters with a flair for the dramatic! With their gravity-defying hair and fierce glare, they look like... See more

What did you think of today's newsletter?

Vote to help us make it better for you.

Login or Subscribe to participate in polls.

If you have specific feedback or anything interesting you’d like to share, please let us know by replying to this email.

Help me get the word out. Please share AIography with your fellow creatives!

Reply

or to participate.