- AIography
- Posts
- AI Breakthroughs: Redefining the Future of Filmmaking
AI Breakthroughs: Redefining the Future of Filmmaking
Explore the latest AI innovations transforming Hollywood and beyond!
Welcome to Today’s AIography!
The AI revolution in media production is accelerating at an unprecedented pace! Today, we’re exploring DNEG's massive $200M boost to develop groundbreaking AI CGI tools, and how Apple and OpenAI are joining forces, making Hollywood studios nervous. Discover how AI is reviving the voices of iconic celebrities, and the significant impacts generative AI is having on film and TV jobs, shaking up the industry.
We’ll also delve into the latest leaps in AI video technology, influencing every facet of media production, and Meta's rapid advancements in creating 3D images. Get ready for a whirlwind tour of the cutting-edge AI developments that are redefining creativity and transforming the future of filmmaking. Let’s dive in!
In today’s AIography:
DNEG gets $200M for AI CGI tools development 🎬
Apple, OpenAI deepen ties; Hollywood cautious 🎬
AI revives celebrity voices for narration app 🎧
Generative AI reshaping film, TV jobs significantly 🎬
AI video tech leaps; influences media production 📹
Meta's AI creates 3D images - Fast 🌐
Read time: About 5 minutes
THE LATEST NEWS
TL;DR: DNEG received a $200M investment to develop AI-driven CGI tools through its new subsidiary Brahma, aiming to revolutionize visual effects production and establish Abu Dhabi as a creative tech hub.
Key Takeaways:
DNEG secured a $200M investment from United Al Saqer Group to develop AI-powered CGI tools via their new tech division, Brahma.
Brahma aims to utilize AI to transform VFX production, leveraging 25-year data to enhance visual effects quality and efficiency.
The launch of Brahma and a new office in Abu Dhabi mark a strategic shift, positioning the region as a high-tech creative hub.
This strategic move aims to lower VFX production costs significantly while expanding DNEG's market reach and artistic capacity.
Why it’s important: DNEG's $200M funding for AI-powered CGI tools marks a pivotal shift in film production, promising both artistic and economic transformations. This investment could significantly reduce costs and enhance VFX quality, positioning Abu Dhabi as a new high-tech creative hub and potentially reshaping global content production landscapes.
AIOGRAPHY TECH
Apple, OpenAI deepen ties; Hollywood cautious 🎬
AI Generated Image
TL;DR: Apple and OpenAI's deepening partnership, involving Phil Schiller as a board observer and leveraging AI for content creation, has Hollywood cautiously navigating AI's legal and ethical implications.
Key Takeaways:
Apple and OpenAI's expanded partnership includes Phil Schiller observing OpenAI's board, merging tech with creative sectors.
OpenAI's Sora, a tool capable of creating hyper-realistic videos from text, showcases AI's evolution in content creation.
Other studios remain quiet, possibly due to concerns over AI's implications on intellectual property and creative roles.
Hollywood's cautious stance may reflect a wait-and-see approach to AI's legal and ethical impacts in entertainment.
Why it’s important: Apple and OpenAI's deepening alliance signals a monumental shift in entertainment, pushing AI to the forefront. Studios' silence reflects apprehension about AI's transformative impact on creativity, intellectual property, and jobs, shaping the future discourse in policy and industry operations.
Getty Photos: Everett Collection
TL;DR: ElevenLabs has partnered with some famous actors' estates, leveraging AI to bring their iconic voices to its Reader App, ensuring ethical use aligned with new AI entertainment laws.
Key Takeaways:
ElevenLabs finalized deals with estates of Judy Garland, James Dean, and others, using their voices in its Reader App.
The Reader App turns text into audio using iconic voices, enhancing listener experiences with context-aware narratives.
Licensing with CMG Worldwide ensures ethical use of celebrity voices, preventing unauthorized AI-generated content creation.
This partnership could influence future AI entertainment ethics, aligning with trends and laws like California's AB 1836.
Why it’s important: ElevenLabs' deals catalyze a new realm in digital storytelling by ethically using revered celebrity voices, enhancing user engagement and potentially shaping future regulations in AI ethics and the management of digital celebrity legacies.
TL;DR: A Variety VIP+/HarrisX survey finds generative AI poised to reshape film and TV production, impacting roles and improving efficiency but raising crucial ethical issues in media and entertainment.
Key Takeaways:
VIP+ and HarrisX survey shows generative AI to significantly impact film and TV production jobs like animators and VFX artists.
Generative AI is anticipated to increase productivity and improve quality of work, reshaping media and entertainment.
Ethical issues, notably consent, control, and compensation, are highlighted as key as AI integrates into creative sectors.
Industry stakeholders advocate for ethical frameworks and permissions for using AI in replicating human or artistic likenesses.
Why it’s important: The integration of generative AI in the film and TV industry underscores a shift towards more efficient, high-quality production but also demands rigorous ethical frameworks. This evolution not only transforms job functions but also sets the stage for debates on the creative merit and moral boundaries of AI in art.
AI Generated Image
TL;DR: Tristan Wolff's article detailed rapid enhancements in AI video generation tools from 2023 to 2024, indicating potential major shifts in media production industries.
Key Takeaways:
Tristan Wolff's Medium post highlights a year of drastic improvements in AI video generation from May 2023 to July 2024.
Key advancements include transitions from text-to-image to complex image-to-video and text-to-music functionalities.
AI tools like Zeroscope, Midjourney, LumaLabs' Dream Machine, and Suno AI demonstrated substantial enhancements in video & Audio production.
These AI-driven improvements suggest significant future impacts on media sectors like entertainment, marketing, and education.
Why it’s important: Wolff's observations reflect a transformative shift in media production capabilities, powered by AI. As these tools evolve, they not only enhance creative processes but also forecast a forthcoming era where AI predominates in shaping content across various sectors.
TECHNOLOGY/3D
Meta's AI creates 3D images fast 🌐
Image: Meta AI
TL;DR: Meta's latest "3D Gen" AI model rapidly transforms text into detailed 3D images, streamlining content creation in gaming, filmmaking, and VR, and broadening access for creators.
Key Takeaways:
Meta's new "3D Gen" model converts text to detailed 3D images in under a minute, showcasing AI advancements.
The 3D Gen system enhances images with new textures and physically-based rendering via simple text prompts.
This technology promises to simplify the creation of professional 3D assets, democratizing access for various creators.
Potential impacts include transforming game development, filmmaking, and VR with real-time, high-quality content generation.
Why it’s important: Meta's "3D Gen" model is set to revolutionize content creation across multiple industries by significantly lowering the barriers to producing high-quality 3D visuals, potentially speeding up production times and fostering creative innovation in gaming, film, and VR.
ESSENTIAL TOOLS
Tools to Check Out
Essential tools page/database still under construction. Until then, check out and bookmark the following pages. Exploring what they have to offer will provide a solid foundation in understanding what these tools can do. Most of the web-based tools are quite similar, with varying functionality. This hands-on experience will not only enhance your skills but also keep you ahead of the curve in the rapidly evolving world of AI filmmaking.
Microsoft VASA-1: Lifelike audio-driven talking faces
generated in real time (Microsoft Research-Not available yet)RunwayML - The first mover and leading vendor of AI Video-gen and editing tools. Look at their new Gen-3 feature
Claude 3.5 Sonnet - Claude’s new model that’s taking the chatbot world by storm.
ChatGPT - Well, you probably already know and are using this one
PikaLabs - The closest competitor to Runway but coming on fast
Midjourney - Leader in still image generation.
Pixverse - Another good video generator. Simple to use.
Hedra - Generate expressive and controllable human characters
ElevenLabs - Powerful AI voice generator
Suno - Currently considered the best AI music generator
SHORT TAKES
🤖 China’s Kuaishou launches KLING web app
👩💻 AI Start-Up Odyssey Challenges Hollywood Giants
🎥 Exploring LTX Studio: From Story Idea to Final Cut
🎹 Suno's AI Music App hits the App Store
🎮 Nintendo Rejects AI for Game Development
🎭 Nicholas Cage is “Terrified” of AI
🎬 AI transforms filmmaking at Bucheon Film Festival
ONE MORE THING…
This week, we're excited to feature a groundbreaking music video by Arata Fukoe, showcased on X. Crafted entirely with AI using the tools mentioned in his tweet below, this video is a testament to the incredible fusion of technology and art. Take a look at his website to explore his innovative projects, where he’s continually pushing the boundaries of what's possible in the creative realm. Enjoy!
現状最新の生成AIを使いまくってMV的なものを作ってみました(内容はめちゃくちゃ)🙌
Tools Utilized ↓
Music : ChatGPT,Sunoai
Video : DreamMachine,Gen-3,Kling
Image :MJ,SD
Edit : Ps,Ae特に人物とかは大きい画面で見ると粗が目立ちますが、使い方次第でなんとか誤魔化せるかなといった感じ🤔
— Arata Fukoe (@Arata_Fukoe)
6:44 AM • Jul 7, 2024
What did you think of today's newsletter?Vote to help us make it better for you. |
If you have specific feedback or anything interesting you’d like to share, please let us know by replying to this email.
AIography may earn a commission for products purchased through some links in this newsletter. This doesn't affect our editorial independence or influence our recommendations—we're just keeping the AI lights on!
Learn AI in 5 Minutes a Day
AI Tool Report is one of the fastest-growing and most respected newsletters in the world, with over 550,000 readers from companies like OpenAI, Nvidia, Meta, Microsoft, and more.
Our research team spends hundreds of hours a week summarizing the latest news, and finding you the best opportunities to save time and earn more using AI.
Reply