• NewsLounge
  • Posts
  • 🚀😲Gen-AI 3D on Immersive Mobile

🚀😲Gen-AI 3D on Immersive Mobile

newslounge.co · July 30, 2024

Good Morning. 

🤷‍♂️First, I wanted to apologize for being MIA for a couple of weeks. I have been quite busy and the heat in Los Angeles has been unbearable.
TBH lately, I’ve been thinking a lot about my goals and priorities, ohh, what a fucking rabbit hole!!
Technology has made our lives easier with countless tools to automate everything, but it’s also a major source of anxiety unless you have clear ambitions. General ideas without proper planning can ruin you but specific ambitions can give you direction.

Being busy can be one of the least productive uses of your time. But the irony is, you need to waste a few hours every day to find ways to be more productive.

“You waste years by not being able to waste hours.” -Amor Tversky

Time to think, which doesn’t look productive, can save you years of wasted effort and be the most productive thing you can do. People get stuck in jobs for many years for that.

let me know if these email are helping you in anyway and without further ado, let's get into it.

On today’s menu:

  • Kling AI and Open Sora 1.2

  • RIFE for Nuke

  • Exploring The Future of AR

  • Gen-AI 3D on Immersive Mobile

  • Complex Mix-Fluid in Houdini 20.5

-Ardy

was this email forwarded to you? you can sign up here.

🚨Just a quick note: You can share this newsletter with your friends using the unique referral link at the bottom of this email. By doing so, you'll earn points that can be exchanged for some cool prizes. Let's spread the word! 😎

CASE STUDY

IS KLING AI WORTH THE HYPE?

Yesterday, I decided to test Kling AI and made some fun videos. However, as with many AI models, you never quite know what to expect, and prompting is, of course, very important. Compared to competitors like Runway Gen 3 and the anticipated OpenAI's Sora, Kling AI shows promise but still has some catching up to do in terms of video quality. For instance, Runway Gen 3 produces smoother, higher-quality videos with fewer artifacts. My main issue remains the lack of a clear roadmap for effective prompting.

Open-Sora 1.2 by HPC AI Tech enhances video generation with significant improvements. Key advancements include a 3D-VAE model for better video quality, rectified flow training, and a video compression network using OpenAI’s Sora. The platform supports text-to-video, image-to-video, and video-to-video translation.
🚨Model training has been optimized for efficiency, and comprehensive evaluation metrics ensure high-quality outputs. Open-Sora continues to democratize video production with its open-source approach.

RIFE FOR NUKE

For anyone who has tried making videos in ComfyUI, you should be familiar with RIFE for image interpolation and smoothing out the final animation. Seeing these tools find their way into more professional workflows is very exciting. In this video, Alex introduces RIFE, a frame interpolation or optical flow tool for Nuke. Similar to Kronos, RIFE yields better results, though it is slightly more expensive to run.

RIFE, or Real-Time Intermediate Flow Estimation, uses advanced AI algorithms to predict and generate intermediate frames between existing ones, resulting in smoother and more natural motion.

-Ardy

EXPLORING THE FUTURE OF AR

Check out this incredible mixed reality experience developed by Bascule Japan. This hyper-reality adventure integrates an endless array of virtual objects into our everyday surroundings, offering an unbelievably immersive experience. Developed and filmed using a new "full-speed outdoor AR system," as stated by Director Sho Yanagisawa, it showcases this technology in action.

Recorded on iPhone and tested on Quest 3, this experience is more than just a visual treat—it's a glimpse into the future of interactive media and commerce.

🤿The potential applications of this technology are limitless. Augmented reality (AR) is set to revolutionize various fields:

  • Marketing and Advertising: Brands can create interactive campaigns that engage customers in innovative ways, offering personalized and immersive experiences.

  • Entertainment: AR can enhance movies, games, and live events, providing audiences with a deeper and more interactive experience.

  • Education: AR can bring educational content to life, making learning more engaging and interactive for students of all ages.

  • Retail and E-commerce: AR can allow customers to try products virtually before purchasing, enhancing the online shopping experience.

  • Healthcare: AR can be used for medical training and patient education, providing detailed visualizations of complex medical procedures.

This mixed reality experience is about feeling and engaging with the world in entirely new ways. This tech opens up possibilities for innovative storytelling, interactive learning, and immersive advertising.

🔺Watch the video [Youtube]

-Ardy

SNIPPET

🙋‍♂️According to McKinsey's research, generative AI has the potential to reduce content production costs by 40% and boost marketing efficiency by 2030.

A Hollywood movie like Atlas (2024, Netflix) costs around $100 million to make, with each minute costing $935,000 and each second $16,000. McKinsey research suggests AI content generation tools could reduce these costs by up to 40% by 2030. With the US media and entertainment industry valued at $675 billion (2.5% of the US GDP), this transformation could be worth $270 billion over the next five years, with even greater potential globally.

⛔Runway faces backlash following reports of using AI video training data copied from YouTube.

🚀Alibaba Group introduced Outfit Anyone, a two-stream conditional diffusion model for high-quality virtual try-ons, adaptable to various body shapes and poses.

🤳Meta has introduced its new AI-generator “Imagine Me” which allows users to create images based on their photos.

👩‍💻OpenAI has unveiled SearchGPT, a prototype AI search tool that integrates real-time web data with conversational AI. Currently, it is being tested by a select group of users. This might be their attempt to implement capabilities similar to those of Perplexity.ai

AI TOOLS

Color AI: This tool uses AI to help you find and generate perfect color palettes with sensory and cultural references for your projects. [HERE]

Meshy AI: turn text and images into captivating 3D models. [HERE]

LAUNCH OF THE DAY

Stable Video 4D by stability.ai

Stability AI has released Stable Video 4D, an innovative model for dynamic multi-angle video generation. With this tool, users can upload a single video and specify their desired 3D camera angles. Stable Video 4D then creates eight new videos from different viewpoints, giving a complete, multi-angle perspective of the subject.

Gen-AI 3D on Immersive Mobile

The Lume Pad 2 came with LeiaDream using Stability AI which enabled creators to generate images and view them in 3D without glasses.

Why it’s important?
Imagine a future where this capability extends to prompting 3D models and creating volumetric or stereoscopic videos directly on a mobile device that could switch to immersive mode. 💡 

👩‍💻Learn more [HERE]

-Sponsored

TRENDING

COMPLEX MIX FLUID SIMS IN HOUDINI 20.5

In my opinion, Houdini 20.5 is the most exciting release of Houdini in recent years. The MPM solver, in particular, blew my mind.

Here are some key points:

Multi-material simulations: The MPM Solver can simulate multiple materials in a single simulation, allowing for complex interactions between different fluids and granular substances

Fluid and solid interactions: It's particularly effective at simulating "chunky" materials where large pieces stick together, like snow or soil, as well as interactions between fluids and solids, such as water carrying chunks of soil.

Realistic behavior: The solver can create realistic effects for various materials, including water splashes, mud flows, and soil avalanches

GPU acceleration: The MPM Solver is fully written in OpenCL, taking advantage of powerful GPUs for faster simulations

-NL

🙋‍♂️WE NEED YOUR FEEDBACK…

What'd you think of today's edition?

Login or Subscribe to participate in polls.

INTERESTED IN SPONSORING US OR LEARNING ABOUT AI INTEGRATION IN YOUR STUDIO?

REPLY TO THIS EMAIL TO SCHEDULE A CALL!!

-newslounge

BUT, WAIT! THAT’S NOT ALL! ⬇

🎁You can get free stuff for referring your friends!!

Earn free gifts 🎁

5 referrals - “Water Bottle Stickers” 🔺15 referrals - “Mystery Box”
25 referrals - “Water Bottle” 🔺 40 referrals - “Nuphy Desk Mat”
60 referrals - “Logitech Mouse”