😺 DIY AI special effects

PLUS: Did ChatGPT start messaging people first?!
September 16, 2024

😺 DIY AI special effects

PLUS: Did ChatGPT start messaging people first?!
September 16, 2024
In Partnership with

Welcome, humans.

We’ve been seeing A LOT of AI music videos lately. Like check out this one that uses Flux Schnell images, to Runway Gen 3 videos, set to Udio music, with lyrics by o1:

Hmmm…. who does this remind you of…?

Some other instant-hits:

Y’know what someone should do? Bring back MTV (“back when MTV used to play music videos”) as a Youtube live channel that streams AI music videos 24/7.

Here’s what you need to know about AI today:

  • Runway launched a new “video to video” feature.
  • Midjourney to add external photo editing and 3D features soon.
  • Tencent created AI open-world game generator.
  • ChatGPT allegedly messaged someone first.

Advertise in The Neuron here.

Runway just released “Video to Video” capabilities—here’s what that means.

Last Friday, Runway released video-to-video for its Gen-3 model, which essentially lets you alter a video through simple text commands. For example, “change the background of me walking to be in NYC.”

What people are saying: Early users note inconsistent style across clips, with a “wide discrepancy” between high fidelity and “smudgy” images.

While the new video maintains the movements of the original, the new creations can still struggle to emulate physics accurately.

Sometimes you want a Phoenix flying through a jungle, and you get a Phoenix that IS a jungle.

That said, video to video is probably the closest you can get to “controlling” the output of a video generator, so it’s a must-have if you want to seriously create AI videos.

Creators have already demo’d over 35 impressive use-cases:

  1. Add filters to various video types:
    1. Dance videos, performance videos, youtube videos, music videos, video game streams, memes, anime fight scenes, and stock footage (1, 2, 3).
  2. Provide a change of scenery (1, 2, 3).
  3. Generate a clip with Midjourney image-to-video, then change the style (1, 2, 3, 4).
  4. Create homemade Hollywood effects—no green screen required (1, 2, 3).
  5. Animate selfies (1, 2), pets, and kids.
  6. Turn motion capture CGI into a “rendered” animation.
  7. Create a visual effects mask on your footage (like the VFX pros do).
  8. Create ad mockups for a potential product video (another example).
  9. Make an animated movie out of your kids toys–or their crafts.
  10. Create realistic lip syncs.
  11. Create video game footage in real life.
  12. Send a car into outer space.
  13. Become anyone, anywhere.

Here’s Runway’s guide on how to use.

The TLDR: upload your reference vid, write your prompt, adjust the “structure transformation” score (0 for an exact match, 1 for very different), and generate. Max input is 64mb (1280x768p) with 720p output.

For best results, use 5-10 second clips, a “fixed seed” for consistent styles, and distort your vid if needed. Here’s a tutorial video, with more examples.

FROM OUR PARTNERS

Have an AI idea but don’t know how to build it?

Hire world-class AI experts from Harvard, Stanford and MIT.

If you know AI should be a part of your business but don’t know how to implement it, you need AE Studio.

Their team is stacked with elite software creators who can turn any AI concept into reality for your business—think automated reports, NLP, custom chatbots, and beyond.

The secret to their success is treating your project as if it were their own startup.

Tell AE Studio about your business challenge today. They’ll listen to you, take the time to “get” it, and do the work you need to get done.

Around the Horn.

Treats To Try.

  1. *In sales, timing is everything. But how can you stay on top of every lead when you're juggling dozens of calls a day? Easy. Let Attention automate email follow-ups so you can focus on closing more deals.
  2. Selfplanr creates weekly plans for high school students to help them prepare for admission to elite colleges.
  3. MindPal helps you turn your personal expertise into an agent workflow you can sell to others (without any coding).
  4. DryMerge lets you connect your favorite apps and automate repetitive tasks, like an AI Zapier—this report says it's a bit buggy atm, but a cool product to try.

See our top 51 AI Tools for Business here!

*This is sponsored content. Advertise in The Neuron here.

What gives it away that this is AI?

Your job is to tell us what about the video below gives it away as being AI. Click the link, watch the vid, and then answer the poll with your best take!

What gives it away that this video is AI?

Write in

Write in, pt. 2

Monday Meme.

A Cat's Commentary.

If you missed yesterday’s Sunday newsletter, check your inbox!
cat carticature

See you cool cats on X!

Get your brand in front of 450,000+ professionals here
www.theneuron.ai/newsletter/diy-ai-special-effects

Get the latest AI

email graphics

right in

email inbox graphics

Your Inbox

Join 450,000+ professionals from top companies like Disney, Apple and Tesla. 100% Free.