Luma Dream Machine & Runway ML Video Tests

Luma Labs: Dream Machine

Luma Labs just released their “Dream Machine” AI tool to allow video creation with a simple prompt. In addition to creating videos from just a description, you can also create videos from uploaded imagery. Here are samples of some of the first videos I created with the tool and the use cases I believe could be created:

Stock Video Footage

Prompt: students walking across a college campus in autumn

Historical Photos Animated

Prompt: movement of subjects noticing the camera and turning their heads to look at each other

Use case: Take old historical photos from campus archives and animate them to tell your stories.

B-Roll from Photography

Prompt: students walking on campus

From my alma mater, Anderson University, and a photo I found on the Internet.

Use case: Take photos and animate them for video b-roll.

Prompt: students walking across the quad with camera rising up in a drone fashion

Fordham University dolly shot.

Video from Midjourney Image

Prompt: student walking

From my original “not-so-stock” Midjourney image.

 

Runway.ml Gen 2

Another platform, called Runway, which has been out for a while, has brought its capabilities up significantly as well. Here is the same prompt and image that was used in the Luma Dream Machine example:

Before you reject this as poor quality, remember that this is as bad as it ever will be.

How will you use this new tool?