Auto reframe: horizontal to vertical video with AI speaker tracking
First video free up to 60 min, then 20 min a month, watermarked, no card. Drop the watermark from $12/month.
No link handy? Upload the file in the app instead. Sources need at least 45 seconds of footage.
A 16:9 frame is 1.78 times wider than tall; a 9:16 one is 0.56. Going from landscape to portrait throws away about two thirds of the width, and the only question is which two thirds. A static crop answers once for the whole video. Auto reframe answers scene by scene, and here with more than one shape: a tracked crop for one speaker, two stacked halves for two, a full-width screen with the presenter underneath.
Paste a long horizontal video and you get vertical clips back with the framing already decided, plus an editor to overrule it on scenes where it chose wrong.
Free plan: your first video cut whole up to 60 minutes, then 20 minutes a month, with a watermark and no card. Paid plans start at $12/month without one.
How auto reframe works here
1. Paste a link or upload the video
Any horizontal recording works: an interview, a two-camera podcast, a screen tutorial, a stream with a facecam. Paste a public link or upload the file; it needs at least 45 seconds of material.
2. AI cuts the clips and decides the frame
The best moments are picked from the transcript, then each clip is reframed scene by scene: faces tracked, two people in one shot stacked, screens kept readable and a corner webcam enlarged.
3. Check, adjust, export
Every clip comes back 9:16 with captions. Where the AI framed a scene wrong, draw the crop yourself for that scene in the reframe editor, then download or post to TikTok, Shorts and Instagram.
Auto reframe versus a static crop
There are two ways to make a horizontal video vertical. The first is a fixed treatment: keep a vertical slice at one position, or shrink the whole picture into the middle over a blurred copy or black bars. That is what the free video to 9:16 converter does, in your browser, with no upload. It is the right tool for a short clip where the subject stays put, a slide deck, or a wide shot you want whole. Most tools sold as a vertical video converter are this kind.
The second is to look at the picture. A person walking across the stage, two people taking turns, a presenter who shares a screen halfway through: each needs the frame to change with the content, and no single crop position can do it. Auto reframe does the looking. The difference shows up most on exactly the footage people want to clip, interviews and podcasts, where a fixed centre crop either cuts the guest out or shows an empty chair. Church services are the other common case: a preacher walking the stage through a whole sermon, which the sermon clip creator handles with the same tracking.
Genuine Clipping AI output, not a mock-up. A two-person podcast: both hosts stacked in half-frames, with captions riding the seam so neither face gets covered. Credit: Turn the Tables with Dan and Shoshana Jordan, Heritage of Faith, CC BY.
The layouts, and when each is used
The layout is decided per scene, not once per video, because one video mixes shots: an edited podcast cuts between close-ups and a wide two-shot, a tutorial cuts between the camera and the screen.
Tracked crop (one speaker)
A single subject is followed with MediaPipe face detection, with a YOLOv8 person detector as backup when the face is lost. The camera is damped by a stabiliser that holds still while the subject stays inside a safe zone and only moves when they leave it, so the clip looks operated rather than jittery. A detection that jumps past the safe zone in one frame has to repeat before the camera follows, which stops a passing face from yanking the frame.
Stacked split (two people in one shot)
When two faces are visible in the same frame for at least half the sampled frames, the scene is stacked, one person per half. That condition is what separates a real two-shot from shot and reverse shot, where stacking would show the same person twice. Captions on a stacked stretch sit on the seam between the halves, where they cover nobody.
Screen and presenter
For tutorials and demos each shot is classed from one still: a screen, a screen beside the presenter, or a camera shot. A full screen keeps its width, cropped to the area actually being read; a presenter beside their content is stacked under the content columns; a webcam window floating over the screen is boxed and enlarged below it.
Wide content
When what matters spans more of the frame than any crop can keep (a group on a stage, a map, a chase), the scene zooms about 1.3 times around the motion, keeping roughly three quarters of the width between the hook and the captions instead of a thin full-width strip or a random vertical column.
Facecam inset
A stream or recording with a webcam composited into a corner is spotted by geometry: a subject small, off centre and still. The clip renders the main picture across the top and the webcam enlarged below.
Speaker cuts and punch-ins
Two more options live on the API (layouts:
speaker_cut, punch_in): hard cuts to whoever is talking,
decided from mouth activity normalised per speaker, and a small push in on the
beats of the audio.
The layout choice itself comes from twelve stills of the video, sent to Gemini at 1024 pixels with a closed question rather than the whole video: on a hand-labelled set of 48 clips it picks the right layout 92 to 96% of the time, and costs the same whether the source runs ten minutes or three hours.
When the AI frames a scene wrong
Automatic framing is right most of the time and occasionally wrong in a way nobody would accept: the crop on the interviewer while the guest talks, a face in the audience instead of on stage. The reframe editor fixes that scene by scene. Each scene plays with the uncropped picture and its crop rectangle over it, so you can judge it with motion and sound; drag the rectangle or split it into two stacked regions, and only scenes you touched get re-rendered. The rest stay automatic.
Sources already vertical, and output size
A source shot vertical passes through untouched: every layout above exists to win back width a crop throws away, and a vertical video has none to give. Horizontal sources are delivered at least 1080 pixels wide, so a 1080p recording becomes 1080x1920. A smaller crop is scaled up to that floor; a larger source is never scaled down.
Auto Reframe in Premiere Pro or CapCut vs Clipping AI
Premiere Pro and CapCut both have an auto reframe feature, and it is good at what it does: inside your edit, it reframes a clip or sequence you have already cut to a new aspect ratio, following the motion in the shot. It is a manual workflow with an automatic step in it. You still choose the moments, cut them, set up the sequence, check the framing and add captions yourself, one video at a time.
Clipping AI puts reframing somewhere else: it is one stage of turning a long recording into clips, after the moments are picked and before captions are burned, with nobody in an editor. And it can change the frame's shape (stacked halves for two people, screen over presenter, an enlarged webcam), not just the position of one crop.
- Use the editor's feature when you already have a finished horizontal edit and only need it vertical, or when you want frame-by-frame control in an editor you know.
- Use Clipping AI when you start from a long recording and want clips found, cut, reframed and captioned for you.
- Use the free converter for a short file where one fixed crop is enough.
Free tiers, side by side
Competitor plans checked 5 October 2026 on their public pricing pages.
| Tool | Free plan | Paid from |
|---|---|---|
| Clipping AI Cloud | First video up to 60 min, then 20 min/month. Watermark, no card | $12/month, 100 min, watermark-free |
| 2short.ai | 30 minutes of AI analysis a month, YouTube links only, no watermark, 1080p | $9.90/month |
| Klap | One video to try it, no card. There is no ongoing free tier. | $14/month billed annually |
| Opus Clip | 60 credits a month (one credit is one minute of source video), exports up to 1080p with a watermark, no editing, clips must be exported within 3 days | $15/month |
| Submagic | No free tier. A trial with no card is offered instead. | $12/month billed annually |
Every tool here reframes with face tracking. The differences are the layouts beyond a single crop: Klap lists split-screen, screencast and gaming layouts, 2short.ai keeps one centred speaker and Submagic is a caption editor first.
What it does not do
- It does not reframe a whole long video into one vertical file. It reframes the clips it cuts, each up to 180 seconds.
- It does not output square or 4:5. The target is 9:16.
- It does not take sources under 45 seconds. For a short file, use the free converter.
- It does not track objects or animals as subjects: tracking is for faces and people.
- It cannot invent picture. When the content is wider than any crop, it keeps about three quarters of the width, centred on the motion, over a blurred backdrop rather than guessing.
- Free clips carry a watermark. A paid plan removes it, from clips already made too.
Questions people ask
- What does auto reframe mean?
- Turning a horizontal video vertical (or to another aspect ratio) by moving the crop to follow what matters in the shot, usually a face, instead of cutting a fixed slice from the middle. Here it is one stage of turning a long video into vertical clips.
- Is auto reframe free?
- On the hosted free plan your first video is cut whole up to 60 minutes, then 20 minutes a month, with a watermark and no card; paid plans start at $12/month without one. For a quick static crop of a short file, the free video to 9:16 converter runs in your browser with no account and no watermark.
- How is this different from the free 9:16 converter?
- The converter applies one fixed treatment to the whole file (crop at a position you choose, blurred background or black bars) and never looks at what is in frame. Auto reframe tracks faces, decides a layout per scene and cuts the video into clips. Use the converter for a short clip you already cut; use auto reframe for a long recording with people in it.
- Can it reframe a whole video into one vertical video?
- No. It reframes the clips it cuts, each up to 180 seconds when you raise the ceiling. To convert a whole short video in one piece with a fixed crop, use the free 9:16 converter, which takes up to 5 minutes in the browser.
- What happens with two people in shot?
- When both faces are visible in the same frame for at least half the sampled frames, the scene is stacked: one person in each half of the vertical frame, captions on the seam between them. Shot and reverse shot (one person at a time) stays a single tracked crop, so nobody appears twice.
- Does it work on screen recordings?
- Yes. With the layout on auto or screencast, each shot is classed as screen, screen beside a presenter or camera. A screen keeps its full width, cropped to the area being read; a presenter beside it is stacked under the content; a webcam floating over the screen is enlarged below.
- What if my video is already vertical?
- It passes through untouched. Every layout exists to win back width a crop throws away, and a vertical source has none to lose.
- Can I correct the framing?
- Yes. The reframe editor plays each scene with the uncropped picture and the crop rectangle over it, so you can move the rectangle or split it into two stacked regions. Scenes you leave alone stay automatic.
- What resolution is the output?
- At least 1080 pixels wide: a 1080p source gives 1080x1920. A smaller crop is scaled up to that floor; a larger source is never scaled down.
- How is this different from auto reframe in Premiere Pro or CapCut?
- Those reframe footage you have already edited, inside the editor, with you choosing the moments and adding captions. Here reframing is one automatic stage of turning a long recording into clips: moments are picked, cut, reframed per scene (including stacked two-speaker and screen layouts) and captioned with no editor. For a finished horizontal edit that only needs to be vertical, the editor feature is the shorter path.
- Can it convert landscape to portrait video?
- Yes, as clips: each cut from a landscape (16:9) recording comes back as portrait 9:16, reframed scene by scene. To convert a short landscape video to portrait in one piece with a fixed crop, use the free 9:16 converter.
- How does it compare with Opus Clip or 2short.ai auto reframe?
- Both face-track to 9:16. 2short.ai keeps the speaker centred with one tracked crop and has an unwatermarked 30-minute free plan, YouTube links only (checked 5 October 2026). Clipping AI adds stacked two-speaker, screencast and webcam-inset layouts, plus per-scene manual overrides.
Sources & checks
- Layout picker accuracy (12 stills at 1024 px, 92 to 96% on a hand-labelled 48-clip set), split and screencast rules and the vertical pass-through:
layout_picker.py,split_layout.py,screencast_layout.py,reframe_v2.py. - Competitor plans: our comparison data, checked 5 October 2026. See 2short AI.