monty
Try Monty free
All articles
Guide2026-07-16· 8 min read

Horizontal to Vertical Video: Smart Face-Tracking Crop, Not a Flat Center Crop

Turn 16:9 into 9:16 for Reels, Shorts and TikTok without chopping off heads. How smart face-tracking crop works, the real numbers, and safe zones.


You have a horizontal clip: an interview, a webinar, a chunk of a podcast, something shot on a camera. The platforms want vertical. Reels, Shorts and TikTok play full-screen on a phone, and that shape is 9:16. The fastest way to convert it is a center crop. The fastest way to ruin it is also a center crop.

Let's break down why a flat center crop cuts off exactly the thing that matters, how smart face-tracking crop actually works, and what numbers sit behind the claim that vertical genuinely wins attention on mobile.

Why a center crop is a bad idea

When you take a 16:9 frame and cut a 9:16 strip out of it, you physically throw away the sides. Only about 56% of the original width survives; the rest goes off-frame (Transcriptr). If you park the crop window in the center and never move it, anyone standing off-center loses half their face. The speaker steps toward the whiteboard and vanishes. Two people in a conversation become an empty wall between them.

A center crop knows nothing about the content. It cuts out the geometric middle of the rectangle, and the important part of a video almost never sits dead center.

Flat center crop

  • Crop window nailed to the frame center
  • Speaker off to the side gets sliced in half
  • Person moves, the frame stays put
  • A two-person chat becomes a blank wall
  • Fast, but it looks like a mistake

Smart tracking crop

  • Window follows the active speaker's face
  • Face always in frame with headroom on top
  • Person shifts, the frame glides after them
  • In a dialog it cuts to whoever is talking
  • Looks like it was shot vertical to begin with
The difference isn't speed. It's whether the point of the shot is even in frame.

What happens when 16:9 becomes 9:16

It helps to see the scale of the loss. A horizontal 1920x1080 frame and a vertical 1080x1920 frame are different worlds. To get true 9:16 with no black bars, you keep a narrow vertical column out of the wide frame. By width, that's a little over half of the original picture.

~44%
of the original frame width falls off-screen going from 16:9 to 9:16 - only about 56% remains (Transcriptr)

That's why the choice of where to place the column decides everything. Place it in the center at random and you throw away a face instead of empty background. Place it by content and glide it with the speaker, and you throw away the background while the person stays in frame.

How smart face-tracking crop works

Under the hood, a proper auto-reframe isn't magic, it's a clear pipeline. First it finds faces on every frame (for example with MediaPipe Face Mesh, which places up to 468 points per face), then decides which face is the main subject right now. Next it computes the vertical window so the face sits in frame with 15-20% headroom on top, and finally it smooths the path of that window so the shot doesn't jitter (Transcriptr).

1Find faces
2Pick the active one
3Compute 9:16 window
4Smooth the path
5Render vertical
The smart-crop pipeline: detect, choose subject, crop, smooth, render.

The key step here is smoothing. If the window chases every tiny head movement, the viewer gets seasick in three seconds. So the path runs through a filter (low-pass or Kalman) with a smoothing window of roughly 10-30 frames: big moves get tracked, small shakes get damped out (Transcriptr).

  • Detection: where the faces are on each frame
  • Tracking: the same person across frames, so the window doesn't jump
  • Crop: a narrow vertical window with air above the head
  • Smoothing: a gentle camera move with no snaps

The numbers: why vertical actually wins

This isn't a matter of taste. People hold phones upright and watch that way. By figures widely cited across the industry, about 94% of smartphone users hold their phone vertically while watching video, and most won't rotate it for a horizontal clip (Embryo). A vertical frame also takes up roughly 78% more screen area on mobile than a horizontal one (Sculpt).

Hold phone upright94%
More screen area for vertical78%
Watch video muted85%
Why vertical and captions aren't optional: industry figures (Embryo, Sculpt).

The same logic drives completion. A widely cited MediaBrix study found vertical videos see roughly a 90% higher completion rate than horizontal ones (Sculpt). And by recent platform observations, a clip in true 9:16 on vertical feeds pulls about 2.3x more engagement than a 1:1 square or a 4:5 cut (quso.ai). The format alone already moves the numbers.

And one thing people keep forgetting: about 85% of feed video is watched with the sound off (Sculpt). So the vertical format alone only does half the job. Without captions burned into the frame, the viewer never learns what the clip is about and scrolls on.

Center crop, manual keyframes, and tracking

There are three ways to get vertical out of horizontal. What separates them is how much time you spend and how reliably the face stays in frame.

Center cropManual keyframesSmart tracking
Face stays in if speaker is off-center
Follows movement✓ by hand✓ auto
Smooth move, no snapsn/adepends on you✓ smoothing
Time per minute of videoseconds10-30 minseconds
Cuts between speakers✓ by hand✓ auto

Manual keyframing gives a perfect result if you're willing to sit and drag the crop window by hand across the whole clip. For a minute of talking that's dozens of adjustments. Smart tracking gets nearly the same quality in seconds, because an algorithm drives the window.

Framing hits retention directly

The first seconds decide. On vertical feeds the viewer scrolls endlessly, and if the opening frame has a forehead sliced off or the person already drifted off the edge, the thumb is already moving. Good framing keeps the eye exactly where it should be for the whole clip.

100% saw the first frame
45% stayed past 3s
18% finished
4% shared
A typical retention funnel on a vertical feed: the crop affects every step.
The rule is simple: if the person's face is out of frame or chopped in the first shot, you lose viewers before they've heard the first word.

9:16 safe zones

Even a perfectly framed face can be ruined by the platform's interface. TikTok, Reels and Shorts draw their own buttons, handle, description and captions on top of your video. The standard canvas is 1080x1920, 9:16. Keep the important stuff away from the edges the interface covers (quso.ai).

  • Bottom: keep face and text above the bottom ~270 px, where the handle, caption and music sit
  • Right: leave ~100 px on the right for the like, comment and share buttons
  • Top: don't push captions to the very top, where icons and the clock live
  • Clips where key content spills outside the safe zone lose completion, by one estimate around 22% (quso.ai)

How Monty does it

Monty takes one take of yours and builds a finished short for each platform out of it. It writes the script in your voice, edits the take (cuts, music, b-roll), adds captions timed to your speech, makes a separate version for each platform, and posts it to Shorts, Reels, TikTok and Telegram. The first video is free.

For horizontal-to-vertical, that means you don't hand-drag a crop window or fit yourself into safe zones. Monty produces the vertical version with captions burned into the frame and posts it itself. Want control? Leave approval on and every video waits for your go. Want autopilot? Put it on a schedule.

Vertical plus captions is the baseline in 2026. Smart cropping is what keeps the face in frame, instead of the wall behind it, when 16:9 becomes 9:16.

FAQ

Can't I just center-crop 16:9 and move on?

You can, if the important thing sits dead center and never moves. In practice it rarely does: the speaker is off-center, walks around, or there are two people. A center crop then slices faces and keeps empty background. Smart tracking glides the window with the person and fixes that.

How much of the picture is lost going vertical?

By width, about 56% of the original 16:9 survives, so roughly 44% falls off-frame. That's exactly why where you place the vertical window matters: by content, not at random in the center.

Do I need captions if the clip is already vertical?

Yes. About 85% of feed video is watched with the sound off. The vertical format grabs attention, but without burned-in captions the viewer won't get the point and scrolls past. Format and captions work as a pair.

What is a safe zone and why care?

It's the part of the frame the platform's buttons and captions don't cover. On a 9:16 1080x1920 canvas, keep the important stuff above the bottom ~270 px and left of the right ~100 px, or the interface hides the face or text and completion drops.

Sources

  1. 1.AI Auto-Reframe for Vertical Video - How It Works (Transcriptr)
  2. 2.TikTok Dimensions 2026: Spec & Safe Zone Guide (quso.ai)
  3. 3.30 Vertical Video Stats (Embryo)
  4. 4.How to Perfect Vertical Video on Social Media (Sculpt)
  5. 5.Best Auto Reframe Tools for Repurposing (OpusClip)

One take. Posted everywhere.

Try Monty free

Keep reading