ClipsAI

Free plan Self-hosted

What ClipsAI is

ClipsAI is an open-source Python library that turns long-form video into shorter clips. It targets audio-led, narrative material such as podcasts, interviews, speeches and sermons. The clipping algorithm reads a transcript and uses TextTiling to divide long-form audio into coherent segments. Videos must be transcribed first; the documentation demonstrates WhisperX, an open-source wrapper on Whisper. ClipsAI also changes video framing to focus on the current speaker and convert aspect ratios, including 16:9 to 9:16. Resizing uses Pyannote for speaker diarization and requires a Hugging Face access token; the documentation says Pyannote use does not incur a charge. Installation uses pip install clipsai and also requires WhisperX, libmagic and ffmpeg. The package is for Python 3, with metadata specifying Python 3.9 or later, and is MIT licensed. A documentation-linked UI demo shows generated clips. The library is free, self-hosted and lists [email protected] as its contact email.

Who it suits

ClipsAI suits developers who want to build transcript-based clipping and speaker-focused reframing into self-hosted Python workflows. It is particularly aligned with podcasts, interviews, speeches and sermons.

What it does well

Open-source MIT-licensed library
Uses transcripts to identify clip segments
Reframes around the current speaker
Converts 16:9 video to 9:16
Free to use

What to know first

Requires Python 3.9 or later
Needs transcription before clipping
Installation also requires WhisperX, libmagic and ffmpeg
Resizing requires a Hugging Face token

Verdict

ClipsAI provides transcript-driven clipping and automatic reframing in a self-hosted Python package. It offers a free, flexible foundation, but setup involves several dependencies and resizing needs an access token.

Facts from ClipsAI's own pages

Aspect ratios: The library can segment a video into multiple clips and resize its aspect ratio from 16:9 to 9:16. · clipsai.com, 9 Oct 2026
Clip detection: Its clipping algorithm analyzes a video's transcript to identify clips. · clipsai.com, 9 Oct 2026
Clip selection: Its clipping algorithm analyzes a video's transcript to identify and create clips. · clipsai.com, 9 Oct 2026
Demo: The documentation links to a UI demo of clips generated with the library. · clipsai.com, 9 Oct 2026
Install: The documented installation uses pip install clipsai and also calls for WhisperX, libmagic, and ffmpeg. · clipsai.com, 9 Oct 2026
Intended content: It is designed for audio-centric, narrative-based videos such as podcasts, interviews, speeches, and sermons. · clipsai.com, 9 Oct 2026
Intended videos: It is designed for audio-centric, narrative-based videos such as podcasts, interviews, speeches, and sermons. · clipsai.com, 9 Oct 2026
License: The GitHub repository lists an MIT license. · github.com, 9 Oct 2026
Maker: The documentation footer identifies the maker as Clips AI, Inc. · clipsai.com, 9 Oct 2026
Platform: The product is distributed as a Python library; its package metadata specifies Python 3 and Python 3.9 or later. · github.com, 9 Oct 2026
Product: Clips AI is an open-source Python library that automatically converts long-form video into clips. · clipsai.com, 9 Oct 2026
Pyannote cost: The documentation states that using Pyannote will not incur a charge. · clipsai.com, 9 Oct 2026
Resize requirement: Resizing requires a Hugging Face access token because it uses Pyannote for speaker diarization. · clipsai.com, 9 Oct 2026
Segmentation method: The clipping feature uses the TextTiling algorithm to segment long-form audio into coherent clips based on the transcript. · clipsai.com, 9 Oct 2026
Speaker reframing: Its resizing algorithm dynamically reframes video to focus on the current speaker. · clipsai.com, 9 Oct 2026
Support: The package metadata lists [email protected] as the author contact email. · github.com, 9 Oct 2026
Transcription: The documentation says videos must first be transcribed, and shows transcription using WhisperX, an open-source wrapper on Whisper. · clipsai.com, 9 Oct 2026
Video processing dependencies: Installation instructions include libmagic and ffmpeg. · clipsai.com, 9 Oct 2026
Video reframing: Its resizing algorithm dynamically reframes videos to focus on the current speaker and convert videos to different aspect ratios, including 16:9 to 9:16. · clipsai.com, 9 Oct 2026
What it does: Clips AI is an open-source Python library that automatically converts longform video into clips. · clipsai.com, 9 Oct 2026

Where ClipsAI stands on Freedom251

AI Video Repurposing Tools#22 of 50