Clips AI

Clips AI is an open-source Python library for automatically converting longform audio-centric videos into short clips. It analyzes a video's transcript to identify clip segments and can resize videos from 16:9 to 9:16 using speaker diarization. Designed for podcasts, interviews, speeches, and sermons, it requires only a few lines of code to get started.

Key Features

• Clip Finding: Uses transcription (via WhisperX) to detect and extract clips.
• Resizing: Dynamically reframes video to focus on the current speaker.
• Open Source: Free to use and modify.

Requirements

• Python, WhisperX, libmagic, ffmpeg, and a HuggingFace token for resizing.