Reverse Video Search
You may have used some kind of reverse image search before. Put simply, instead of searching using text: australian shepherds running, you can use an image: australian_shepherd_running.png. The search engine will then find all similar images based on that input.
In the example below, I'll upload a picture of an Australian Shepherd dog, and Google's reverse image search will find all similar pictures of Australian Shepherds.
Since we have an upper bound on the size of inputs to our mixpeek.embed.video service, we need to preprocess it. This also helps to ensure we get proper granularity, it's a similar technique to tokenization of a corpus.
We're telling the video processor tool to cut up the video into 5 frame intervals, resize the resolution as 720x1280 and return each snippet as a base64_string
This will return an embedding of the video, so we just iterate through each base64_string response from the tools processor and embed them. We want to maintain the time_start and time_end keys as well.
