At RTA Summit 2024, we will have a booth demonstration showcasing Apache Pinot’s ability to serve analytics and similarity search in real-time. The

SUP! Hubert’s Substack

submited by

Style Pass

2024-05-07 21:30:02

At RTA Summit 2024, we will have a booth demonstration showcasing Apache Pinot’s ability to serve analytics and similarity search in real-time. There is actually a lot to make this successful. Let me unpack this by describing the use case.

At conferences, you should always have someone at your booth to answer questions, hand out swag, and scan attendees. This tends to require multiple people. This demo will monitor your booth using your camera to identify people assigned to booth duty and measure their activity throughout the day.

The timeline chart at the top of the dashboard plots the occurrences of those assigned booth duty. The middle table is the same dataset but displayed as a table. The bottom of the dashboard is a GenAI response using information obtained from the frames. It provides a summary of what has been happening at the booth for the last 15 minutes while providing the frames that captured this information.

To convert the frame to an embedding, you can use the PIL module to read the frame and pass it to a sentence transformer using the clip-ViT-B-32 image embedding model.