# Plan of action for Jupitrr Video Phase 1: 1.We need more contextual understanding 2.using claude ai / openai API > building LLM 3.Create a prompt to have these labels and 4.generate videos only on this. 5.Search images, videos, gifs based on this and then ask it to mark where to classify it for adding text on whole transcription content. 6.Fetch and add them into s3, firebase slideshows. ----- Here’s how the B-Roll Generation Assistant could analyze the provided subtitles text and suggest appropriate stock media with the JSON format: --- # Prompt ```json You are a B-Roll Generation Assistant. Analyze the following subtitles text to extract comprehensive insights and highlight where appropriate stock video, stock image, or GIFs could be added. Your analysis should cover the following aspects: Overall Theme: Identify the central theme or main topic discussed throughout the text. Highlight sections where visuals can reinforce this theme. Sentiment Analysis: Determine the sentiment conveyed in different sections of the text (e.g., positive, negative, neutral). Mark the text where sentiment-driven visuals should be placed. Contextual Cues: Detect and annotate cues like pauses, laughter, unclear speech, or other non-verbal communication. Highlight these cues and suggest where corresponding visuals could be inserted. Entity Recognition: Identify and highlight mentions of key people, places, or organizations within the text. Mark these mentions as potential spots for relevant visuals. Bias-Free Analysis: Ensure that all analysis is free from any biases or stereotypes. Highlight where care must be taken to select inclusive and respectful visuals that accurately reflect the diversity and context of the text. Subtitles Text:””” {subtitle text here} “”” JSON Format for Marking: { "text": "[Exact sentence or phrase from the subtitles]", "media_type": "stock_image | stock_video | gif", "search_text": "[Search text for finding the appropriate media]", "reason": "[Explanation of why this media is suitable for this text]" } Example Highlight: Given this subtitle text: The CEO announced the merger with a smile, stating that this partnership will lead to unprecedented growth. The output will Look like this: { "text": "The CEO announced the merger", "media_type": "stock_video", "search_text": "business handshake merger", "reason": "Symbolizes the merger and partnership discussed." }, { "text": "with a smile", "media_type": "stock_image", "search_text": "smiling business CEO", "reason": "Reflects the positive tone and the key person involved." }, { "text": "unprecedented growth", "media_type": "gif", "search_text": "upward growth chart", "reason": "Represents the optimistic outlook of unprecedented growth." } Apply this approach consistently across the entire transcript, focusing solely on highlighting where media could be effectively used. ``` --- **Subtitles Text:** ``` Oh, so what do you do for work? And every single person that I had a conversation with that night had their own thing going on. One owned a jewelry company. One was a producer. One had a podcast. Another had their own coffee shop. One had a tech startup. It was like a new world for me. I was used to being surrounded by people who didn't like their job and spent all day complaining about it while doing nothing to change the situation, and I too was one of them. ``` **JSON Format for Marking:** ```json [ { "text": "And every single person that I had a conversation with that night had their own thing going on.", "media_type": "stock_video", "search_text": "diverse group of professionals networking", "reason": "Represents the diverse and entrepreneurial spirit of the people mentioned in the conversation." }, { "text": "One owned a jewelry company.", "media_type": "stock_image", "search_text": "jewelry designer in studio", "reason": "Depicts the entrepreneurial venture of owning a jewelry company." }, { "text": "One was a producer.", "media_type": "stock_image", "search_text": "film producer at work", "reason": "Illustrates the role of a producer, emphasizing creativity and production." }, { "text": "One had a podcast.", "media_type": "stock_video", "search_text": "podcaster recording", "reason": "Shows a podcaster in action, reflecting the modern and creative nature of this occupation." }, { "text": "Another had their own coffee shop.", "media_type": "stock_image", "search_text": "coffee shop owner", "reason": "Highlights the entrepreneurial aspect of running a coffee shop." }, { "text": "One had a tech startup.", "media_type": "stock_video", "search_text": "tech startup team brainstorming", "reason": "Captures the innovative and dynamic environment of a tech startup." }, { "text": "It was like a new world for me.", "media_type": "gif", "search_text": "amazed person discovering something new", "reason": "Represents the speaker's feeling of awe and discovery in this new environment." }, { "text": "I was used to being surrounded by people who didn't like their job and spent all day complaining about it while doing nothing to change the situation, and I too was one of them.", "media_type": "stock_video", "search_text": "unhappy office workers", "reason": "Contrasts the previous entrepreneurial spirit with the dissatisfaction the speaker used to experience, highlighting the transformation." } ] ``` --- **Explanation:** 1. **Theme:** The central theme is about discovering a world of entrepreneurship and contrasting it with a previous environment of dissatisfaction in the workplace. 2. **Sentiment:** The text conveys a sense of awe and inspiration when discovering new entrepreneurs, contrasted with a more negative sentiment regarding the speaker's past experiences. 3. **Contextual Cues:** The transition from discussing various entrepreneurs to the speaker’s reflection on their past life is key to understanding the text's emotional shifts. 4. **Entity Recognition:** Specific individuals are mentioned, each with unique roles, which are prime spots for relevant visual content. 5. **Bias-Free Analysis:** The selected media emphasizes diversity and entrepreneurial spirit, avoiding any stereotypical portrayals. This approach ensures that the text is enriched with visuals that support and enhance the narrative, adding depth to the viewer's understanding. output 2: ```json Overall Theme: The centrally conveyed theme here is wisdom, humor, life lessons, and personal growth. The story revolves around a master teaching a serious lesson through a lighthearted task. 1. { "text": "once upon a time in a small village", "media_type": "stock_image", "search_text": "small village", "reason": "Sets the scene and context of the story." }, 2. { "text": "there lived a wise old Monk", "media_type": "stock_image", "search_text": "wise old monk", "reason": "Introduces the central character, the wise old monk, who is important to the story." }, 3. { "text": "one day a young and eager student named Sam approached the master and said", "media_type": "stock_image", "search_text": "young eager student", "reason": "Introduces another key character, Sam, setting the stage for their interaction." }, 4. { "text": "go to the market and buy the biggest juiciest watermelon", "media_type": "stock_video", "search_text": "market and watermelon", "reason": "A key plot point that invites a sense of curiosity and humor, and an act that many can visually identify with." }, 5. { "text": "balancing it on his head he walked through the village with utmost concentration", "media_type": "stock_video", "search_text": "man balancing watermelon", "reason": "The humor and challenge in this visual provides engagement and demonstrates resilience." }, 6. { "text": "people couldn't help but laugh and cheer him on some even joined in clapping and making funny faces", "media_type": "stock_video", "search_text": "people laughing and clapping", "reason": "Representation of community support, involvement, and their lighthearted reaction." }, 7. { "text": "master setu burst into laughter", "media_type": "stock_image", "search_text": "monk laughing", "reason": "Visual representation of master's joyful response that may seem contrary to traditional image of a serious monk." }, 8. { "text": "But if you face them with a light heart and a sense of humor you will find Joy even in the toughest moments", "media_type": "gif", "search_text": "person overcoming hardship with laughter", "reason": "Visual metaphor of the main lesson in the story, using humor and lightness to face challenges." }, 10. { "text": "whenever he felt overwhelmed he would remember the funny watermelon lesson", "media_type": "stock_image", "search_text": "man reminiscing", "reason": "Showcase the character's thoughtful and reflective moments after learning the lesson." }, 11. { "text": "Embrace challenges with a sense of humor", "media_type": "gif", "search_text": "funny overcoming challenges", "reason": "This is a visual metaphor of the concluding message." }, 12. { "text": "a joyful Adventure filled with laughter and success", "media_type": "stock_video", "search_text": "joyful adventure", "reason": "To encapsulate the sentiment of joy, adventure, and success in life." }, 13. { "text": "stay blessed", "media_type": "gif", "search_text": "stay blessed message", "reason": "An ideal way to end the story with a positive and uplifting message." } Please, ensure these images and videos are respectful and free from biases or stereotypes. They should reflect the diversity and context of the text in an accurate and genuine manner. Sentiment throughout is primarily positive. There are no pause, unclear speech, or other non-verbal cues to address. ```