## Opportunity to customize FOSS AI for the UN ### by yuiseki {%hackmd WdEeg3SdQ-OHU9QFfiW1hg %} --- ## Background - I am researching the integration of GIS and AI, especially LLM - Through the organization of the hackathon, a sponsor has come forward to offer its vast computational resources free of charge - I was fortunate to be selected as a participant in this hackathon - I would like to use this opportunity for my research interests and for the UN --- ## Sponser of this hackathon - <img src="https://hackmd.io/_uploads/HysIzWwA6.jpg" alt="Witness" width="80" height="auto"> Witness - Mysterious person who will provide us with vast computational resources this time - https://twitter.com/i_witnessed_it --- ## Organizer of this hackathon - <img src="https://hackmd.io/_uploads/Bk_FfZvCT.jpg" alt="saldra" width="80" height="auto"> saldra - Organizer of Discord community called "Confronting Local AI" - Organizer of "LOCAL AI HACKATHON" with Witness - https://twitter.com/sald_ra --- ## Resources to be offered - 256GB RAM - A5000 GPU * 7 (= VRAM 168GB) - May be A5000 GPU * 8 (= VRAM 192GB) - 10 days (240 hours) - It will start **one hour after this meeting**. --- ## My Goal of this hackathon - I would never try to create a large, universal AI - I would create a large number of small but reliable AIs that would get the task done - that can be used by the UN --- ## Method - Fine-tuning TinyLlama - TinyLlama is FOSS LLM - TinyLlama is most lightweight LLM - that works on Raspberry Pi 4B 8GB RAM - that requires no Internet connection - that eliminating the risk of information leakage - that meets the strict information control standards of the UN --- ## Known Tasks at the UN (0) - **Support for low-resource languages** - Enhanced support for minor languages - **Translation** - **Summarization** - I'm trying to get TinyLlama to specialize in nearly 200 languages for this hackathon - But **time is limited**, so I would like to know if there is any language that should be prioritized --- ## Known Tasks at the UN (1) - **Sentiment Analysis** - Identify the emotional tone of the text - **Fake News Detection** - Identifying unreliable news - **Hate Speech Detection** - Identification of discriminatory or offensive discourse - These tasks help in conflict prevention and the execution of the UN's mission. --- ## Known Tasks at the UN (2) - Be more specific, - **Text to SQL** - Generate correct SQL based on natural language instruction --- ## Call for Opinions - **What other tasks are needed?** - Intelligence analysis? - Crisis management? - Creation of educational materials? - Others? --- ### What I will do - Customize TinyLlama based on your feedback - Optimized as software to support the mission and work of the UN --- ### Request for your cooperation - Let me know what you think about the task today - Based on your valuable feedback, I will strive to provide a better LLM - Please send email to **yuiseki@gmail.com**