# Lolo Work progress ## Improve tiktok, scrapping, and overall data volume ### Marius (update 25/30/22) To scale data volume, we decided to build Marius, a cloudfront stack dedicated to desktop/puppeteer scrapping at scale. Marius is done. Scripts for each task need to be implemented. ### Pipiads (update 30/06/22) With the use of marius and about 80 (1$) accounts, we fetched 45k ads (dropship) from pipiads. Thats not bad. Results: https://metabase.dropispy.com/question/495 I plan to do it again with more accounts soon. ### Sergey (update 20/06/22) Considering the good volume of sashi, we do not go further with sergey. We only use his API to enrich the data. ### Facebook scrapping with real aged accounts (update 20/06/22) I first evaluated the feasibility of scraping the facebook feed with old accounts => we can do it ! There are 2 ways of doing it: * Scrap the facebook feed => We need a warmed account that contains some ads in the feed => I still need to understand how to warm an account. * Scrap the sponsored post after entering a keyword in the search bar => I prefer this method because it looks like sponsored posts are often there. At least more often that the first method Until there, I tested with DE and US accounts. Everything seems ready for me to start scaling using Marius. I plan to develop a quick backoffice to manage different accounts. This would help us to detect and replace a banned account, etc. We also need to look further for a better facebook account provider. ## Accounts and invoices checking ### Illegitimate accounts (update 10/06/22) Given the huge amount of request to stripe we need for each Minea user, I created userSummary lambda function in minea-stack that ouput a summary for each user in an S3 bucket. I then sync the remote bucket locally and apply a rule to detect illegitimate accounts. Results => https://mineagroupe.slack.com/archives/C0229K87GNT/p1654864196888289 ### Block account sharing - Done Considering the priority of different tasks, and following a meeting with thib and loic, this task is entrusted to swaleh (and loic) ## Promotion (link between ads and domain) (update 30/06/22) Doing. ## Classify dropshipping shop (update 30/06/22) Not started. ## Remove alexa from domainz Not started.