trantrungtin•This week
I crawled 5000+ X account from AI companies.
Hi all,
My work requires me to have an overview of the AI market so I wrote a script to crawl and keep track of all the X (Twitter) accounts that mention AI/LLM/SD or similar terms and look like a company/team. If someone asks how to scrape X, I just use some off-the-rack GitHub repo to implement the script, and X didn't detect the bot, or they are not enforcing the rule. I plan to also scrape these companies' websites to see what they are cooking but that is for later as it's a kinda big endeavor.
Long story short, here is the result (in the first comment), hope it's somewhat helpful.
