AI网络爬虫：用deepseek批量提取天工AI的智能体数据

文章预览

  天工AI的智能体首页： F12查看真实网址和响应数据： 翻页规律： https:// work.tiangong.cn/agents _api/square/sq_list_by_category?category_id=7 =0 https:// work.tiangong.cn/agents _api/square/sq_list_by_category?category_id=7 =80 https:// work.tiangong.cn/agents _api/square/sq_list_by_category?category_id=7 =100 网站返回的是json数据： { "code": 200, "message": "success", "msg": "success", "data": { "agents": [ { "agent_id": "3193461", "agent_type": "general", "name": "假如科比参加欧洲杯", "message": "我们的牢大回来了，他参加了欧洲杯，面临巨大挑战，运用你的智慧帮助牢大获得欧洲杯冠军吧！", "icon": " https:// static-recommend-img.tiangong.cn /ai-text-gen-image/agent-backgroud_9783755_1803007243774124032.jpg ", "hot": 0, "views": "2107", "author": "@Anria", "labels": [ "生活娱乐" ], "status": 3, "is_new": false, "intro": "", "is_has": false, "share_link": "", "r_info": { "agent_id": 3193461, "categoryI ………………………………