← Back to roles

混元大模型漫爬数据策略算法工程师

Tencent Technology (Shenzhen) Co., Ltd.

深圳Posted Sep 22, 2026
Apply on Tencent Technology (Shenzhen) Co., Ltd.

Overview

Tencent Technology (Shenzhen) Co., Ltd.
Open roles
2,267
At this company
See all
Added in 30 days
501
At this company, still open

Skills named in this posting

  • Python
1.负责大模型预训练/AI搜索业务的全网漫爬策略设计，解决资源发现和调度问题，覆盖全语种/多模态，提升有价值数据覆盖率、时效性； 2.页面质量，基于机器学习/NLP/LLM，构建高质量内容筛选策略，识别低质量/垃圾/重复页面，提高数据质量； 3.重复问题解决，优化URL/资源内容去重策略，提升爬虫抓取效率、内容转化和留存能力； 4.内容理解，基于BERT/GPT/LLM 等技术，构建网页内容理解、网页分类，助力大模型训练数据/AI搜索效果。 1.计算机相关专业优先，熟悉 python/c++编程语言； 2.有数据工程或相关领域的工作经验，具备一定的机器学习算法基础，了解BERT/GPT/LLM 等技术； 3.熟练掌握大数据技术栈，包括Hadoop、Spark 等，有使用数据库（如SQL）和数据仓库的经验。

Apply on the employer's site

Original posting: careers.tencent.com

Apply on Tencent Technology (Shenzhen) Co., Ltd.

RISC-V ecosystem

Tencent Technology (Shenzhen) Co., Ltd. in the RISC-V ecosystem

RISC-V International: Premier TSC

Tencent Holdings Ltd. is a Chinese multinational technology and entertainment conglomerate and holding company headquartered in Shenzhen.

  • Tencent joined RISC-V International as China pushed for open-instruction-set alternatives (widely reported)
  • Its TencentOS Tiny IoT operating system is used on RISC-V MCUs, e.g. tutorials pairing TencentOS Tiny with the GD32V RISC-V MCU
  • Also participates in Chinese RISC-V community events such as the RISC-V Forum in Shenzhen

Same employer

More roles at Tencent Technology (Shenzhen) Co., Ltd.

View all 2,267