岗位职责
1. 数据平台建设
设计、开发并优化公司级数据平台，支持大规模数据的采集、存储、计算与分析需求
主导数据计算、存储、调度框架的技术选型、二次开发及性能优化，确保平台的稳定运行
持续推动数据平台架构的演进，满足快速变化的业务需求
2. 数据开发工具建设
设计与开发高效、易用的数据开发工具，提升数据团队整体开发效率
支持数据集成与业务需求落地，构建适配业务场景的自动化工具化解决方案
打造数据开发与运维工具链，提升平台开发与管理体验
3. 数据安全与合规
负责数据安全体系的设计、实现与优化，确保数据的机密性、完整性与可用性
实施数据加密、访问控制、权限管理等安全机制，保障平台安全性
推动数据合规落地，确保平台符合相关监管要求（如 SOC2、GDPR 等）
设计并实施数据审计、追踪和监控机制，确保数据使用透明且合规
4. 数据生命周期管理
主导数据全生命周期管理，包括数据源接入、数据抽取、清洗、建模、元数据管理及优化
制定数据质量保障机制，提供技术支持，确保数据的可靠性、准确性与一致性
推动数据治理落地，构建高效的数据管理体系
岗位要求
1. 学历与经验
计算机、软件工程、数据科学等相关专业本科及以上学历
5年以上数据平台开发经验，具备架构设计及落地能力
2. 技术能力
扎实的计算机科学基础，熟悉操作系统原理、网络及分布式系统；
精通 Java 和 Python，熟练掌握常用数据结构与算法；
深入理解主流大数据技术栈，包括但不限于：Hadoop、Flink、Spark、Hive、Kafka、Paimon 等；
对分布式计算、存储、调度框架有较强的技术敏感性与优化经验
3. 数据安全与合规能力
熟悉数据安全相关技术，包括但不限于：数据加密、访问控制、权限管理、数据脱敏等
有数据合规领域的实践经验，熟悉相关法律法规（如 GDPR、SOC2等），并能推动合规性要求落地
有设计和实施数据安全审计、溯源和监控系统的经验
4. 平台与工具开发经验
有大型数据平台或工具的设计与开发经验，熟悉技术选型、架构设计及性能优化
能快速理解复杂业务需求，并将其转化为高效技术方案
具备从零到一搭建系统的能力，或从一到百优化平台的经验
5. 软技能
具备良好的沟通能力、团队协作能力，能够推动跨部门项目落地
自驱力强，善于解决复杂问题，具备结果导向的思维模式
对技术有持续热情，愿意探索前沿技术并应用于实际场景
加分项
在大数据框架领域有深入研究，阅读过核心代码或向开源社区贡献过代码（如提交 patch）；
熟悉以下领域之一：
元数据管理：对数据血缘、数据目录、元数据管理有深刻理解
安全合规： 有数据安全和合规方面的工作经验
数据湖建设：掌握数据湖的架构设计与实现方法
Job Responsibilities
Data Platform Construction
Design, develop, and optimize a company-wide data platform to support large-scale data collection, storage, computation, and analysis needs.
Lead the technical selection, secondary development, and performance optimization of data computation, storage, and scheduling frameworks to ensure the stable operation of the platform.
Continuously promote the evolution of the data platform architecture to meet rapidly changing business requirements.
Data Development Tool Construction
Design and develop efficient and user-friendly data development tools to enhance the overall development efficiency of the data team.
Support data integration and the implementation of business requirements by building automated tool solutions adapted to business scenarios.
Create a toolchain for data development and operation, improving the platform's development and management experience.
Data Security and Compliance
Responsible for the design, implementation, and optimization of the data security system to ensure data confidentiality, integrity, and availability.
Implement security mechanisms such as data encryption, access control, and permission management to ensure platform security.
Promote data compliance to ensure the platform meets relevant regulatory requirements (e.g., SOC2, GDPR, etc.).
Design and implement data audit, tracking, and monitoring mechanisms to ensure data usage is transparent and compliant.
Data Lifecycle Management
Lead the management of the entire data lifecycle, including data source integration, extraction, cleaning, modeling, metadata management, and optimization.
Develop data quality assurance mechanisms and provide technical support to ensure the reliability, accuracy, and consistency of data.
Promote data governance to build an efficient data management system.
Job Requirements
Education and Experience
Bachelor's degree or higher in Computer Science, Software Engineering, Data Science, or related fields.
Over 5 years of experience in data platform development, with architecture design and implementation capabilities.
Technical Skills
Solid foundation in computer science, familiar with operating system principles, networking, and distributed systems.
Proficient in Java and Python, with a strong grasp of commonly used data structures and algorithms.
In-depth understanding of mainstream big data technology stacks, including but not limited to: Hadoop, Flink, Spark, Hive, Kafka, Paimon, etc.
Strong technical sensitivity and optimization experience in distributed computing, storage, and scheduling frameworks.
Data Security and Compliance Skills
Familiar with data security-related technologies, including but not limited to: data encryption, access control, permission management, data masking, etc.
Practical experience in the field of data compliance, familiar with relevant laws and regulations (e.g., GDPR, SOC2, etc.), and able to promote compliance requirements.
Experience in designing and implementing data security audits, tracing, and monitoring systems.
Platform and Tool Development Experience
Experience in designing and developing large data platforms or tools, familiar with technology selection, architecture design, and performance optimization.
Ability to quickly understand complex business requirements and translate them into efficient technical solutions.
Capability to build systems from scratch or optimize platforms from an existing solution.
Soft Skills
Strong communication skills and teamwork abilities, capable of driving cross-departmental projects to completion.
Highly self-motivated, adept at solving complex problems, with a results-oriented mindset.
Continuous passion for technology, willing to explore cutting-edge technologies and apply them in practical scenarios.
Preferred Qualifications
In-depth research in the field of big data frameworks, having read core code or contributed code to open-source communities (e.g., submitting patches).
Familiarity with one of the following areas:
Metadata Management: Deep understanding of data lineage, data cataloging, and metadata management.
Security Compliance: Work experience in data security and compliance.
Data Lake Construction: Mastery of data lake architecture design and implementation methods.