Senior Cloud Engineer – AWS & Data Lake

What you will be responsible for:

● Manage and maintain cloud infrastructure (AWS), focusing on reliability, performance, and cost-efficiency.

● Build and maintain scalable, secure, and cost-effective Data Lake architecture using services such as Amazon S3, AWS Glue, Lake Formation, and Athena.

● Administer large-scale database platforms (RDS, Redshift, EMR, DynamoDB) and perform backup/recovery, tuning, and upgrades.

● Automate infrastructure provisioning and operations using Infrastructure-as-Code (IaC) tools such as Terraform or AWS CloudFormation.

● Design and operate ETL/ELT pipelines for ingesting data into the data lake.

● Ensure data quality, security, access control, and compliance for all lake-stored data.

● Ensure data platforms are highly available, backed up, and meet disaster recovery requirements.

● Implement and maintain monitoring, alerting, and logging solutions for infrastructure, pipelines and data workloads.

● Participate in on-call rotation for cloud operations and database issue escalation.

● Work cross-functionally with data engineers, developers, and product teams to meet analytical and operational data needs.

● Collaborate with security teams to ensure compliance and best practices are followed for data protection and cloud resource access.

How you will stand out:

● Bachelor's degree or above in Computer Science, Information Systems, or a related field.

● Over 5 years of experience in cloud operations, with a focus on AWS.

● In-depth knowledge of AWS services including S3, Glue, Lake Formation, Redshift, Athena, EMR, IAM, and CloudWatch.

● Solid hands-on experience with designing and managing Data Lake and big data analytics platforms.

● Strong experience in managing relational and NoSQL databases (e.g., PostgreSQL, MySQL, DynamoDB).

● Strong scripting and automation skills in Python, Bash, or Go.

● Familiar with tools such as Terraform, Ansible, Jenkins, Git, etc.

● Experienced in setting up monitoring and cost optimization for AWS-based infrastructure.

● Understanding of security, encryption, data governance, and compliance best practices for public cloud data platforms.

Preferred qualifications:

AWS Certified Solutions Architect – Associate/Professional.

AWS Certified Data Analytics – Specialty or Database – Specialty.

Experience with modern data stack tools (e.g., Apache Iceberg, Delta Lake, dbt) is a plus.

Kubernetes or containerization certification is preferred.

公司地点:北京海淀区中关村东升科技园·学院园

公司简介:

职位发布者:顾先生

北京非尘科技有限公司

融资阶段:

公司规模:

相似职位: