The Platform Engineer designs, manages, and optimizes the underlying infrastructure supporting the Bank’s Global Data Platform. This role ensures high availability, scalability, and security for multi-tenant workloads while aligning with governance and regulatory frameworks. Platform Engineers work across Kubernetes, MinIO, and other modern tools like Airflow, Argo, OpenLineage, and DataHub deliver a robust infrastructure that supports streaming, batch processing, analytics, and query engines such as Trino. Additionally, the role includes setting up the analytics data store, near real-time data store, and query engine to meet business needs.
1. Data Architecture: GDP Data platform building using Python.
2. Data Governance: Big Data Management, Strong in Spark, Python, Pyspark, Kubernates,Trino
3. Service Platform Operations: Familiar with Object storage
4. Strong understanding of multi-tenancy and resource management in distributed systems.
5. Familiarity with governance tools such as Apache Ranger, OpenLineage, and DataHub.
6. Experience setting up and managing analytics data stores and near real-time data stores integrated with modern data lakehouses.