focus on data platform research and development, providing technical solutions for existing data projects and data requests from business teams. At the same time, existing projects need to be integrated and optimized to make the data platform architecture more reasonable, with high performance and scalability under the premise of stable operation
Job Responsibilities:
Work with project members and resource to make detailed plan for data project delivery and data related initiatives support. Collaborate and mobilize local and remote cross team members.
Responsible for the planning and construction of the company's data center, and provide data solutions for the company's various business lines
Responsible for building and improving data warehouse and data market, including batch and real-time data access, and completing ODS, CDW and ADS according to data warehouse construction methodology
Responsible for data platform component selection, planning, deployment, capacity expansion, daily troubleshooting and performance tuning, able to quickly locate and troubleshoot problems
Support data platform, data pipeline and data service under business requirements, and be able to optimize availability, scalability and efficiency on a larger scale
For different service scenarios, provide query performance optimization construction and solutions in large data volume and high concurrency scenarios
Job requirements:
More than 8 years of work experience, proficient in Java development, familiar with Springboot, SpringCloud, Mybatis and other open source frameworks, understand JVM, have some tuning experience, have a profound understanding of data structure and algorithm design
Familiar with Hadoop, Hive, Spark, Flink, Kafka, ES, Redis, Zookeeper and other big data related components and middleware, understand the underlying mechanism and principle, have open-source software source code analysis, secondary development and optimization capabilities, and can combine with business scenarios for architecture design
Familiar with Linux/Unix operating system, Python, Shell and other scripting language programming ability
Familiar with Ali cloud big data components, such as Maxcompute, TableStore, ADB, Hologres is preferred
Familiar with AWS big data components such as EMR, Redshfit, Athena is preferred
Familiar with Clickhouse, Presto and other big data analysis components, related performance optimization experience is preferred
Experience in tracking data collection and user behavior data analysis is preferred
逸迅科技是数据治理和数据中台的全栈方案供应商 ，致力于帮助客户“用数据决策未来”，目前已获投数千万融资。
凭借创新业务能力，逸迅科技被评为上海高新技术企业，2019年度入选上海市“科技创新行动计划”创新项目，并在第六届先进制造业大会上斩获“工业大数据解决方案”金奖。