Mô Tả Công Việc
Job SummaryWe are looking for a highly skilled Data Engineer to design, develop, and maintain scalable, high-performance data pipelines and infrastructure. In this role, you will collaborate closely with Data Analysts, Quantitative Researchers, and cross-functional teams to ensure seamless data availability, reliability, and performance.Your responsibilities will include building and optimizing ETL and streaming dataflows, enhancing data lakehouse storage efficiency, and integrating diverse data sources to support advanced analytics, quantitative trading, machine learning, and business intelligence initiatives.This position reports to the Data Engineer Manager / Head of Business Technology Solution.Key Responsibilities • Engage in the full lifecycle of data platform development, including building and maintaining data lakes, warehouses, and streaming pipelines to support analytics, quant trading, and AI-driven decision systems.• Design, implement, and optimize ETL pipelines using Apache Airflow and Spark, ensuring reliability and scalability for large datasets.• Build and manage real-time data ingestion and processing pipelines using Apache Kafka to support low-latency trading and analytical applications.• Develop and maintain data serving layers with Trino for interactive analytics and cross-source query federation.• Integrate and optimize data flows from PostgreSQL, Oracle, and MongoDB databases into unified data pipelines.• Develop FastAPI-based microservices to expose data and insights to internal and external consumers.• Conduct POC (proof of concept) and adopt new data technologies to enhance scalability, throughput, and system efficiency.• Ensure data quality, observability, and governance, implementing validation, lineage, and monitoring best practices.• Maintain compliance with data security, privacy, and regulatory requirements.
Xem toàn bộ Mô Tả Công Việc
Yêu Cầu Công Việc
Experience & Qualification: • Bachelor’s or Master’s degree in Computer Science, Applied Mathematics, Quantitative/Computational Finance, or a related field.• 5+ years of experience in Data Engineering or related roles.• Proficient in Python (experience with FastAPI preferred); familiarity with Java is a plus.• Strong experience with Apache Spark, including performance tuning and distributed data processing.• Solid hands-on experience with Apache Airflow for workflow orchestration.• Experience with Apache Iceberg table format.• Experience with Apache Kafka for streaming data ingestion and event-driven architecture.• Experience with Apache Flink (Java) for real-time stream processing.• Strong understanding of Trino for large-scale, federated query execution.• Practical experience integrating data from PostgreSQL, Oracle, and MongoDB.• Experience in data modeling, schema design, and data warehouse/lakehouse architecture.• Familiarity with CI/CD for data pipelines and modern DevOps practices.• Cloud experience (GCP, AWS) is an advantage.Nice to Have• Familiarity with StarRocks or other high-performance OLAP databases.• Knowledge of trading, financial, or high-frequency data systems is a plus.
Xem toàn bộ Yêu Cầu Công Việc
Hình thức
Full-time
Quyền Lợi
Key technical leadership role in a mission-critical, high-performance platform.Dynamic and innovation-driven working environment in a leading securities firm.Access to modern technologies and real-world system challenges at scale.Opportunity to shape architecture for future growth across multiple domains.
Mức lương
Thỏa thuận
Báo cáo tin tuyển dụng: Nếu bạn thấy rằng tin tuyển dụng này không đúng hoặc có dấu hiệu lừa đảo,
hãy phản ánh với chúng tôi.
Tham khảo: 10 Dấu hiệu nhận biết hành vi lừa đảo qua tin tuyển dụng.
Tham khảo: 10 Dấu hiệu nhận biết hành vi lừa đảo qua tin tuyển dụng.