Mô Tả Công Việc
Open for the following levels:Middle LevelSenior LevelSolution ArchitectRole SummaryAs a Senior/Lead Data Engineer at GFT, you will be responsible for managing, designing, and enhancing data systems and workflows that drive key business decisions. The role is focused 75% on data engineering, involving the construction and optimization of data pipelines and architectures, and 25% on supporting data science initiatives through collaboration with data science teams for machine learning workflows and advanced analytics. You will leverage technologies like Python, Airflow, Kubernetes, and AWS to deliver high-quality data solutions. Key ActivitiesArchitect, develop, and maintain scalable data infrastructure, including data lakes, pipelines, and metadata repositories, ensuring the timely and accurate delivery of data to stakeholdersWork closely with data scientists to build and support data models, integrate data sources, and support machine learning workflows and experimentation environmentsDevelop and optimize large-scale, batch, and real-time data processing systems to enhance operational efficiency and meet business objectivesLeverage Python, Apache Airflow, and AWS services to automate data workflows and processes, ensuring efficient scheduling and monitoringUtilize AWS services such as S3, Glue, EC2, and Lambda to manage data storage and compute resources, ensuring high performance, scalability, and cost-efficiencyImplement robust testing and validation procedures to ensure the reliability, accuracy, and security of data processing workflowsStay informed of industry best practices and emerging technologies in both data engineering and data science to propose optimizations and innovative solutions
Xem toàn bộ Mô Tả Công Việc
Yêu Cầu Công Việc
Required SkillsCore Expertise: Proficiency in Python for data processing and scripting (pandas, pyspark), workflow automation (Apache Airflow), and experience with AWS services (Glue, S3, EC2, Lambda)Containerization & Orchestration: Experience working with Kubernetes and Docker for managing containerized environments in the cloudData Engineering Tools: Hands-on experience with columnar and big data databases (Athena, Redshift, Vertica, Hive/Hadoop), along with version control systems like GitCloud Services: Strong familiarity with AWS services for cloud-based data processing and managementCI/CD Pipeline: Experience with CI/CD tools such as Jenkins, CircleCI, or AWS CodePipeline for continuous integration and deploymentData Engineering Focus (75%): Expertise in building and managing robust data architectures and pipelines for large-scale data operationsData Science Support (25%): Ability to support data science workflows, including collaboration on data preparation, feature engineering, and enabling experimentation environments Nice-to-have requirementsAdvanced Data Science Tools: Experience with AWS Sagemaker or Databricks for enabling machine learning environmentsBig Data & Analytics: Familiarity with both RDBMS (MySQL, PostgreSQL) and NoSQL (DynamoDB, Redis) databasesBI Tools: Experience with enterprise BI tools like Tableau, Looker, or PowerBIMessaging & Event Streaming: Familiarity with distributed messaging systems like Kafka or RabbitMQ for event streamingMonitoring & Logging: Experience with monitoring and log management tools such as the ELK stack or DatadogData Privacy and Security: Knowledge of best practices for ensuring data privacy and security, particularly in large data infrastructuresDue to the high volume of applications we receive, we are unable to respond to every candidate individually. If you have not received a response from GFT regarding your application within 10 workdays, please consider that we have decided to proceed with other candidates.
Xem toàn bộ Yêu Cầu Công Việc
Quyền Lợi
HR benefitsCompetitive salarySalary band per level are reviewed once per year13th month salary pro rata depending on the employee’s length of service (within a calender year), paid with the December salaryMonthly lunch allowance: 700,000 VND/employeeParking: GFT covers the monthly parking fee for employee motorbikesPerformance evaluation is once per year, for 2 purposes: > Performance bonus > Salary incrementsHealth carePrivate health insurance: including accident, outpatient, in-patient, maternity, and dental for all permanent employees who pass 2-month probation.Optical: expense claim for eyewearAnnual health check-ups.VacationMaximum 18-day vacation leave/year (with the ability to carry over 05 days till 31st March of the following year)Adding one more annual leave day for each two-year anniversary.Healthy lifestyleSports and hobby clubs: company has an annual fund for fitness activities, which is allocated per month as team’s vote.Range of healthy snacks, tea, coffee, milk and beer on tapSocialCompany townhall: each 6 weeksCSR activities: as per company’s CSR guidelineOnsite tour/training courses at other GFT offices and client’s destination overseas (where applicable).