Senior Data Engineer

Bachelor’s degree in computer science, engineering, management information system or a related technical discipline. 3+ years’ experience working as a Data Engineer role, ETL with large amounts of data. Experience with software engineering best practice in version control and CI/CD Experience with data warehousing architecture and data modeling, ETL data pipeline in both batch and real-time applications Obsessed with Data Quality and Data Observability. Experience in data lineage and data testing processes Experience with using the following software/tool in the big data field. ○ Workflow management tools: Airflow, Prefect, Dagster, etc.○ ETL/Reverse tools: Talend, CDAP, Azure Data Factory, Airbyte/ Matillion, Census, dbt, etc.○ Big data technology: Apache Spark, Apache Beam, Presto, Kafka, Redis, etc.○ NoSQL and OLAP database: MongoDB, Elastic search, Clickhouse/Druid, Prometheus, InfluxDB, etc.○ Monitoring tools: Grafana, Kibana, etc.○ Linux and command line interfaces Good at programming languages: Python, Java, etc. Experience in performing root cause analysis, identify problems and propose recommendations for improvement. Strong organizational and multitasking skills with the ability to balance competing priorities Experience modern cloud computing platforms and concepts is a plus (Azure/GCP)  Who we are looking for“Attitude eats skills for breakfast”: we greatly value people who possess the 3 personal traits: Growth mindset Curiosity Automation