Data Engineer (SQL, Agile)

About Us Live Payments is one of Australia's leading payment service providers, servicing thousands of businesses across Australia. We continue to innovate our payment solutions and expand our product offering alongside our industry-leading strategic partners, including Qantas Loyalty and Ingenico.  Live Payments is seeking a talented, experienced Data Engineer to join our growing, multi-national team. The Data Engineer will be responsible for designing, building, and maintaining the systems and infrastructure that enable the processing, collection, storage, and analysis of large volumes of data.   CORE DUTIES INCLUDE: Data Pipeline Development & Operations Design, build, and maintain cloud-native data pipelines Implement ETL/ELT processes for moving and transforming data at scale Develop event-driven data processing solutions with proper handling of idempotency, retries, and deduplication Production Support & Reliability Monitor production data pipelines and respond to incidents Set up alerting systems and troubleshoot pipeline failures Implement data quality checks and reconciliation processes Infrastructure & Cloud Services Management Work with managed database services (AWS qRDS PostgreSQL/SQL Server, Azure SQL) Utilise cloud object storage solutions (S3, Azure Blob Storage/ADLS) for data lake operations Implement monitoring and logging using CloudWatch, Azure Monitor, or Datadog Develop and maintain infrastructure as code using Terraform or CloudFormation Development & Deployment Write advanced SQL queries and Python code for data transformations Implement CI/CD pipelines for data infrastructure Collaborate with cross-functional teams on data requirements and solutions