Senior Data Engineer (Machine Learning/ Informatica)

We are looking for a talented Data Engineer to join our team and work on developing an internal enterprise chatbot using GPT and Llama models. 

The ideal candidate will be responsible for designing, building, and maintaining the data pipeline for the project, ensuring that data is available, reliable, and accurate for machine learning models. 

Key Responsibilities: 

• Design, build, and maintain the data pipeline for Machine Learning models 
• Develop and maintain data pipelines for processing and storing large amounts of data
• Collaborate with data scientists and machine learning engineers to ensure data is ready for use by the chatbot. 
• Design and implement data models and schema to support the chatbot's natural language processing capabilities. 
• Develop and maintain data quality standards and processes to ensure data accuracy and completeness. 
• Ensure data security and compliance with data privacy regulations. 
• Continuously monitor and optimize the performance of the data infrastructure and pipelines 
• Provide technical guidance and support to other team members as needed.