We are seeking an experienced Data Engineer to help us deliver AI-driven products and solutions. As a Data Engineer, you will be responsible for designing, implementing and maintaining databases and the associated scripts and batch jobs that are used in our solutions to provide decision-enabling insights to our users.
Responsibilities:
- Review and validate the database schema and the scripts created by AI agents to populate the database; provide feedback to the AI Agents to ensure that the database schema and the scripts meet the solution requirements.
- Work with clients to implement batch jobs to extract the required data from the client systems on a periodic basis and import the client data in the solution in a secure manner.
- Work with the Software Development and DevOps teams to design, implement and maintain the ETL processes required in our solution.
Requirements:
- Bachelor’s degree in Computer Science, Information Technology, or a related field. Master’s degree or higher is a plus.
- Minimum 8 years of experience in Data engineering and ETL processes.
- Proven experience in working with SQL and NoSQL databases in a cloud environment.
- Strong proficiency in programming languages such as Python that are used for data extraction and processing.
- Experience with GenAI tools such as ChatGPT and Claude.
- Experience with databases and services in cloud environments such as Microsoft Azure.
- Solid understanding of machine learning algorithms, data structures, and software engineering principles.
- Strong problem-solving skills and the ability to work independently as well as part of a team.
- Excellent communication skills with the ability to explain complex technical concepts to non-technical stakeholders.
