Data Engineer

Functieomschrijving

Collaborate with data scientists and business analysts to develop data science (DS) and business intelligence (BI) data products, empowering and accelerating business processes
Set up and maintain infrastructure for data science use cases, including ELT pipelines, machine learning models, and app deployment, using various open-source tools. As part of this role, you’ll also act as a half-platform engineer
Work closely with BI, IT, and Data Engineering peers to identify optimal solutions on private cloud
Design, develop, and curate data pipelines to maintain reliable and well-curated data sources, enhancing productivity
Bring best practices to the entire lifecycle of data products, from development and testing to deployment and ongoing maintenance
Develop a deep understanding of data based on business acumen, collaborating closely with data scientists, business analysts, and business stakeholders
Communicate technical and business topics effectively, using written, verbal, and presentation materials as needed

Experience in creating data pipelines using SQL and Python, with a strong proficiency in both
Familiarity with Linux, Kubernetes, Airflow, and CI/CD pipelines
Knowledge of best practices for database design within relational databases (e.g., MySQL, PostgreSQL, Vertica)
Experience with Mlflow and Kubeflow is a plus
Exposure to data products, including dashboards and machine learning models
Strong problem-solving skills and a proactive attitude, capable of finding solutions with minimal guidance
A team player with a growth mindset, possessing excellent analytical, organizational, and communication skills. You’ll be able to deliver on tight deadlines in alignment with business requirements

Refer code: 931362. Tesla - De vorige dag - 2024-03-17 08:40