Netherlands – Rotterdam | Senior Data Engineer
About Us:
MetrixLab is a global market research and insights company. We are challenging the status quo of insights by blending evolving technology with passionate experts. MetrixLab helps global and local brands to drive more business impact. From packaging to creative testing, and brand tracking to media effectiveness, MetrixLab’s solutions adapt to fit all types of budgets, timelines and business needs.
Headquartered in Rotterdam, we have offices in more than 20 countries and we counted -so far- 31 nationalities. A truly international environment!
We are seeking a highly skilled Senior Data Engineer with extensive experience in AWS, DataLake, Data Pipeline, Python, AWS Athena, Snowflake, and Databricks. The successful candidate will be responsible for designing, building, and maintaining our data infrastructure, ensuring that data is readily accessible, secure, and optimized for performance. This role requires a strategic thinker with a deep understanding of modern data engineering technologies and best practices.
Key Responsibilities:
- Design and Develop Data Infrastructure:
- Design, build, and manage scalable data pipelines using AWS services.
- Develop and maintain data lakes, data warehouses, and data marts.
- Implement data integration strategies using AWS Athena, Snowflake, and Databricks.
- Data Pipeline Management:
- Create and manage ETL processes to gather data from multiple sources.
- Ensure efficient and reliable data flow across systems using tools like AWS Glue, Databricks, and other ETL platforms.
- Optimize data pipeline performance and scalability.
- Programming and Scripting:
- Write clean, efficient, and well-documented code in Python.
- Develop automated processes for data ingestion, transformation, and validation.
- Utilize Spark and PySpark within Databricks for large-scale data processing.
- Collaboration and Communication:
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements.
- Provide technical guidance and mentorship to junior data engineers.
- Communicate complex technical concepts to non-technical stakeholders.
- Monitoring and Optimization:
- Monitor data systems for performance and reliability issues.
- Troubleshoot and resolve data-related issues in AWS Athena, Snowflake, Databricks, and other platforms.
- Continuously improve data infrastructure to meet changing business needs.
- Security and Compliance:
- Implement data security and compliance measures.
- Ensure adherence to data governance policies and best practices.
Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or a related field.
- Proven experience with AWS services (e.g., S3, Redshift, Glue, EMR, Athena).
- Strong experience with data lakes and data warehouses, particularly with Snowflake.
- Expertise in building and maintaining data pipelines.
- Experience with Databricks, Spark, and PySpark for data processing.
- Proficiency in Python and related libraries (e.g., Pandas, NumPy).
- Strong understanding of ETL processes and tools.
- Familiarity with big data technologies (e.g., Hadoop, Spark, Databricks).
- Experience with SQL and relational databases.
- Knowledge of data modeling and database design.
- Excellent problem-solving skills.
- Strong communication and collaboration skills.
Compensation and benefits:
- Competitive salary package
- Good pension scheme
- Company discount on health insurance
- 25 paid days of leave
- Full travel reimbursement (yes, that includes cycling!)
- Subscription to Udemy Business
- A challenging position in a dynamic, fast-paced, innovative, quickly growing global IT driven market research company
- A flexible work environment with a focus on owning and taking pride in your work
- Growth opportunities in line with your career ambitions and passions
- An open-culture work environment staffed with ambitious colleagues with “can-do” mentalities
- An amazing, stylish office space in one of the city’s most trendy areas, close to the Hotel New York where we have weekly (free!) Friday afternoon drinks
Application process
Please send in your applications to: [email protected] including your CV, motivation and salary expectations
Contact
Office location: Wilhelminakade 312 │3072 AR Rotterdam │ The Netherlands
Contact: [email protected] │ www.metrixlab.com │ +31 10 2030700