Senior Data Engineer (BB100FT RM 3989)

Position: Senior Data Engineer (BB100FT RM 3989)

Key responsibilities include:

• Refactor and build reusable data pipelines in AWS and Databricks.
• Collaborate with business analysts, data scientists, architects, developers, and business stakeholders to deliver fit-for-purpose solutions.
• Design and develop cloud-based solutions for data lakes, data warehouses, ETL processes and backend services for structured, and unstructured data.
• Participate in code reviews and documentation efforts.
• Optimize pipelines for cost, scalability, reliability and security
• Implement rigorous testing and monitoring protocols.
• Resolve performance bottlenecks and optimize workloads.
• Stay current with data engineering trends and apply them where relevant.
• Mentor other data engineers and contribute to competence development.

Education and experience

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• 10+ years of experience in data engineering, data analytics and backend services.
• Hands-on experience with AWS Cloud and Databricks
• Proficiency across multiple execution and query paradigms, including:
  o Event-driven and orchestration workflows for serverless computing (AWS Lambda, Step Functions)
  o General-purpose and scripting languages for automation and data processing (Python, Bash, Make)
  o Query languages for structured and semantic data (SQL, SPARQL).
• Solid understanding of multiple data paradigms, including
  o Relational data for structured storage and analytics (AWS Redshift)
  o Key-value and document-oriented models for high-performance transactional workloads (DynamoDB)
  o Object storage for semi-structured data and large-scale lakes (AWS S/3)
  o Graph-based data models for relationship-driven queries and semantic structures (AWS Neptune)
• GIT and CI/CD experience required; GitLab preferred
• Infrastructure as Code experience required; AWS CDK preferred
• Experience with Gitlab for Version Management, CI/CD and CDK for Infra as Code.

Skills
Working at the cutting edge of tech, you’ll always have new challenges and new problems to solve – and working together is the only way to do that. You won’t work in a silo. Instead, you’ll be part of a creative, dynamic work environment where you’ll collaborate with supportive colleagues. There is always space for creative and unique points of view. You’ll have the flexibility and trust to choose how best to tackle tasks and solve problems.

To thrive in this job, you’ll need the following skills:

• Passion for data engineering and solving real-world problems.
• Customer-centric mindset and value-driven approach.
• Strong analytical and problem-solving capabilities.
• Excellent collaboration and communication skills.
• Knowledge of data architecture techniques and data modeling concepts.
• Exceptional mentorship abilities
• Familiarity with agile and scrum methodologies.
• Proactive attitude toward continuous improvement.

*******************************************************************************************************************************************