Data Engineer – Core Python (MT610FT RM 3738)

Position: Data Engineer – Core Python (MT610FT RM 3738)

Job Summary:
We are seeking a highly skilled Data Engineer with a strong background in Python to join our dynamic team. The ideal candidate will have 6 to 10 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.

Skills Core Python + good to have PySpark

Responsibilities:

• Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.
• Implement data models and architectures that support analytics and reporting needs.
• Optimize data storage and retrieval processes for performance and scalability.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Monitor and troubleshoot data pipeline performance, implementing improvements as necessary.
• Stay updated with industry trends and best practices in data engineering and related technologies.
• Document data processes, architectures, and workflows for knowledge sharing and compliance.

Mandatory Skills:

• Strong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.
• Extensive experience with SQL and relational databases (e.g., PostgreSQL, MySQL).
• Hands on experience with data warehousing solutions and ETL tools.
• Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
• Strong understanding of data modeling concepts and best practices.
• Excellent problem solving skills and attention to detail.

Preferred Skills:

• Experience with data visualization tools (e.g., Tableau, Power BI).
• Knowledge of machine learning concepts and frameworks.
• Familiarity with containerization technologies (e.g., Docker, Kubernetes).
• Experience with version control systems (e.g., Git).

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 6 10 years of experience in data engineering or a related field.
• Proven track record of successful data projects and implementations.
• Strong communication skills and ability to work collaboratively in a team environment.

*******************************************************************************************************************************************