Data Engineer - Master Data Management - #440992

Introduction

A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat. Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.

Your Role And Responsibilities

We are looking for an experienced Data Engineer with over five years of expertise in designing, building, and maintaining scalable data pipelines and architectures. The ideal candidate will be responsible for ensuring data reliability, accessibility, and security for our organization.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL (Extract, Transform, Load) processes to support data-driven applications and analytics.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
• Develop and manage data storage solutions, including data warehouses and data lakes, using technologies such as Hadoop, Spark, or cloud-based platforms (e.g., AWS, Azure, GCP).
• Design and implement data governance policies, data quality checks, and metadata management practices.
• Ensure data security, privacy, and compliance with relevant regulations and standards.
• Monitor and optimize data processing performance and scalability.
• Stay current with emerging trends and best practices in big data technologies and data engineering.
• Mentor junior data engineers and contribute to knowledge sharing within the team.
  
  

Preferred Education

Bachelor's Degree

Qualifications

Required technical and professional expertise

• Bachelor's degree in Computer Science, Information Systems, or a related field.
• Minimum of 5 years of professional experience in data engineering.
• In-depth knowledge of data modeling, database design, and SQL.
• Proficiency in big data technologies (e.g., Hadoop, Spark, Kafka, Flink).
• Experience with cloud platforms (AWS, Azure, GCP) and related data services.
• Familiarity with data warehousing solutions (e.g., Amazon Redshift, Google BigQuery, Snowflake).
• Strong scripting skills in languages such as Python, Scala, or Shell.
• Experience with data orchestration tools (e.g., Apache Airflow, Luigi, Prefect).
• Excellent analytical and problem-solving abilities.
• Strong communication skills with the ability to collaborate effectively with diverse teams.
• Professional certifications (e.g., AWS Certified Big Data - Specialty, Google Professional Data Engineer) are a plus.
  
  

Preferred Technical And Professional Experience

Hiring manager and Recruiter should collaborate to create the relevant verbiage.