Big Data Engineer - #453446

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Job Description

Technical Skills:

Data Structures and Algorithms: Expertise in designing efficient data structures and algorithms for big data processing.

Distributed Systems: Experience with distributed computing frameworks and parallel processing.

Data Integration: Proficiency in integrating data from various sources and ensuring data consistency.

Performance Optimization: Skills in optimizing data processing and storage for high performance.

Containerization: Experience with Docker and Kubernetes for deploying big data applications.

Version Control: Proficiency in using Git for collaborative development.

Security: Knowledge of data security practices and compliance with regulatory standards.

Machine Learning: Familiarity with machine learning techniques and their application in big data environments

Responsibilities:

Design, develop, and maintain scalable big data architectures and systems.

Implement data processing pipelines using technologies such as Java, Spring Batch, Spring Boot, Scala ,Hadoop, Spark, and Kafka.

Optimize data storage and retrieval processes to ensure high performance and reliability.

Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

Perform data modeling, mining, and production processes to support business needs.

Ensure data quality, governance, and security across all data systems.

Stay updated with the latest trends and advancements in big data technologies.

Experience with real-time data processing and stream analytics.

Knowledge of advanced analytics and data visualization tools.

Knowledge of DevOps practices and tools for continuous integration and deployment

Experience in managing big data projects and leading technical teams

Disclaimer

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law.

Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.

Applicants for employment in Canada must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in Canada by Capgemini.

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.