Data Engineer - II

QUALIFICATIONS

• Bachelor's or master's degree in computer science, engineering, or a related field
• 5+ years of professional experience as a data engineer, with a strong focus on cloud- based data engineering using AWS services
• Solid understanding of cloud computing concepts and experience working with AWS technologies and services, such as Amazon S3, Amazon Redshift, AWS Glue, AWS Lambda, and others
• Must have strong proficiency in Python, and hands-on experience in using python for ETL and other data transformation projects
• Strong experience with SQL and database technologies, knowledge of cloud data warehouses like snowflake would be a plus
• Hands-on understanding of DevOps practices and ability to build automation that can securely deploy changes to cloud platforms
• Ability to perform performance optimizations at both ETL and database loads
• Experience in building and optimizing data pipelines and ETL processes, leveraging technologies such as Apache Spark, Apache Airflow, or AWS Glue
• Experience in Microservices, Event-driven architectures and complex integrations
• Familiarity in data warehousing concepts and experience with data modeling and schema design
• Excellent problem-solving skills and the ability to analyze and resolve complex data engineering challenges
• Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment

WHO YOU'LL WORK WITH

You will join McKinsey's Visual Graphics & Media (VG&M) organization, as a core member of the Data engineering team, committed to solving business problems using data and technology. 
You will work closely with experts in various disciplines - designers, researchers, engineers, spread across India and Europe - and together the team relentlessly strives to deliver outcomes that matter. 
We are seeking an experienced cloud data engineer to shape and accelerate the delivery of target state cloud-based platforms and transform transactional data into valuable business insights. We want a passionate engineer who loves to build our data solutions on the cloud that enhances our capability to build great data-driven products, AI/ML capabilities, and enable data governance, in a high-energy agile environment.

WHAT YOU'LL DO

As a member of the team, you will be responsible for building our cloud-based enterprise data platform and help accelerate our firm’s cloud-first transformation.  
As an expert cloud data engineer, you will be responsible for developing innovative data ingestion solutions to integrate across on-premises and SaaS ecosystems. You will work with a team of data engineers that works across the global hubs to build target state platforms and migrate existing applications and products. 
You will also be part of an effort to build next-gen data platforms on the cloud to enable our Enterprise colleagues with rapid data access and incubate emerging technologies. You will be part of the team managing data governance, ensuring necessary data security and lifecycle controls are in place.