BU LVA - Data Engineer

At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around the world.

At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our 39,000 employees work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We’re looking for people who are determined to make life better for people around the globe.

Business Units Information and Digital Solutions (IDS) is a global organization strategically positioned so that through information and technology leadership and solutions, we create meaningful connections and remarkable experiences, so people feel genuinely cared for. The Business Unit IDS organization is accountable for designing, developing, and supporting commercial or customer engagement services and capabilities that span multiple Business Units (Bio-Medicines, Diabetes, Oncology, International), functions, geographies, and digital channels. The areas supported by Business Unit IDS includes: Customer Operations, Marketing and Commercial Operations, Medical Affairs, Market Research, Pricing, Reimbursement and Access, Customer Support Programs, Digital Production and Distribution, Global Patient Outcomes, and Real-World Evidence.   

This position is responsible for developing the process of ETL / ELT / File Movement of data & integrations.   The key responsibilities will be to process and move data between different compute and storage services, as well as on-premises data sources at specified intervals. The employee will also be responsible for the creation,scheduling, orchestration, and management of data pipelines. 

• Competency

Data Engineer

Data engineers are responsible for ensuring the availability and quality of data needed for analysis and business transactions. This includes data integration, acquisition, cleansing, harmonization and transforming raw data into curated datasets for data science, data discovery, and BI/analytics. Responsible for developing, constructing, testing, and maintaining data sets and scalable data processing systems. 

Data engineers work closest with Data Architects and Data Scientists.  They also work with business and IT groups beyond the data sphere, understanding the enterprise infrastructure and the many source systems.

Input is raw datasets.  Output is analytics-ready, integrated/curated datasets.  

Key capabilities in this role family include:

• Data Acquisition - is the process of gathering and storing data in a location and format that it can be consumed for data preparation and/or downstream business uses.

• Data Preparation - is an iterative process for exploring, integrating, cleaning, validating and transforming raw data into curated datasets

• Data Publishing - is the act of releasing data in consumable form for (re)use by others.

Note: All data engineer roles should have a foundational set of knowledge in  communication, leadership, teamwork, problem solving skills, solution / blueprint definition, business acumen, architectural processes (e.g. blueprinting, reference architecture, governance, etc.), technical standards, project delivery, and industry knowledge.

Business Analysis and Technical Leadership 

• Engages with business and proactively seeks opportunities to deliver business value.  

• Understands business requirements and effectively translates business needs and process into technical terms, and vice versa 

• Elicits and defines requirements 

• Ensures appropriate business roles are engaged in solution execution. 

• Participates in design reviews to ensure traceability of requirements. 

• Networks with appropriate IT colleagues to determine solutions to meet business partners’ needs. 

• Seeks opportunities to reuse existing processes and services to streamline support and implementation of key systems.  

• Stay abreast of tools and technologies to influence IT strategy so that it provides best usage opportunities for business

• Ability to adapt quickly in a constantly changing environment

Must Have:

• Bachelor’s degree in computer science, information technology, management information systems or equivalent work experience 
• 4+ years of development experience as a data engineer with focus on core tools and technologies like AWS (Lambda, Glue , S3,  Redshift , Athena, Eventbridge , IAM Roles & Policies), Pyspark, SQL and Tableau.
• Architect and build high-performance and scalable data pipelines adhering to data lakehouse, data warehouse & data marts standards for optimal storage, retrieval, and processing of data.
• Develop data profiling and data quality methodologies and embed them into the processes involved in transforming data across the systems.
• 4+ years of experience in Agile Development and code deployment using Github & CI-CD pipelines.
• Expertise in the design, data modelling, creation, and management of large datasets/data models
• Ability to work with business owners to define key business requirements and convert to technical specifications
• Experience with security models and development on large data sets
• Ensure successful transition of applications to service management team through planning and knowledge transfer
• Develop expertise of processes and data used by business functions
• Responsible for system testing, ensuring effective resolution of defects, timely discussion around business issues and appropriate management of resources relevant to data and integration
• Partner with and influence vendor resources on solution development to ensure understanding of data and technical direction for solutions as well as delivery.

Preferred Qualifications / Certifications 

• Experience working in regulated environments and with internal systems quality policies and procedures. 
• Demonstrated experience with a variety of relational database and data warehousing technology such as AWS Redshift, Athena, RDS, BigQuery.
• Strong experience with ELT/ETL design and implementations in context of large and complex datasets.
• 2+ years of experience in job orchestration using Airflow.
• Experience in development and deployment on cloud infrastructure.
• Pharmaceutical or healthcare industry experience
• Early drug discovery industry experience
• Salesforce Health Cloud knowledge/experience is preferred.
• Defining best practices and developing technical standards, design principals, best practices, and frameworks
• Technical curiosity and desire to innovate.

Note: When applying internally for a position your current supervisor receives notification that you have applied to the position. We encourage employees to discuss the opportunity with their supervisor prior to applying.

Lilly does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status.

#WeAreLilly

Eli Lilly and Company, Lilly USA, LLC and our wholly owned subsidiaries (collectively “Lilly”) are committed to help individuals with disabilities to participate in the workforce and ensure equal opportunity to compete for jobs. If you require an accommodation to submit a resume for positions at Lilly, please email Lilly Human Resources ( Lilly_Recruiting_Compliance@lists.lilly.com ) for further assistance. Please note This email address is intended for use only to request an accommodation as part of the application process. Any other correspondence will not receive a response.

Lilly does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status.

#WeAreLilly