Progressive is dedicated to helping employees move forward and live fully in their careers. Your journey has already begun. Apply today and take the first step to Destination: Progress.
As a data engineering lead within the Personal Lines Media Data Operations team, you’ll play a pivotal role in empowering data scientists, analysts, and business stakeholders with cutting-edge tools, technologies, infrastructure, and data solutions. This team is responsible for enabling data-driven decision-making by optimizing advertising campaigns, deploying predictive analytics, and maintaining robust data systems. In this role, you’ll design and implement real-time APIs, scalable data pipelines, and cloud-based infrastructure to support machine learning model deployment and advanced analytics, while also growing your expertise in cloud infrastructure, generative AI, machine learning, and data engineering. As a lead, you’ll take ownership of projects from inception to delivery, refine and shape requirements to meet business needs, mentor team members to foster growth, and spearhead innovation to tackle complex data challenges.
This is a remote position for US based work only.
Must-have qualifications
- Bachelor's Degree or higher in an Information Technology discipline or related field of study and minimum of five years of work experience designing, programming, and supporting software programs or applications.
- In lieu of degree, minimum of six years related work experience designing, programming, and supporting software programs or applications may be accepted.
Preferred skills
- Extensive experience with Python, Terraform/CloudFormation, Snowflake or Databricks (Data Lakehouse architecture), and AWS Cloud services, including Lambda, API Gateway, CloudFront, Route 53, S3, and EC2. Proficiency in CI/CD tools such as GitHub Actions or Jenkins, and orchestration tools such as Prefect or Airflow. Proven experience with real-time data streaming platforms such as Kafka or Kinesis.
- Data Pipeline Development & Management: Demonstrated ability to design and build robust data pipelines, including ingestion of flat files, handling semi-structured data, API data integration, and real-time processing. Expertise in working with massive datasets in Snowflake or Databricks, including data deduplication, cleansing, data modeling, and organization for downstream users. Experience with DBT for data transformation is a plus.
- Machine Learning & Model Deployment: Experience deploying data science models into production environments, particularly using real-time API systems for low-latency model scoring. Strong understanding of end-to-end system architecture and complex logging for analytics in Snowflake or Databricks.
- Operational & DevOps Skills: Solid background in Linux systems, Docker, and networking. Proven ability to manage Infrastructure as Code (IaC) and automate deployment processes to ensure reliability and scalability.
- Leadership & Stakeholder Collaboration: Demonstrated ability to lead projects independently, refine incomplete requirements, and collaborate effectively with stakeholders, data scientists, and analysts to support data-driven decision-making.
- Troubleshooting & Debugging: Exceptional problem-solving skills with the ability to troubleshoot and debug complex data systems and workflows, ensuring reliability and efficiency in production environments. Experience with monitoring tools such as Splunk or CloudWatch is beneficial.
Compensation
- $147,000 to $160,000/year
- Gainshare annual cash incentive payment up to 40% of your eligible earnings based on company performance
Benefits
- 401(k) with dollar-for-dollar company match up to 6%
- Medical, dental & vision, including free preventative care
- Wellness & mental health programs
- Health care flexible spending accounts, health savings accounts, & life insurance
- Paid time off, including volunteer time off
- Paid & unpaid sick leave where applicable, as well as short & long-term disability
- Parental & family leave; military leave & pay
- Diverse, inclusive & welcoming culture with Employee Resource Groups
- Career development & tuition assistance
- Onsite gym & healthcare at large locations
Energage recognizes Progressive as a 2024 Top Workplace for: Innovation, Purposes & Values, Work-Life Flexibility, Compensation & Benefits, and Leadership.
Equal Opportunity Employer
Sponsorship for work authorization for foreign national candidates is not available for this position.
