Data Platform Engineering Manager
Gopuff
Software Engineering
Miami Beach, FL, USA
Posted on Sep 22, 2024
Overview:
Gopuff is seeking a Data Platform Engineering Manager to lead its Data Platform team. This individual will play a major role in shaping the team’s technical direction, leading the team that enables analytics, data science, and machine learning at scale. The candidate will bring strong data and cloud engineering expertise and leadership to influence Gopuff-wide data platforms and architecture. This position will involve a combination of hands-on engineering and people management. The ideal candidate will be an experienced engineering leader with an interest in both the technical and product management aspects of data engineering.
This role is hybrid (Tues-Thurs in office) in either Philadelphia, PA or Aventura, FL.
You Will:
- Lead and mentor a team of Data Platform Engineers to develop Gopuff’s central data platform, fostering a collaborative and innovative team culture
- Drive continuous improvement within the team by developing practices around professional development, performance management, and hiring
- Provide clear technical direction and support for the team, ensuring the successful execution of data platform projects and initiatives
- Collaborate with engineering and product leadership to translate business requirements into effective technical solutions
- Develop and promote best practices for data collection, storage, and processing that impact the company-wide data strategy across Gopuff’s data lake and warehouse
- Architect and implement large-scale data platforms that enable analytics, data science, and machine learning in a multi-cloud environment
- Partner with software and analytics engineering teams to establish data contracts and improve data quality at every stage of the data lifecycle
- Manage project timelines, resource allocation, and team performance, ensuring that deliverables are met on schedule and within scope
You Have:
- 5+ years of experience in a data engineering or cloud/infrastructure engineering role
- 3+ years of engineering management experience
- Experience collaborating with functional stakeholders and establishing a roadmap that aligns with business priorities
- Experience with organizational design, team development, hiring, and performance management
- Experience building batch data pipelines using DAG-based tools such as Dagster or Airflow
- Experience deploying applications and service to Kubernetes and using related tools in the Kubernetes ecosystem (i.e. Helm, ArgoCD, Istio)
- Experience implementing DevOps best practices within the data platform, including solutions for CI/CD, data observability, monitoring, and lineage
- Experience in producing and consuming topics to/from Apache Kafka, AWS Kinesis, or Azure Event Hubs
- Experience with Infrastructure as code tools such as Terraform
- Experience developing real-time data pipelines using frameworks such as Apache Beam, Flink, Storm, Spark Streaming, etc.
- Experience with data warehouses, data lakes, and their underlying infrastructure
- Proficiency in Python, SQL, RESTful API development
- Experience with cloud computing platforms such as Azure, AWS
- Experience with data governance, schema design, and schema evolution
At Gopuff, we know that life can be unpredictable. Sometimes you forget the milk at the store, run out of pet food for Fido, or just really need ice cream at 11 pm. We get it—stuff happens. But that’s where we come in, delivering all your wants and needs in just minutes.
And now, we’re assembling a team of motivated people to help us drive forward that vision to bring a new age of convenience and predictability to an unpredictable world.
Like what you’re hearing? Then join us on Team Blue.
Gopuff is an equal employment opportunity employer, committed to an inclusive workplace where we do not discriminate on the basis of race, sex, gender, national origin, religion, sexual orientation, gender identity, marital or familial status, age, ancestry, disability, genetic information, or any other characteristic protected by applicable laws. We believe in diversity and encourage any qualified individual to apply.