Overview:
Are you a seasoned data engineering leader passionate about building and scaling high-performing data teams? Do you thrive on setting technical vision, mentoring engineers, and driving the creation of robust, efficient data platforms that transform raw data into critical business insights? If so, we want you to lead our fast-growing data engineering team and help shape the future of data-driven retail!
Who We Are:
We're a small but ambitious startup revolutionizing the retail experience through innovative technology. We're passionate about creating user-friendly, engaging experiences that make shopping effortless and enjoyable. We work collaboratively, value open communication, and believe in fostering a culture of continuous learning and growth.
What You’ll Do:
- Lead and mentor a team of data engineers, fostering a culture of technical excellence, collaboration, and continuous improvement.
- Define and drive the technical vision, strategy, and roadmap for our data platform, ensuring alignment with overall business objectives.
- Design, build, and maintain scalable data pipelines and ETL processes to support business analytics and operational needs.
- Collaborate with cross-functional teams to integrate, transform, and make data accessible for analysis and decision-making.
- Implement and optimize data ingestion processes, ensuring efficient data movement across systems.
- Develop and manage Spark-based data processing workflows for real-time and batch processing.
- Write clean, efficient, and well-documented Python code to support data engineering workflows.
- Monitor and troubleshoot data pipelines, ensuring high availability and reliability.
- Drive best practices for data governance, security, and quality to ensure accuracy and consistency.
- Stay up to date with industry trends, tools, and best practices to continuously improve our data architecture and processes
What You Bring:
- 5+ years of experience as a Data Engineer, with at least 2+ years in a technical leadership or team lead role, managing or mentoring a team of data engineers and working with large-scale data infrastructure.
- Strong proficiency in Python for data processing and automation.
- Deep understanding of distributed data processing architecture and tools such as Spark, Kubernetes and Kafka.
- Experience working with data integration tools.
- Deep understanding of ETL processes and data pipeline orchestration.
- Self-motivated and proactive with a strong ability to learn new technologies quickly.
- Exceptional leadership skills with the ability to inspire, motivate, and develop a high-performing team.
- A humble yet confident mindset, open to feedback and collaboration.
- Excellent problem-solving skills with a keen attention to detail.
Bonus Points:
- Experience with cloud platforms such as GCP, AWS, or Azure.
- Familiarity with data warehouse solutions like Snowflake, BigQuery, or Redshift.
- Knowledge of workflow orchestration tools such as Apache Airflow.
- Experienced in deploying and maintaining complex machine learning models in production environments.
- Prior experience working in a startup environment.
- Knowledge of CI/CD pipelines and test-driven development.