Apply Buddy
support@applybuddy.ai | (123) 456-7899 | Silicon Valley, CA
Professional Summary
Senior Data Engineer with 9 years of experience designing petabyte-scale data platforms. Proven track record of reducing infrastructure costs, mentoring engineering teams, and enabling advanced machine learning capabilities.
Professional Experience
- Architected a lakehouse solution using Databricks and Delta Lake, serving as the single source of truth for 50+ analysts.
- Optimized spark jobs and cluster configurations, resulting in a 40% reduction in monthly cloud compute costs ($200k/year savings).
- Led a team of 4 engineers in migrating from a batch-only architecture to real-time streaming using Kafka.
- Established CI/CD workflows for infrastructure-as-code using Terraform.
- Developed a custom ingestion framework in Python that onboarded new third-party data sources in hours instead of days.
- Maintained and tuned a Hadoop/Hive cluster processing sales data for 500+ retail locations.
- Collaborated with data scientists to deploy ML feature stores.
- Developed complex PL/SQL stored procedures for financial reporting.
- Optimized slow-running queries and performed database indexing.
Skills
System Architecture, Python / Scala, Distributed Systems (Spark/Kafka), Cloud Infrastructure (AWS/Terraform), Cost Optimization, Team Leadership
Education
Certifications
- AWS Certified Solutions Architect - Professional