We're looking for a hands-on Senior Data Engineer to take a leading role in architecting, designing, building, and evolving our AWS-based data platform. This is not a maintenance role-you'll have meaningful technical ownership and influence over how data is architected, processed, and delivered across our systems and product suite.
You'll tackle large-scale, complex data challenges while driving architectural decisions, establishing engineering best practices, and designing solutions for scalability, reliability, performance, and cost efficiency. As a senior member of the team, you'll collaborate across engineering and product, provide technical guidance and mentorship, and help shape the evolution of our platform toward a more modern, scalable, and intelligent data architecture.
Primary Responsibilities
· Analyze large, and complex, data sets
· Design, develop and coordinate the generation of Data Pipelines
· Work collaboratively with team to plan and solve complex problems
· Design for, or optimize existing pipelines, for performance and cost
Required Experience (Must Have)
· Expert Python & SQL Developer
· Strong AWS Experience (Lambda, Glue, State Machines, Fargate, Cloud Formation, RedShift)
· Strong Experience with Semi-Structured Data (XML, CSV, JSON, Parquet)
· Strong Automation Experience
· Experience with Databricks (Delta Lake, Notebooks, SQL Analytics)
· Experience with Kubernetes (Cluster Orchestration, Container Networking, Pod Management)
· Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
· Experience with Agentic AI (LangGraph, MCP Servers, Agent Frameworks)
· Experience with Data Handling (Pandas / NumPy, Apache Spark, Ray)
Helpful Experience (Nice to Have)
· Experience with LLMs, Machine Learning & Deep Learning Libraries, AI Application Frameworks, Vector Databases
· Experience with Automotive Data / Industry
· Experience with Agile / Scrum
Required Experience (Must Have)
- Expert Python & SQL Developer
- Strong AWS Experience (Lambda, Glue, State Machines, Fargate, Cloud Formation, RedShift)
- Strong Experience with Semi-Structured Data (XML, CSV, JSON, Parquet)
- Strong Automation Experience
- Experience with Databricks (Delta Lake, Notebooks, SQL Analytics)
- Experience with Kubernetes (Cluster Orchestration, Container Networking, Pod Management)
- Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
- Experience with Agentic AI (LangGraph, MCP Servers, Agent Frameworks)
- Experience with Data Handling (Pandas / NumPy, Apache Spark, Ray)
Helpful Experience (Nice to Have)
- Experience with LLMs, Machine Learning & Deep Learning Libraries, AI Application Frameworks, Vector Databases
- Experience with Automotive Data / Industry
- Experience with Agile / Scrum
AWS-based,data platform,intelligent data,reliability,architecting,architecture,maintenance,mentorship,scalability,designing solutions,cost efficiency