Luminar is a global automotive technology company ushering in a new era of vehicle safety and autonomy. For the past decade, Luminar has built an advanced hardware and software/AI platform to enable its more than 50 industry partners, including the majority of global automotive OEMs. From consumer vehicle programs with Volvo Cars and Mercedes-Benz to technology partnerships including NVIDIA and Mobileye, Luminar is poised to be the first automotive technology company to enable next-generation safety and autonomous capabilities for global production vehicles.
For more information, please visit www.luminartech.com.
Team OverviewWe are seeking an experienced and technical Data Engineering/Architect to lead our enterprise-level initiative in building reliable and scalable Data Pipelines at Luminar Technologies. The successful candidate will have in-depth experience with Databricks and AWS. Be responsible for driving the design, implementation, and management of data pipelines. Work closely with stakeholders across the organization including business leaders, IT leadership and external partners.
Responsibilities- Build data pipelines using Delta Live Table Framework such as Autoloader, Delta Tables (View, Materialized View, Streaming View), Expectation, Workflows, Change Data Capture, SCD, Data Asset Bundle, Python, and Spark
- Manage internal/external tables & volumes, access control, tagging, comments, and credentials on Unity Catalog
- Implement DevOps processes on the Databricks platform, harmonize and curate pipelines across all programs
- Programming and debugging in Python and SQL.
- Manage Databricks on AWS
- Help reduce consumption and improve performance issues. Can help build monitoring tools
- Build and develop RAGs and AI functions in Databricks
- Define data requirements that determine the different types of data structure needed for a project, such as raw, conform, and consumption data layers. Demonstrating the structure model types such as 3rd Normal Form, denormalized, and dimensionalized structures.
- 5+ years of experience in data engineering, data science, technical architecture, or similar roles
- Bachelor’s or master’s degree in computer science, Information Systems, or a related field.
- On-Hands experiences with Databricks, Python, SQL, Spark
- Knowledgeable of security, privacy, and compliance requirements
- Excellent communication and interpersonal skills to effectively collaborate with cross-functional teams.
Preferred Qualifications
- Databricks Certification
- 10+ years of experience in data engineering, data science, technical architecture, or similar role
Luminar is an equal opportunity employer. All applicants will be considered for employment without regard to race, color, ancestry, national origin, sex, gender, sexual orientation, marital status, religion, age, disability, gender identity, results of genetic testing, service in the military, or any other characteristic protected by applicable federal, state or local laws. We will make a reasonable accommodation for any qualified applicant with a disability, provided that the individual is otherwise qualified to safely perform the essential functions of the job with or without accommodation and that the accommodation would not impose an undue hardship on the operation of our business. Please let us know if you believe you require reasonable accommodation, or if you would like assistance to complete an application or to participate in an interview at the company.
