MACHINE LEARNING TECHNOLOGIES LLC
Senior Databricks Engineer Overview
| Company Name | MACHINE LEARNING TECHNOLOGIES LLC |
| Job Role | Senior Databricks Engineer |
| Qualifications | Not specified |
| Category | I |
| Job Type | Full Time |
| Location | Austin, TX, United States |
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Jobs Portal
- Contact Us
- Home
- About
- Adaptive AI
- Industries
- Consulting
- Jobs Portal
- Contact Us
Job Description
Job Overview
- Job ID:
J55076
- Job Title:
Senior Databricks Engineer
- Location:
Austin, TX
- Duration:
12 Months + Extension
- Domain Exposure:
Healthcare
- Client:
To Be Discussed Later
- Employment Type:
W-2, 1099, C2C
- Work Authorization:
US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other
View All Jobs
Similar Jobs
- Senior Data Engineer – Databri… – Sunnyvale, CA
- Senior .NET Full Stack Develop… – Dallas, TX
- Senior AI Observability & Eval… – Dallas, TX
- Senior Java Full Stack Enginee… – Charlotte, NC
- Senior PowerBuilder Developer – Richmond, VA
Job Title: Senior Databricks Engineer
Location: Austin, TX
Duration: 12 Months + Extension
Bill Rate: $73/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD
Job Description
- We are hiring 5 Senior Databricks Engineers to support a large-scale data modernization initiative, migrating legacy Ab Initio ETL workflows into scalable, modular PySpark pipelines on Databricks.
Key Responsibilities:
- Analyze and migrate legacy Ab Initio workflows into PySpark-based ETL pipelines.
- Design, develop, and optimize scalable data pipelines using Databricks and PySpark.
- Refactor monolithic ETL processes into modular, reusable components.
- Build ETL/ELT pipelines integrating Snowflake and other enterprise data sources.
- Support batch and near real-time data processing.
- Create end-to-end data lineage, data flow diagrams, and identify opportunities for process consolidation.
- Implement data quality, governance, and validation standards.
- Develop unit, integration, and reconciliation testing frameworks.
- Perform dual-run comparisons between legacy and modernized pipelines.
- Support UAT, pre-production validation, migration cutover, and legacy workflow decommissioning.
- Optimize job scheduling using tools such as Control-M.
- Prepare runbooks, monitoring solutions, and operational documentation.
Required Technical Skills:
- Strong hands-on experience with Databricks and PySpark.
- Experience in Ab Initio ETL migration or modernization.
- Strong ETL/ELT development and data lake architecture experience.
- Snowflake data integration experience.
- Data lineage, data governance, and data quality.
- Unit testing, integration testing, reconciliation, and dual-run validation.
- Batch and near real-time data processing.
- Control-M or similar enterprise scheduling tools.
Apply Now
Equal Opportunity Employer
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.
- Home
|
- About
|
- Adaptive AI
|
- Industries
|
- Consulting
|
- Contact Us
© 2004-2026, Machine Learning Technologies LLC, or its affiliates
Visa Sponsorship May be
To apply for this job please visit www.linkedin.com.
