Beschreibung
We are seeking a skilled Data Engineer to join our team, specializing in building and maintaining modern data pipelines using ETL/ELT methodologies. The ideal candidate will have extensive experience in transforming unstructured data into structured datasets, creating CI/CD automation, and ensuring high-quality, validated data for analytical purposes. Key Responsibilities Built and maintained scalable ELT pipelines using Databricks Developed robust data models with advanced SQL (CTEs, window functions, joins) Implemented CI/CD pipelines for dbt projects using Git Automated data validation using Python and Q-Test Managed version control, code reviews, and pull requests Migrated data across diverse sources (Excel, XML, JSON, SQL Server) Resolved production issues and ensured data reliability Collaborated with stakeholders to deliver data-driven solutions Created technical documentation and knowledge base artifacts Integrated Databricks APIs with React applications on AWS Implemented IAM security, CI/CD, and CloudWatch monitoring Optimized system performance for scalability and availability Configured end-to-end integration between Databricks APIs and React frontend applications on AWS, implementing CI/CD pipelines, IAM-based security, monitoring with CloudWatch, and optimized compute/storage setup for high availability and performance. ##LI-DNIWe are seeking a skilled Data Engineer to join our team, specializing in building and maintaining modern data pipelines using ETL/ELT methodologies. The ideal candidate will have extensive experience in transforming unstructured data into structured datasets, creating CI/CD automation, and ensuring high-quality, validated data for analytical purposes. Key Responsibilities Built and maintained scalable ELT pipelines using Databricks Developed robust data models with advanced SQL (CTEs, window functions, joins) Implemented CI/CD pipelines for dbt projects using Git Automated data validation using Python and Q-Test Managed version control, code reviews, and pull requests Migrated data across diverse sources (Excel, XML, JSON, SQL Server) Resolved production issues and ensured data reliability Collaborated with stakeholders to deliver data-driven solutions Created technical documentation and knowledge base artifacts Integrated Databricks APIs with React applications on AWS Implemented IAM security, CI/CD, and CloudWatch monitoring Optimized system performance for scalability and availability Configured end-to-end integration between Databricks APIs and React frontend applications on AWS, implementing CI/CD pipelines, IAM-based security, monitoring with CloudWatch, and optimized compute/storage setup for high availability and performance.
A little about ADP: We are a comprehensive global provider of cloud-based human capital management (HCM) solutions that unite HR, payroll, talent, time, tax and benefits administration and a leader in business outsourcing services, analytics, and compliance expertise. We believe our people make all the difference in cultivating a down-to-earth culture that embraces our core values, welcomes ideas, encourages innovation, and values belonging. We've received recognition for our work by many esteemed organizations, learn more at ADP Awards and Recognition.
Diversity, Equity, Inclusion & Equal Employment Opportunity at ADP: ADP is committed to an inclusive, diverse and equitable workplace, and is further committed to providing equal employment opportunities regardless of any protected characteristic including: race, color, genetic information, creed, national origin, religion, sex, affectional or sexual orientation, gender identity or expression, lawful alien status, ancestry, age, marital status, protected veteran status or disability. Hiring decisions are based upon ADP’s operating needs, and applicant merit including, but not limited to, qualifications, experience, ability, availability, cooperation, and job performance.
Ethics at ADP: ADP has a long, proud history of conducting business with the highest ethical standards and full compliance with all applicable laws. We also expect our people to uphold our values with the highest level of integrity and behave in a manner that fosters an honest and respectful workplace. Click https://jobs.adp.com/life-at-adp/ to learn more about ADP’s culture and our full set of values.
