Job title:
Senior Data Engineer – Palantir Foundry & PySpark
Company
Hertz
Job description
Job Description:JOB PURPOSE:The Senior Data Engineer, Palantir Foundry & PySpark will be responsible for building and maintaining data pipelines and workflows that support ML, BI, analytics, and software products. This individual will work closely with data scientists, data engineers, analysts, software developers and SME’s within the business to deliver new and exciting products and services. The main objectives are to develop data pipelines and fully automated workflows to drive operational efficiency and effectiveness by enabling data-driven decisions across the organization. This includes fostering collaboration, building partnerships, co-developing products, sharing knowledge, providing insights and valuable predictive information to business teams and leaders to highlight potential risks and opportunities that initiate the drive for change. The primary platform used will be Palantir Foundry and the secondary platform will be DataBricks.BUSINESS IMPACT:This role has an impact on our operational capabilities, business services and ability to service customers.Job Contributions- what will you doTECHNICAL LEADERSHIP
- Development of high-quality code for the core data stack including data integration hub, data warehouse and data pipelines.
- Build data flows for data acquisition, aggregation, and modeling, using both batch and streaming paradigms
- Empower data scientists and data analysts to be as self-sufficient as possible by building core systems and developing reusable library code
- Support and optimize data tools and associated cloud environments for consumption by downstream systems, data analysts and data scientists
- Ensure code, configuration and other technology artifacts are delivered within agreed time schedules and any potential delays are escalated in advance
- Collaborate across developers as part of a SCRUM team ensuring collective team productivity
- Participate in peer reviews and QA processes to drive higher quality
- Ensure that 100% of code is well documented and maintained in source code repository.
INNOVATIVE INFRASTRUCTURE & PROBLEM SOLVING
- Strive to engineering excellence by simplifying, optimizing, and automating processes and workflows.
TEAMWORK & COMMUNICATION
- Proactively educate others on basic data management concepts such as data governance, master data management, data warehousing, big data, reporting, data quality, and database performance.
- Superior & demonstrated team building & development skills to harness powerful teams
- Ability to communicate effectively with different levels of leadership within the organization
- Provide timely updates so that progress against each individual incident can be updated as required
- Write and review high quality technical documentation
CONTROL & AUDIT
- Ensures their workstation and all processes and procedures, follow organization standards
CONTINUOUS IMPROVEMENT
- Encourages and maintains a ‘Best practice sharing culture’, always striving to find ways to improve service and change mind set.
Experience and Qualifications
- Minimum of 5 years professional experience as a data engineer, software engineer, data analyst, data scientist or related role
- Strongly prefer hands on experience with Palantir Foundry and DataBricks
- Experience with relational and dimensional database modelling (Relational, Kimball, or Data Vault)
- Proven experience with all aspects of the Data Pipeline (Data Sourcing, Transformations, Data Quality, Etc…)
- Bachelors or Masters in Computer Science, Information Systems, or an engineering field or equivalent work experience
- Prefer Travel, transportation, or hospitality experience, especially with fleet management and vehicle maintenance.
- Prefer experience with designing application data models for mobile or web applications
- Excellent written and verbal communication skills.
- Flexibility in scheduling which may include nights, weekends, and holidays preferred
- Regular work hours are based on Eastern Time.
- Prefer experience with event driven architectures and data streaming pub/sub technologies such as IBM MQ, Kafka, or Amazon Kinesis.
- Strong capabilities in Python
- Strong capabilities in SQL and experience with stored procedures
- Strong interpersonal and communication skills with Agile/Scrum experience.
- Strong problem solving and critical thinking skills with a proven record for identifying and diagnosing problems, and solving complex problems with simple, logical solutions.
- Outstanding verbal, written, presentation, facilitation, and interaction skills, including ability to effectively communicate technical and non-technical issues and concepts to multiple organization levels.
Hertz is an equal opportunity employer, all applicants must have the legal right to work in Ireland (Valid EU Passport / Relevant Visa).What You’ll Get:
- Employee Friends & Family rental discount (40% discount for employee & partner; 30% discount for up to 8 additional family/friends)
- Hybrid/flexible working arrangements
- 22 days holidays on hire rising to 27 days with service.
- Occupational Pension Scheme with up to 5% company matched contribution.
- Life Cover payable at 4 times base salary.
- Profit Share Scheme
- Tuition support plus access to compressive online learning platform
- 10 days paid study leave & paid exam leave where exams fall during work hours.
- Income protection for long term illness
- Professional membership fees paid in full annually where membership relates directly to role.
- Bike to Work & Travel Pass schemes.
- Employee Assistance Programme for employees and family
- Occupational Health support
- Christmas savings scheme
Expected salary
Location
Co Dublin
Job date
Thu, 13 Mar 2025 01:53:17 GMT
To help us track our recruitment effort, please indicate in your email/cover letter where (jobsineu.net) you saw this job posting.
