IT & Telecomms
Data Engineer - Databricks
Customise Talent Partners was created with a mandate to bring together the highest calibre professionals within Recruitment, to add value when solving growing organisations talent related challenges. The whole is greater than the sum of its parts.
APPLY FOR THIS JOBAbout The Role
About IT & Telecomms
You will play a key role in further building our client's Databricks offering and enabling data-driven decision-making across the organization.
Addressing the short comings found in most traditional recruitment agencies was one of the cornerstones that CTP was built on. Why should you pay for legacy overheads that add little value to solving your needs? We sought about empowering our team to deliver quality to you; not a focus on KPIs & volume. CTP has eliminated the pressure on employees that typically gets generated to pay for the expensive offices, inefficient and outdated systems, managerial staff, and shareholders' increasing demands for profitability.
JOB DETAILS
- Design and architecture
- Opportunity to be a thought leader
- Fun and welcoming team
I am seeking a highly skilled Senior Data Engineer to join my clients data initiatives, with a focus on designing, developing, and maintaining scalable data solutions in Azure and Databricks. You will play a key role in further building their Databricks offering and enabling data-driven decision-making across the organization.
Key Responsibilities:
- Design, develop, and optimize data pipelines and workflows using Azure services and Databricks.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver effective solutions.
- Ensure data security, quality, and governance across all platforms.
- Automate data processing and implement best practices for data architecture.
- Support and enhance existing data systems, ensuring scalability and robustness.
- Stay current with emerging technologies and industry trends related to Azure and data engineering.
- Proven extensive experience as a Data Engineer or in a similar role.
- Strong expertise in Azure Data Services (Azure Data Factory, Databricks, Synapse Analytics, etc.).
- In-depth knowledge of Databricks and its capabilities for data orchestration and processing.
- Proficiency in SQL, Python, Spark, or other relevant programming languages.
- Experience with data modeling, ETL/ELT processes, and cloud data architecture.
- Excellent problem-solving skills and the ability to work in a fast-paced environment.
- Strong communication skills and team collaboration abilities.
- Microsoft certifications related to Azure Data Engineer or Data Fundamentals.
- Databricks certifications
