Data Engineer – (Databricks)

We’re looking for an experienced Data Engineer with strong, hands-on Databricks experience to join a modern cloud and AI-focused data environment.

Databricks is a mandatory requirement for this role. We’re particularly interested in engineers who have spent several years building and optimising production data solutions on the Databricks Lakehouse Platform, rather than candidates with limited or incidental exposure.

The Role

You’ll work across modern data engineering and cloud integration initiatives, designing scalable data solutions using Databricks, AWS, Python, SQL and PySpark.

What You’ll Be Doing

• Build and optimise Databricks data pipelines and Lakehouse solutions
• Develop scalable ingestion, transformation and orchestration workflows
• Design and deliver cloud-native data integrations across AWS
• Work extensively with Python, SQL, Spark/PySpark
• Improve data performance, quality, security and governance
• Support AI-enabled data and integration initiatives
• Collaborate with engineering, architecture and business teams
• Contribute to engineering standards, automation and best practices

What We’re Looking For

• 5+ years’ Data Engineering experience
• Strong commercial, hands-on Databricks experience – mandatory
• Proven experience building and optimising production Databricks pipelines
• Strong understanding of the Databricks Lakehouse Platform
• Strong Spark/PySpark, Python and SQL
• Strong AWS experience across services such as S3, Glue, Lambda, Athena, Redshift, IAM and API Gateway
• Experience with cloud-native data integration and orchestration
• Understanding of APIs and modern integration patterns
• Strong communication and problem-solving skills

Experience with Delta Lake, Unity Catalog, Medallion Architecture, Terraform/CloudFormation, CI/CD, Docker/Kubernetes or AI development tools would be highly regarded. This is a 6 month contract with strong possibility for an extension paying $950 – $1000 per day inc super.

If you’re a hands-on Databricks Data Engineer with strong AWS experience and want to work across modern cloud, data and AI initiatives, apply now or contact ray.stewart@talentinternational.com